-- Logs begin at Tue 2022-03-08 13:11:00 UTC, end at Tue 2022-03-08 14:13:15 UTC. -- Mar 08 13:37:37.583189 dv-cinder-830092-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Mar 08 13:37:37.593586 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Mar 08 13:37:37.598209 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Mar 8 13:37:37 2022] *** Mar 08 13:37:37.598209 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 08 13:37:37.598209 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 08 13:37:37.598209 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: nodename: dv-cinder-830092-2-iscsi Mar 08 13:37:37.598209 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: machine: x86_64 Mar 08 13:37:37.598209 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: clock source: unix Mar 08 13:37:37.598209 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: pcre jit disabled Mar 08 13:37:37.598209 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: detected number of CPU cores: 4 Mar 08 13:37:37.598209 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: current working directory: / Mar 08 13:37:37.598209 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: detected binary path: /usr/bin/uwsgi-core Mar 08 13:37:37.598209 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: your processes number limit is 47680 Mar 08 13:37:37.598794 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: your memory page size is 4096 bytes Mar 08 13:37:37.598794 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: detected max file descriptor number: 2048 Mar 08 13:37:37.598794 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: lock engine: pthread robust mutexes Mar 08 13:37:37.598794 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: thunder lock: enabled Mar 08 13:37:37.598794 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Mar 08 13:37:37.598794 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 08 13:37:37.642891 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: Python main interpreter initialized at 0x559c408a59c0 Mar 08 13:37:37.642891 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: python threads support enabled Mar 08 13:37:37.642891 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: your server socket listen backlog is limited to 100 connections Mar 08 13:37:37.642891 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: your mercy for graceful operations on workers is 90 seconds Mar 08 13:37:37.643229 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: mapped 403077 bytes (393 KB) for 2 cores Mar 08 13:37:37.643386 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: *** Operational MODE: preforking *** Mar 08 13:37:37.643683 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: *** uWSGI is running in multiple interpreter mode *** Mar 08 13:37:37.643683 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: spawned uWSGI master process (pid: 91139) Mar 08 13:37:37.643904 dv-cinder-830092-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Mar 08 13:37:37.644443 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: spawned uWSGI worker 1 (pid: 91153, cores: 1) Mar 08 13:37:37.644966 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: spawned uWSGI worker 2 (pid: 91154, cores: 1) Mar 08 13:37:37.645905 dv-cinder-830092-2-iscsi devstack@keystone.service[91139]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 08 13:37:43.274893 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 13:37:43.274893 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: from cryptography.utils import int_from_bytes Mar 08 13:37:43.275689 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 13:37:43.275689 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: from cryptography.utils import int_from_bytes Mar 08 13:37:43.276090 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 13:37:43.276090 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: from cryptography.utils import int_from_bytes Mar 08 13:37:43.276208 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 13:37:43.276208 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: from cryptography.utils import int_from_bytes Mar 08 13:37:43.320366 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 13:37:43.320533 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 13:37:43.320619 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 13:37:43.320700 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 13:37:43.320768 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] command line args: [] {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 13:37:43.320832 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] command line args: [] {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 13:37:43.321077 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 13:37:43.321168 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 13:37:43.321235 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ================================================================================ {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 13:37:43.321294 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ================================================================================ {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 13:37:43.321511 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] admin_token = **** {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.321588 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] admin_token = **** {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.321667 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] config_dir = [] {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.321728 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] config_dir = [] {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.321790 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.321855 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.322036 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] config_source = [] {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.322116 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] config_source = [] {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.322116 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] debug = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.322228 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] debug = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.322370 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.324592 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.324592 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.324750 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.324817 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.324884 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] insecure_debug = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.324945 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.325007 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.325065 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.325127 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.325192 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] list_limit = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.325257 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] list_limit = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.325321 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] log_config_append = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.325680 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] log_config_append = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.325788 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.326092 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.326092 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] log_dir = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.326465 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] log_dir = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.326465 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] log_file = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.326808 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] log_file = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.327005 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.327197 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.327385 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.327610 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.327610 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.327966 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.328152 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.328349 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.328549 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.328779 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.328982 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.329145 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.329334 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.329529 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.329722 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.329961 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.330129 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.330318 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.330477 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.330642 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.330812 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.330946 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.331082 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.331248 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.331384 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.331524 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.331666 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.331797 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] notification_format = cadf {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.331954 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.332103 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.332239 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.332376 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.18/identity {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.332504 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] publish_errors = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.332636 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] publish_errors = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.332770 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.332902 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.333035 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.333163 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.333317 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.333483 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.333623 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.333810 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.333951 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.334084 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.334213 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] standard_threads = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.334351 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] standard_threads = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.334479 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.334611 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] strict_password_check = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.334738 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.334864 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.334991 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.335125 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] use_eventlog = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.335261 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] use_journal = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.335389 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] use_journal = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.335514 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] use_json = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.335651 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] use_json = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.335930 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] use_stderr = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.336108 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] use_stderr = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.336247 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] use_syslog = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.336415 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] use_syslog = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.336587 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.336723 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] watch_log_file = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 13:37:43.336857 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.336996 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.337125 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.337258 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.337403 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.337545 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.337674 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.337819 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.337947 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.338079 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.338212 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.338339 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.338552 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.338682 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.338814 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.338942 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.339068 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.339194 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.339332 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.339461 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.339588 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.339725 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.339851 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.339977 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.340111 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.340239 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.340365 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.340504 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.340631 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.340765 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.340899 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.341034 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.341168 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.341298 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.341474 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.341605 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.341793 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.341925 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.342052 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.342177 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.342302 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.342428 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.342571 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.342699 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.342825 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.342957 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.343083 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.343220 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.343355 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.343489 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.343622 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.343750 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.343881 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.344007 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.344141 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.344269 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.344394 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.344520 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.344645 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.344778 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.344988 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.345123 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.345297 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.345480 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.345608 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.345736 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.345877 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.346005 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.346132 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.346258 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.346385 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.346510 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.346646 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.346775 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.346911 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.347037 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.347163 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.347298 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.347425 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.347551 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.347683 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.347815 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.347943 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.348077 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.348205 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.348341 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.348467 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.348593 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.349788 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.350036 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.350200 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.350389 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.350575 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.350762 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.350955 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.351188 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.351350 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.351535 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.351725 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.351725 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.352089 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.352089 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.352457 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.352457 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.352900 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.353063 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.353251 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.353528 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.353693 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.353888 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.354076 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.354264 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.354452 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.354748 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.354912 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.355091 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.355227 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.355356 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.355517 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.355659 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.355800 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.355929 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.356065 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.356224 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.356366 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.356495 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.356630 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.356760 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.356905 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.357034 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.357161 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.357289 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.357438 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.357609 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.357741 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.357869 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.358009 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.358215 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.358395 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.358541 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.358738 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.358923 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.359094 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.359251 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.359381 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.359517 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.359646 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.359780 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.359915 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.360045 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.360219 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.360386 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.360517 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.enabled = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.360644 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.360770 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.360914 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.361049 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.361260 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.361427 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.361570 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.361699 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.361834 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.361965 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.362102 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.362231 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.362358 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.362486 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.362614 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.362753 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.362893 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.362893 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.363133 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.363259 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.363387 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.363521 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.363651 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.363778 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.363904 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.364030 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.364163 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.364298 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.364435 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.364587 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.364718 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.364844 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.364971 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.365098 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.365224 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.365377 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.365521 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.365651 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.365779 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.365907 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.366042 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.366179 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.366308 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.366445 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.366572 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.366700 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.366827 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.366962 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.367091 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.367219 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.367346 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.367479 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.367645 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.367792 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] auth.external = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.367923 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.368050 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.368178 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.368321 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.368451 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] auth.external = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.368589 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.368745 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] auth.mapped = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.368894 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] auth.password = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.369032 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.369162 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] auth.token = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.369298 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.369487 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.369618 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] auth.password = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.369761 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.369893 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] auth.token = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.370021 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.370159 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.370287 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.370423 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] catalog.caching = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.370552 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.370680 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.370810 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.370938 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.371072 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.371210 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.371210 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.371210 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.371567 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] credential.caching = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.371695 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] credential.caching = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.371828 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.371979 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] credential.driver = sql {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.372109 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.372238 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.372367 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.372494 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.372621 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.372757 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.372892 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.373022 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.373150 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.373277 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.373424 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.373567 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.373706 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.373842 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.373971 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.374145 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.374278 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.374416 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.374547 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.374681 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.374811 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.374939 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.375074 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.375212 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.375341 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.375469 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.375608 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.375737 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.375865 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] federation.caching = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.376000 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] federation.caching = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.376131 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.376259 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.376387 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.376514 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] federation.driver = sql {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.376710 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.376710 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.377050 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.377050 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.377302 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.377302 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.377613 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.377613 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.377876 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.377876 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.378118 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.378118 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.378359 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.378359 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.378611 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.378739 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.378867 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.378994 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] identity.caching = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.379121 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.379266 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.379396 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] identity.caching = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.379541 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.379677 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.379805 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.379932 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.380068 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.380197 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.380326 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.380454 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.380581 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.380708 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] identity.driver = sql {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.380844 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.380991 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.381120 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.381247 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.381391 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.381525 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.381667 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.381796 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.381932 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.382060 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.382303 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.382474 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.382608 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.382737 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.382864 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.383002 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.383129 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.383265 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.383395 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.383524 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.383652 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.383779 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.383907 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.384042 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.384178 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.384314 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.384442 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.384569 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.384707 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.384848 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.384977 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.385105 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.385239 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.385476 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.385476 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.385740 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.385871 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.385999 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.386127 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.386257 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.386384 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.386522 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.386667 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.386796 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.386923 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.387051 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.387185 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.387322 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.387451 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.387578 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.387707 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.387834 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.387961 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.388097 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.388226 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.388364 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.388492 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.388628 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.388758 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.388894 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.389023 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.password = **** {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.389151 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.389279 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.389425 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.389556 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.389695 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.389824 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.389952 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.390079 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.390227 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.390356 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.390497 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.390633 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.390761 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.390890 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.391017 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.391144 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.391280 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.391410 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.391537 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.391664 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.391792 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.391929 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.392075 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.392204 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.392331 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.392459 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.392586 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.392713 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.392848 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.user = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.392977 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.user = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.393105 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.393233 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.393376 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.393518 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.393664 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.393805 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.393933 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.394062 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.394194 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.394321 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.394458 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.394587 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.394715 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.394842 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.394970 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.395106 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.395240 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.395375 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.395504 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.395646 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.395775 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.396039 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.396188 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.396319 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.396448 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.396576 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.396704 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.396841 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.396971 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.397100 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.397228 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.397408 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.397544 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.397694 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.397824 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.397953 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.398080 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.398209 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.398336 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.398472 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.398603 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.398730 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.398857 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.398857 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.399141 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.399141 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.399406 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.399535 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.399662 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.399662 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.399910 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.399910 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.400162 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.400162 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.400405 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] policy.driver = sql {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.400532 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.400658 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.400794 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.400923 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.401051 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.401188 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.401318 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.401470 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] receipt.caching = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.401611 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.401741 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.401875 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.402006 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.402135 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.402262 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.402464 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.402595 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.402724 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] resource.caching = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.402851 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.402979 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.403116 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] resource.caching = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.403252 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.403422 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.403555 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.403683 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] resource.driver = sql {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.403811 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.403939 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.404075 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.404205 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.404332 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.404460 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.404460 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] revoke.caching = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.404702 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.404702 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.404966 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.405094 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.405221 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.405392 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] role.caching = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.405530 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] role.cache_time = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.405671 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] role.driver = sql {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.405800 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] role.caching = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.405928 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.406056 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] role.driver = sql {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.406184 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.406314 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] role.list_limit = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.406450 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.406582 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.406720 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.406848 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.406977 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.407105 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.407240 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.407370 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.407498 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.407626 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.407755 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.407883 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.408019 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.408148 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.408276 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.408420 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.408550 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.408678 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.408814 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.408943 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.409071 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.409205 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.409335 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.409508 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.409645 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.409776 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.409904 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.410032 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.410161 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.410308 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.410437 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.410565 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.410693 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.410822 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.410951 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.411087 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.411217 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.411345 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.411473 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.411601 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.411729 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.411873 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.412016 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.412016 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.412258 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.412393 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.412522 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.412658 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.412788 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.412916 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.413044 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.413044 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.413287 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.413446 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.413579 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.413579 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.413832 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.413962 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.414090 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.414227 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.414356 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.414512 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] token.caching = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.414958 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.415088 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.415217 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] token.cache_time = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.415360 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.415490 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] token.caching = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.415618 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.415745 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.415884 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.416023 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] token.provider = fernet {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.416153 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.416281 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.416409 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.416537 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.416665 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.416801 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.416930 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.417059 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.417187 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.417315 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.417479 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.417637 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.417774 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.417944 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] trust.driver = sql {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.418085 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.418220 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.418354 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.418498 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.418636 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.418770 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.418904 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.419039 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.419175 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.419319 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.419455 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.419600 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.419735 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] database.connection = **** {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.419879 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.420024 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.420166 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.420302 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.420445 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] database.connection = **** {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.420590 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.420736 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.420872 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.421007 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.421147 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.421283 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.421506 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.421656 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.421792 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.421935 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.422072 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.422207 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.422352 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.422489 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.422626 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.422762 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.422898 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.423033 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.423177 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.423315 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.423452 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.423598 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.423733 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.423868 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.424082 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.424220 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.424355 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.424491 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.424627 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.424762 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.424910 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.425048 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.425183 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 13:37:43.425319 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.425319 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 13:37:43.425319 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=91154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 13:37:43.433403 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.433629 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.433774 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.433915 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.434055 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.434055 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.442541 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.442699 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.471000 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.471272 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.471561 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.471792 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.525418 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.525673 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.575339 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.575633 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.575786 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.575929 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.641006 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.641300 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.641517 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.641666 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.641807 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.641986 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.642132 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.642279 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.642419 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.642559 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.642697 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.642848 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.667509 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.667790 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.667942 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.668086 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.668225 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.668362 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.668509 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.668657 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.668798 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.668937 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.669087 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.669233 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.669407 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.669407 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.680369 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.680594 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.693090 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.693321 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.693519 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.693662 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.693818 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.693957 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.694152 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.694296 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.694434 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.694571 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.694707 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.694853 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91153) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.694994 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.694994 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=91154) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Mar 08 13:37:43.711565 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.711803 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 08 13:37:43.711969 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.712113 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.712252 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 08 13:37:43.712389 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 08 13:37:43.712525 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.712661 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.712808 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Mar 08 13:37:43.712946 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.713082 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.713217 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.713385 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.713553 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.713692 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.713692 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.723801 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.724221 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.724332 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.724535 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.724624 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.724794 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.724876 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.725041 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.732730 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.732967 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=91154) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.735930 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.736188 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=91154) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.736275 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.736461 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.736605 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.736845 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.736933 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.737122 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.737208 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.737447 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.737534 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.737697 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.737778 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.737941 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.738034 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.738200 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.738281 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.738442 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.738521 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.738703 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.738784 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.738948 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.764360 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.764695 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.765945 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.766218 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.766304 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=91154) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.766598 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.771340 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.771624 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.771761 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=91154) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.771836 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.772075 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.772228 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.779333 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.779463 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=91154) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.779537 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.779600 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.784008 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.784129 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=91154) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.784348 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.784453 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.784523 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.784586 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.784824 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.784907 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.785093 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.785174 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.785336 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.785455 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.785625 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.785720 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.785903 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.785985 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.804574 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.804972 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.808356 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.808642 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.809855 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.813105 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=91154) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.815917 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.816339 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.816888 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.817180 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.821715 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.822212 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=91154) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.825613 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.825893 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=91154) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.829427 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.829509 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.829756 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.829978 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.830139 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.830305 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.830531 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.830611 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.830840 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.831063 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.831441 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.831829 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.849490 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91154) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.849770 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.850034 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.850292 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.851245 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=91153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.851632 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.852062 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.852452 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.858012 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.859688 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.859962 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.860545 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.862370 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.862756 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.862964 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91154) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.863262 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.863541 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.863818 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.864098 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.866357 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=91153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.866753 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.867137 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.867498 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.867942 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.877176 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91154) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.877484 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.877963 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.878082 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.878316 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.878587 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.878865 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.881935 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=91153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.882406 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.882805 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.883238 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.883634 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.884013 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.884391 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.897686 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91154) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.900962 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91154) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.903689 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=91153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.904199 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.905774 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.907244 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=91153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.907390 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91154) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.907629 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.907912 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.910953 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.912672 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.914485 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=91153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:43.915197 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:43.915585 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.018651 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.020251 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91154) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:44.023424 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.023709 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.024326 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.024607 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.026516 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.028240 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=91153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:44.031572 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.031910 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.032302 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.032681 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.033699 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91154) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:44.033988 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.034265 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.042261 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91154) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:44.042538 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.042814 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.042938 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=91153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:44.043041 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.043340 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.043463 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.043588 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.043876 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.044013 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.044099 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.044398 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.044773 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.045090 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.045395 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.045697 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.046005 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91154) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.052332 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=91153) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Mar 08 13:37:44.052718 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.053097 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.053549 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.053922 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.054294 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.054668 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.055068 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.055476 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.055955 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.056333 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.056709 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.057060 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.057495 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=91153) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Mar 08 13:37:44.082979 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x559c408a59c0 pid: 91154 (default app) Mar 08 13:37:44.086617 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09ff26-b39a-436d-b342-1c18a130935a None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:37:44.086905 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09ff26-b39a-436d-b342-1c18a130935a None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:37:44.087175 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09ff26-b39a-436d-b342-1c18a130935a None None] PATH_INFO: `/v3` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:37:44.091880 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1/1] 10.222.0.18 () {50 vars in 791 bytes} [Tue Mar 8 13:37:44 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:37:44.095081 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x559c408a59c0 pid: 91153 (default app) Mar 08 13:37:52.294801 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc0c33-ec83-48cf-b2eb-fb0be9814f5c None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:37:52.295405 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc0c33-ec83-48cf-b2eb-fb0be9814f5c None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:37:52.295405 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc0c33-ec83-48cf-b2eb-fb0be9814f5c None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:37:52.297426 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 2/2] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:37:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:37:52.307718 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ec7d4-cce0-4057-ae60-efea1a1e053c None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:37:52.308457 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ec7d4-cce0-4057-ae60-efea1a1e053c None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:37:52.308750 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ec7d4-cce0-4057-ae60-efea1a1e053c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:37:52.350538 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG oslo_db.sqlalchemy.engines [None req-b63ec7d4-cce0-4057-ae60-efea1a1e053c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 13:37:52.538690 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG passlib.handlers.bcrypt [None req-b63ec7d4-cce0-4057-ae60-efea1a1e053c None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=91153) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 08 13:37:52.539445 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG passlib.handlers.bcrypt [None req-b63ec7d4-cce0-4057-ae60-efea1a1e053c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91153) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 08 13:37:52.595126 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-b63ec7d4-cce0-4057-ae60-efea1a1e053c None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:37:52.596665 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-b63ec7d4-cce0-4057-ae60-efea1a1e053c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:37:52.722815 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1/3] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:37:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Mar 08 13:37:52.890697 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc0c33-ec83-48cf-b2eb-fb0be9814f5c None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:37:52.931586 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG oslo_db.sqlalchemy.engines [None req-e1dc0c33-ec83-48cf-b2eb-fb0be9814f5c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 13:37:53.068501 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc0c33-ec83-48cf-b2eb-fb0be9814f5c None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:37:53.073965 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26f6f9-020f-4760-9412-7b83d47466c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:37:53.074618 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26f6f9-020f-4760-9412-7b83d47466c4 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:37:53.074898 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26f6f9-020f-4760-9412-7b83d47466c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:37:53.075153 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26f6f9-020f-4760-9412-7b83d47466c4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:37:53.085895 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26f6f9-020f-4760-9412-7b83d47466c4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:37:53.134499 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2b26f6f9-020f-4760-9412-7b83d47466c4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 08 13:37:53.134817 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26f6f9-020f-4760-9412-7b83d47466c4 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:37:53.144761 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 3/4] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Mar 8 13:37:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 13:37:53.152214 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ec7d4-cce0-4057-ae60-efea1a1e053c None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:37:53.167978 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ec7d4-cce0-4057-ae60-efea1a1e053c None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:37:53.174468 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f9f6a-23f7-45bb-a4e8-6e41060b5629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:37:53.175583 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f9f6a-23f7-45bb-a4e8-6e41060b5629 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:37:53.175866 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f9f6a-23f7-45bb-a4e8-6e41060b5629 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:37:53.176137 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f9f6a-23f7-45bb-a4e8-6e41060b5629 admin admin] PATH_INFO: `/v3/projects/bb5233956b7746bc8c923776ec1a970c` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:37:53.177996 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f9f6a-23f7-45bb-a4e8-6e41060b5629 admin admin] RBAC: Authorizing `identity:get_project(project_id=bb5233956b7746bc8c923776ec1a970c)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:37:53.229442 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.common.rbac_enforcer.enforcer [None req-db3f9f6a-23f7-45bb-a4e8-6e41060b5629 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Mar 08 13:37:53.229782 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f9f6a-23f7-45bb-a4e8-6e41060b5629 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:37:53.234385 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 2/5] 10.222.0.18 () {56 vars in 1207 bytes} [Tue Mar 8 13:37:53 2022] GET /identity/v3/projects/bb5233956b7746bc8c923776ec1a970c => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:37:55.508083 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c7f86-c76e-4d2c-abe7-7dbddf01681a None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:37:55.508572 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c7f86-c76e-4d2c-abe7-7dbddf01681a None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:37:55.508658 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c7f86-c76e-4d2c-abe7-7dbddf01681a None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:37:55.513214 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 4/6] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:37:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:37:55.518843 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae282c-20aa-4a6b-85ad-08ff48f85792 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:37:55.519282 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae282c-20aa-4a6b-85ad-08ff48f85792 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:37:55.519376 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae282c-20aa-4a6b-85ad-08ff48f85792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:37:55.540140 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-40ae282c-20aa-4a6b-85ad-08ff48f85792 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:37:55.541668 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-40ae282c-20aa-4a6b-85ad-08ff48f85792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:37:55.550045 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 3/7] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:37:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Mar 08 13:37:55.572900 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c7f86-c76e-4d2c-abe7-7dbddf01681a None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:37:55.594822 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897c7f86-c76e-4d2c-abe7-7dbddf01681a None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:37:55.602812 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a9ec7-0acd-4f0d-8749-83a0857e1aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:37:55.603435 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a9ec7-0acd-4f0d-8749-83a0857e1aaf admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:37:55.603712 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a9ec7-0acd-4f0d-8749-83a0857e1aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:37:55.603980 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a9ec7-0acd-4f0d-8749-83a0857e1aaf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:37:55.612091 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a9ec7-0acd-4f0d-8749-83a0857e1aaf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:37:55.613900 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a9ec7-0acd-4f0d-8749-83a0857e1aaf admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:37:55.622396 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 5/8] 10.222.0.18 () {58 vars in 1324 bytes} [Tue Mar 8 13:37:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 13:37:55.627615 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae282c-20aa-4a6b-85ad-08ff48f85792 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:37:55.637392 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae282c-20aa-4a6b-85ad-08ff48f85792 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:37:55.643811 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab993f1-9d36-4263-9231-c89f58cd5f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:37:55.644659 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab993f1-9d36-4263-9231-c89f58cd5f9b admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:37:55.644937 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab993f1-9d36-4263-9231-c89f58cd5f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:37:55.645206 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab993f1-9d36-4263-9231-c89f58cd5f9b admin admin] PATH_INFO: `/v3/users/9e52ccf157d64bf8a84675f802b2f178` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:37:55.646809 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab993f1-9d36-4263-9231-c89f58cd5f9b admin admin] RBAC: Authorizing `identity:get_user(user_id=9e52ccf157d64bf8a84675f802b2f178)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:37:55.648663 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab993f1-9d36-4263-9231-c89f58cd5f9b admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:37:55.650239 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 4/9] 10.222.0.18 () {56 vars in 1198 bytes} [Tue Mar 8 13:37:55 2022] GET /identity/v3/users/9e52ccf157d64bf8a84675f802b2f178 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:37:57.964409 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a5647-59d4-41de-aa25-59474352fc73 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:37:57.964965 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a5647-59d4-41de-aa25-59474352fc73 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:37:57.964965 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a5647-59d4-41de-aa25-59474352fc73 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:37:57.966745 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 6/10] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:37:57.972150 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfc177-3feb-4364-8d37-12999b4cb764 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:37:57.972606 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfc177-3feb-4364-8d37-12999b4cb764 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:37:57.972700 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebfc177-3feb-4364-8d37-12999b4cb764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:37:57.990048 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-cebfc177-3feb-4364-8d37-12999b4cb764 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:37:57.991354 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-cebfc177-3feb-4364-8d37-12999b4cb764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:37:58.021134 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fab0d-5375-40b7-8029-f614aed5df9c None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:37:58.021455 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fab0d-5375-40b7-8029-f614aed5df9c None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:37:58.021729 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0fab0d-5375-40b7-8029-f614aed5df9c None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:37:58.023761 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 7/11] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:37:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:37:58.029673 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f0464-d10d-4499-98bf-78f4e8fc090a None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:37:58.029957 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f0464-d10d-4499-98bf-78f4e8fc090a None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:37:58.030234 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f0464-d10d-4499-98bf-78f4e8fc090a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:37:58.072491 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 5/12] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:37:58.072686 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG passlib.handlers.bcrypt [None req-4a7f0464-d10d-4499-98bf-78f4e8fc090a None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=91154) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Mar 08 13:37:58.072961 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG passlib.handlers.bcrypt [None req-4a7f0464-d10d-4499-98bf-78f4e8fc090a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=91154) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Mar 08 13:37:58.094928 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfc177-3feb-4364-8d37-12999b4cb764 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:37:58.118874 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-4a7f0464-d10d-4499-98bf-78f4e8fc090a None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:37:58.120469 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-4a7f0464-d10d-4499-98bf-78f4e8fc090a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:37:58.194825 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebfc177-3feb-4364-8d37-12999b4cb764 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:37:58.217877 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 8/13] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:37:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:37:58.227656 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49dd1bf-2f13-4bec-9c64-0287ace46e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:37:58.228456 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49dd1bf-2f13-4bec-9c64-0287ace46e62 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:37:58.228738 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49dd1bf-2f13-4bec-9c64-0287ace46e62 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:37:58.229014 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49dd1bf-2f13-4bec-9c64-0287ace46e62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:37:58.239947 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49dd1bf-2f13-4bec-9c64-0287ace46e62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:37:58.240060 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f0464-d10d-4499-98bf-78f4e8fc090a None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:37:58.246829 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-c49dd1bf-2f13-4bec-9c64-0287ace46e62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:37:58.248033 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 6/14] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:37:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:37:58.253775 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49dd1bf-2f13-4bec-9c64-0287ace46e62 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:37:58.335734 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7f0464-d10d-4499-98bf-78f4e8fc090a None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:37:58.349736 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49dd1bf-2f13-4bec-9c64-0287ace46e62 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:37:58.369131 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c004298-1f84-48a0-bbcf-a1581c9fc51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:37:58.370049 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c004298-1f84-48a0-bbcf-a1581c9fc51f None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:37:58.370331 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c004298-1f84-48a0-bbcf-a1581c9fc51f None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:37:58.370603 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c004298-1f84-48a0-bbcf-a1581c9fc51f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:37:58.383919 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa4d70-888a-4593-b795-ef23197a36f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:37:58.384571 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa4d70-888a-4593-b795-ef23197a36f0 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:37:58.384846 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa4d70-888a-4593-b795-ef23197a36f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:37:58.385122 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa4d70-888a-4593-b795-ef23197a36f0 None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:37:58.385891 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa4d70-888a-4593-b795-ef23197a36f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:37:58.386201 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa4d70-888a-4593-b795-ef23197a36f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:37:58.387577 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa4d70-888a-4593-b795-ef23197a36f0 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:37:58.398811 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 7/15] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:37:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:37:58.404254 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa4d70-888a-4593-b795-ef23197a36f0 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:37:58.437465 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c004298-1f84-48a0-bbcf-a1581c9fc51f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:37:58.438970 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c004298-1f84-48a0-bbcf-a1581c9fc51f None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:37:58.502370 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa4d70-888a-4593-b795-ef23197a36f0 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:37:58.532464 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 9/16] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:37:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:37:58.534701 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3bd9a-d0d9-4929-8d8f-0bce7b7164f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:37:58.535566 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3bd9a-d0d9-4929-8d8f-0bce7b7164f5 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:37:58.535846 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3bd9a-d0d9-4929-8d8f-0bce7b7164f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:37:58.536118 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3bd9a-d0d9-4929-8d8f-0bce7b7164f5 None admin] PATH_INFO: `/v3/users/9e52ccf157d64bf8a84675f802b2f178` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:37:58.537490 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3bd9a-d0d9-4929-8d8f-0bce7b7164f5 None admin] RBAC: Authorizing `identity:get_user(user_id=9e52ccf157d64bf8a84675f802b2f178)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:37:58.538060 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c004298-1f84-48a0-bbcf-a1581c9fc51f None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:37:58.539314 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3bd9a-d0d9-4929-8d8f-0bce7b7164f5 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:37:58.540921 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 8/17] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:37:58 2022] GET /identity/v3/users/9e52ccf157d64bf8a84675f802b2f178 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:37:58.546096 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3bd9a-d0d9-4929-8d8f-0bce7b7164f5 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:37:58.631685 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c004298-1f84-48a0-bbcf-a1581c9fc51f None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:37:58.640519 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3bd9a-d0d9-4929-8d8f-0bce7b7164f5 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:37:58.665019 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d26035-1f54-46f0-a5e6-14d50056fad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:37:58.665816 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d26035-1f54-46f0-a5e6-14d50056fad2 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:37:58.666097 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d26035-1f54-46f0-a5e6-14d50056fad2 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:37:58.666365 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d26035-1f54-46f0-a5e6-14d50056fad2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:37:58.673822 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebc692-056b-44dd-9f65-a04599be0db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:37:58.674604 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebc692-056b-44dd-9f65-a04599be0db0 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:37:58.674881 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebc692-056b-44dd-9f65-a04599be0db0 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:37:58.675152 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebc692-056b-44dd-9f65-a04599be0db0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:37:58.676337 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebc692-056b-44dd-9f65-a04599be0db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:37:58.677833 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebc692-056b-44dd-9f65-a04599be0db0 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:37:58.679421 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 9/18] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:37:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:37:58.684487 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d26035-1f54-46f0-a5e6-14d50056fad2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:37:58.685139 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebc692-056b-44dd-9f65-a04599be0db0 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:37:58.685976 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d26035-1f54-46f0-a5e6-14d50056fad2 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:37:58.702274 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-d1d26035-1f54-46f0-a5e6-14d50056fad2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:37:58.703443 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 10/19] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:37:58.708999 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d26035-1f54-46f0-a5e6-14d50056fad2 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:37:58.777683 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebc692-056b-44dd-9f65-a04599be0db0 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:37:58.802282 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d26035-1f54-46f0-a5e6-14d50056fad2 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:37:58.810972 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc91f2-a4f8-4069-913e-c3cc36ba0105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:37:58.811625 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc91f2-a4f8-4069-913e-c3cc36ba0105 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:37:58.811906 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc91f2-a4f8-4069-913e-c3cc36ba0105 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:37:58.812182 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc91f2-a4f8-4069-913e-c3cc36ba0105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:37:58.812996 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc91f2-a4f8-4069-913e-c3cc36ba0105 None admin] RBAC: Adding query filter params (role.id=fc021ed5870a44f5a0f0b8fff994d6f0, scope.domain.id=default, user.id=9e52ccf157d64bf8a84675f802b2f178) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:37:58.813325 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc91f2-a4f8-4069-913e-c3cc36ba0105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:37:58.814805 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc91f2-a4f8-4069-913e-c3cc36ba0105 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:37:58.821822 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 10/20] 10.222.0.18 () {56 vars in 1322 bytes} [Tue Mar 8 13:37:58 2022] GET /identity/v3/role_assignments?user.id=9e52ccf157d64bf8a84675f802b2f178&scope.domain.id=default&role.id=fc021ed5870a44f5a0f0b8fff994d6f0 => generated 233 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:37:58.835291 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb7001-2120-42db-ada6-cc9cb44639ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:37:58.836021 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb7001-2120-42db-ada6-cc9cb44639ad None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:37:58.836309 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb7001-2120-42db-ada6-cc9cb44639ad None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:37:58.836584 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb7001-2120-42db-ada6-cc9cb44639ad None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:37:58.837392 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb7001-2120-42db-ada6-cc9cb44639ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:37:58.837725 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb7001-2120-42db-ada6-cc9cb44639ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:37:58.839180 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb7001-2120-42db-ada6-cc9cb44639ad None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:37:58.858858 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 11/21] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:01.345701 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80be57e-1ac2-478e-bd04-0bbfa53f3483 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:01.346236 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80be57e-1ac2-478e-bd04-0bbfa53f3483 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:01.346236 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80be57e-1ac2-478e-bd04-0bbfa53f3483 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:01.348494 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 11/22] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:01.353841 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed92d4-110c-4678-b66f-349c4480bfea None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:01.354269 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed92d4-110c-4678-b66f-349c4480bfea None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:01.354442 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed92d4-110c-4678-b66f-349c4480bfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:01.375193 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-55ed92d4-110c-4678-b66f-349c4480bfea None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:01.376622 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-55ed92d4-110c-4678-b66f-349c4480bfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:01.465761 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 12/23] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:01.491360 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20253000-fb29-4245-bed2-bb9393ec3424 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:01.491890 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20253000-fb29-4245-bed2-bb9393ec3424 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:01.492304 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20253000-fb29-4245-bed2-bb9393ec3424 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:01.494260 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 12/24] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:01.500421 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c1dc2-4bc0-4a3c-b05e-7924bc013968 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:01.500904 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c1dc2-4bc0-4a3c-b05e-7924bc013968 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:01.501312 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c1dc2-4bc0-4a3c-b05e-7924bc013968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:01.501949 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20253000-fb29-4245-bed2-bb9393ec3424 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:01.518453 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-c42c1dc2-4bc0-4a3c-b05e-7924bc013968 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:01.519861 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-c42c1dc2-4bc0-4a3c-b05e-7924bc013968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:01.628276 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 13/25] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:01.654597 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20253000-fb29-4245-bed2-bb9393ec3424 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:01.669030 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25423675-0605-4866-b0ab-c72de040d843 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:01.669324 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25423675-0605-4866-b0ab-c72de040d843 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:01.669608 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25423675-0605-4866-b0ab-c72de040d843 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:01.671903 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 14/26] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:38:01.677374 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c67bc-08b3-4b5d-978f-91f9489a1082 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:01.677912 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c67bc-08b3-4b5d-978f-91f9489a1082 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:01.678459 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c67bc-08b3-4b5d-978f-91f9489a1082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:01.693121 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90992f5-affb-4556-9465-4489bac90973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:01.694415 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90992f5-affb-4556-9465-4489bac90973 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:01.694846 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90992f5-affb-4556-9465-4489bac90973 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:01.695327 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90992f5-affb-4556-9465-4489bac90973 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:01.714319 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90992f5-affb-4556-9465-4489bac90973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:01.718322 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-7f9c67bc-08b3-4b5d-978f-91f9489a1082 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:01.719691 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-7f9c67bc-08b3-4b5d-978f-91f9489a1082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:01.724611 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-f90992f5-affb-4556-9465-4489bac90973 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:38:01.728142 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 13/27] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:38:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:01.734586 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90992f5-affb-4556-9465-4489bac90973 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:01.858550 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 15/28] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:38:01.859743 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c67bc-08b3-4b5d-978f-91f9489a1082 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:01.909424 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90992f5-affb-4556-9465-4489bac90973 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:01.943844 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fc3f0-2bb5-47b2-af32-fb930aba4d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:01.944901 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fc3f0-2bb5-47b2-af32-fb930aba4d02 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:01.945377 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fc3f0-2bb5-47b2-af32-fb930aba4d02 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:01.945803 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fc3f0-2bb5-47b2-af32-fb930aba4d02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:01.956003 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fc3f0-2bb5-47b2-af32-fb930aba4d02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:01.957679 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fc3f0-2bb5-47b2-af32-fb930aba4d02 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:01.975450 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-366fc3f0-2bb5-47b2-af32-fb930aba4d02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:38:01.977488 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 14/29] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:01.978622 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fc3f0-2bb5-47b2-af32-fb930aba4d02 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:01.998234 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c67bc-08b3-4b5d-978f-91f9489a1082 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:02.041232 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9ad87-e5b2-4ed0-995d-db03687426cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:02.042183 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9ad87-e5b2-4ed0-995d-db03687426cc None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:02.042630 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9ad87-e5b2-4ed0-995d-db03687426cc None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:02.043044 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9ad87-e5b2-4ed0-995d-db03687426cc None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:02.043938 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9ad87-e5b2-4ed0-995d-db03687426cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:02.044385 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9ad87-e5b2-4ed0-995d-db03687426cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:02.050052 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9ad87-e5b2-4ed0-995d-db03687426cc None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:02.069585 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 16/30] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:02.070613 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9ad87-e5b2-4ed0-995d-db03687426cc None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:02.080698 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fc3f0-2bb5-47b2-af32-fb930aba4d02 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:02.142195 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8225a44-8e41-4037-adc1-cf150fefeccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:02.143332 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8225a44-8e41-4037-adc1-cf150fefeccd None admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:02.143828 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8225a44-8e41-4037-adc1-cf150fefeccd None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:02.144365 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8225a44-8e41-4037-adc1-cf150fefeccd None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:02.145819 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8225a44-8e41-4037-adc1-cf150fefeccd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:02.148450 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8225a44-8e41-4037-adc1-cf150fefeccd None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:02.268092 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9ad87-e5b2-4ed0-995d-db03687426cc None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:02.287549 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 15/31] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Mar 8 13:38:01 2022] POST /identity/v3/roles => generated 219 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:38:02.289398 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8225a44-8e41-4037-adc1-cf150fefeccd None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:02.341122 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505b1cb-2172-469a-8e34-435069cbd5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:02.341828 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505b1cb-2172-469a-8e34-435069cbd5a5 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:02.342119 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505b1cb-2172-469a-8e34-435069cbd5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:02.342372 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505b1cb-2172-469a-8e34-435069cbd5a5 None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:02.343277 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505b1cb-2172-469a-8e34-435069cbd5a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:02.343722 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505b1cb-2172-469a-8e34-435069cbd5a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:02.345271 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505b1cb-2172-469a-8e34-435069cbd5a5 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:02.368727 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 17/32] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:02.373829 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505b1cb-2172-469a-8e34-435069cbd5a5 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:02.401314 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8225a44-8e41-4037-adc1-cf150fefeccd None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:02.482401 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59931a-e097-42bd-b2d4-ce2f0390f759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:02.483670 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59931a-e097-42bd-b2d4-ce2f0390f759 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:02.484144 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59931a-e097-42bd-b2d4-ce2f0390f759 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:02.484636 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59931a-e097-42bd-b2d4-ce2f0390f759 None admin] PATH_INFO: `/v3/users/9e52ccf157d64bf8a84675f802b2f178` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:02.486278 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59931a-e097-42bd-b2d4-ce2f0390f759 None admin] RBAC: Authorizing `identity:get_user(user_id=9e52ccf157d64bf8a84675f802b2f178)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:02.488043 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c59931a-e097-42bd-b2d4-ce2f0390f759 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:02.489916 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 16/33] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:02 2022] GET /identity/v3/users/9e52ccf157d64bf8a84675f802b2f178 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:02.495526 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59931a-e097-42bd-b2d4-ce2f0390f759 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:02.529954 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505b1cb-2172-469a-8e34-435069cbd5a5 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:02.568809 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b433db9-9b1a-4a1d-80e2-538c8b1177cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:02.570055 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b433db9-9b1a-4a1d-80e2-538c8b1177cd None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:02.571383 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b433db9-9b1a-4a1d-80e2-538c8b1177cd None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:02.572126 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b433db9-9b1a-4a1d-80e2-538c8b1177cd None admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:02.574116 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b433db9-9b1a-4a1d-80e2-538c8b1177cd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:02.577687 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b433db9-9b1a-4a1d-80e2-538c8b1177cd None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:02.658528 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c59931a-e097-42bd-b2d4-ce2f0390f759 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:02.695240 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ee751-61a6-42a2-858c-d6f532a2f214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:02.696378 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ee751-61a6-42a2-858c-d6f532a2f214 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:02.696802 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ee751-61a6-42a2-858c-d6f532a2f214 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:02.697226 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ee751-61a6-42a2-858c-d6f532a2f214 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:02.698681 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ee751-61a6-42a2-858c-d6f532a2f214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:02.700371 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ee751-61a6-42a2-858c-d6f532a2f214 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:02.702347 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 17/34] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:38:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:02.703989 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ac139-99ce-4338-9afc-7c8de1a77a2e None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:02.704557 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ac139-99ce-4338-9afc-7c8de1a77a2e None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:02.705011 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ac139-99ce-4338-9afc-7c8de1a77a2e None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:02.707021 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 18/35] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:02.709153 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ac139-99ce-4338-9afc-7c8de1a77a2e None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:02.743422 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 18/36] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Mar 8 13:38:02 2022] POST /identity/v3/projects => generated 301 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:38:02.745084 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25568d-0750-47df-afe1-d00d0d26007a None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:02.745466 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25568d-0750-47df-afe1-d00d0d26007a None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:02.745818 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25568d-0750-47df-afe1-d00d0d26007a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:02.764238 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-de25568d-0750-47df-afe1-d00d0d26007a None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:02.765895 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-de25568d-0750-47df-afe1-d00d0d26007a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:02.825636 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ac139-99ce-4338-9afc-7c8de1a77a2e None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:02.840777 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 19/37] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:02.864085 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25568d-0750-47df-afe1-d00d0d26007a None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:02.866042 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad719cd-0ad8-4298-878e-306d020d7661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:02.867322 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad719cd-0ad8-4298-878e-306d020d7661 None admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:02.867784 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad719cd-0ad8-4298-878e-306d020d7661 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:02.868246 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad719cd-0ad8-4298-878e-306d020d7661 None admin] PATH_INFO: `/v3/domains/default/users/9e52ccf157d64bf8a84675f802b2f178/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:02.871105 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad719cd-0ad8-4298-878e-306d020d7661 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9e52ccf157d64bf8a84675f802b2f178, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:02.873026 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad719cd-0ad8-4298-878e-306d020d7661 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:02.891835 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 19/38] 10.222.0.18 () {58 vars in 1361 bytes} [Tue Mar 8 13:38:02 2022] PUT /identity/v3/domains/default/users/9e52ccf157d64bf8a84675f802b2f178/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:38:02.986403 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25568d-0750-47df-afe1-d00d0d26007a None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:03.026052 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e3430-029a-44ea-98b3-56f7bb3be84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:03.026788 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e3430-029a-44ea-98b3-56f7bb3be84b None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:03.027074 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e3430-029a-44ea-98b3-56f7bb3be84b None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:03.027409 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e3430-029a-44ea-98b3-56f7bb3be84b None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:03.028195 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e3430-029a-44ea-98b3-56f7bb3be84b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:03.030016 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e3430-029a-44ea-98b3-56f7bb3be84b None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:03.048929 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 20/39] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Mar 8 13:38:02 2022] POST /identity/v3/roles => generated 225 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:38:03.253775 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edcf62-f7ee-41c5-9c95-4a12005234d8 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:03.254498 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edcf62-f7ee-41c5-9c95-4a12005234d8 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:03.255043 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67edcf62-f7ee-41c5-9c95-4a12005234d8 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:03.257084 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 20/40] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:03.262780 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107a712-5c74-491c-82d5-b00bf8a2a617 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:03.263076 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107a712-5c74-491c-82d5-b00bf8a2a617 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:03.263353 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107a712-5c74-491c-82d5-b00bf8a2a617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:03.282671 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-a107a712-5c74-491c-82d5-b00bf8a2a617 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:03.283861 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-a107a712-5c74-491c-82d5-b00bf8a2a617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:03.343033 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d57a16-a06d-4e3c-b750-e255bef81010 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:03.343827 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d57a16-a06d-4e3c-b750-e255bef81010 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:03.343998 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d57a16-a06d-4e3c-b750-e255bef81010 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:03.345780 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 21/41] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:38:03.351345 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36852a09-b3a3-45b5-aad3-516ec30f93bb None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:03.351637 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36852a09-b3a3-45b5-aad3-516ec30f93bb None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:03.351919 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36852a09-b3a3-45b5-aad3-516ec30f93bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:03.365003 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 21/42] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:03.370025 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-36852a09-b3a3-45b5-aad3-516ec30f93bb None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:03.371554 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-36852a09-b3a3-45b5-aad3-516ec30f93bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:03.388370 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107a712-5c74-491c-82d5-b00bf8a2a617 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:03.437858 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 22/43] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:38:03.460052 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36852a09-b3a3-45b5-aad3-516ec30f93bb None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:03.491406 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107a712-5c74-491c-82d5-b00bf8a2a617 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:03.525683 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3d1e1-a972-4c58-8a63-1456c77f0664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:03.526425 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3d1e1-a972-4c58-8a63-1456c77f0664 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:03.526714 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3d1e1-a972-4c58-8a63-1456c77f0664 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:03.526987 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3d1e1-a972-4c58-8a63-1456c77f0664 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:03.528162 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3d1e1-a972-4c58-8a63-1456c77f0664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:03.529639 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3d1e1-a972-4c58-8a63-1456c77f0664 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:03.531254 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 22/44] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:38:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:03.536676 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3d1e1-a972-4c58-8a63-1456c77f0664 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:03.556168 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36852a09-b3a3-45b5-aad3-516ec30f93bb None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:03.589911 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc70958-6055-4f90-a5b6-5441870191b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:03.590585 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc70958-6055-4f90-a5b6-5441870191b8 None admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:03.590867 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc70958-6055-4f90-a5b6-5441870191b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:03.591138 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc70958-6055-4f90-a5b6-5441870191b8 None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:03.591880 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc70958-6055-4f90-a5b6-5441870191b8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:03.593267 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc70958-6055-4f90-a5b6-5441870191b8 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:03.617388 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 23/45] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Mar 8 13:38:03 2022] POST /identity/v3/roles => generated 223 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:38:03.632414 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3d1e1-a972-4c58-8a63-1456c77f0664 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:03.669128 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ea8563-45ba-4856-8d55-f7828f3a9e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:03.669853 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea8563-45ba-4856-8d55-f7828f3a9e90 None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:03.670153 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea8563-45ba-4856-8d55-f7828f3a9e90 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:03.670424 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ea8563-45ba-4856-8d55-f7828f3a9e90 None admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:03.671145 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea8563-45ba-4856-8d55-f7828f3a9e90 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:03.672616 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ea8563-45ba-4856-8d55-f7828f3a9e90 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:03.702470 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 23/46] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Mar 8 13:38:03 2022] POST /identity/v3/projects => generated 312 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:38:05.272288 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30d7da-8fd7-497b-a5eb-4756ec073247 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:05.272826 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30d7da-8fd7-497b-a5eb-4756ec073247 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:05.272826 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30d7da-8fd7-497b-a5eb-4756ec073247 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:05.274643 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 24/47] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:05.279962 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a90bb-390b-46e8-9e0a-b6fdf88a5a79 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:05.280370 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a90bb-390b-46e8-9e0a-b6fdf88a5a79 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:05.280520 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a90bb-390b-46e8-9e0a-b6fdf88a5a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:05.298036 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-3a2a90bb-390b-46e8-9e0a-b6fdf88a5a79 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:05.299224 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-3a2a90bb-390b-46e8-9e0a-b6fdf88a5a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:05.365510 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 24/48] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:05.388882 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30d7da-8fd7-497b-a5eb-4756ec073247 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:05.493181 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30d7da-8fd7-497b-a5eb-4756ec073247 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:05.526987 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beee14c-4ff6-466d-a9bd-22fad9e2bccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:05.527724 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beee14c-4ff6-466d-a9bd-22fad9e2bccb None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:05.528007 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beee14c-4ff6-466d-a9bd-22fad9e2bccb None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:05.528279 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beee14c-4ff6-466d-a9bd-22fad9e2bccb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:05.539541 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9beee14c-4ff6-466d-a9bd-22fad9e2bccb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:05.546323 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-9beee14c-4ff6-466d-a9bd-22fad9e2bccb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:38:05.547527 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 25/49] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:38:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:05.553712 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a90bb-390b-46e8-9e0a-b6fdf88a5a79 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:05.654108 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a90bb-390b-46e8-9e0a-b6fdf88a5a79 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:05.688643 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2f6ab-6068-4887-9635-bfe2de5973da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:05.689310 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2f6ab-6068-4887-9635-bfe2de5973da None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:05.689628 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2f6ab-6068-4887-9635-bfe2de5973da None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:05.689903 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2f6ab-6068-4887-9635-bfe2de5973da None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:05.690651 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2f6ab-6068-4887-9635-bfe2de5973da None admin] RBAC: Adding query filter params (name=admin) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:05.690976 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2f6ab-6068-4887-9635-bfe2de5973da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:05.692350 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2f6ab-6068-4887-9635-bfe2de5973da None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:05.700617 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 25/50] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:05.706325 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beee14c-4ff6-466d-a9bd-22fad9e2bccb None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:05.803515 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beee14c-4ff6-466d-a9bd-22fad9e2bccb None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:05.836181 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b694eb-2989-44aa-a4e9-2f35b938df6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:05.837057 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b694eb-2989-44aa-a4e9-2f35b938df6e None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:05.837337 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b694eb-2989-44aa-a4e9-2f35b938df6e None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:05.837638 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b694eb-2989-44aa-a4e9-2f35b938df6e None admin] PATH_INFO: `/v3/users/9e52ccf157d64bf8a84675f802b2f178` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:05.838909 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b694eb-2989-44aa-a4e9-2f35b938df6e None admin] RBAC: Authorizing `identity:get_user(user_id=9e52ccf157d64bf8a84675f802b2f178)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:05.840366 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b694eb-2989-44aa-a4e9-2f35b938df6e None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:05.842012 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 26/51] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:05 2022] GET /identity/v3/users/9e52ccf157d64bf8a84675f802b2f178 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:05.847709 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2f6ab-6068-4887-9635-bfe2de5973da None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:05.946715 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2f6ab-6068-4887-9635-bfe2de5973da None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:05.979913 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be9cc3-0fbe-4d11-8847-3a018a7c2324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:05.980701 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be9cc3-0fbe-4d11-8847-3a018a7c2324 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:05.980979 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be9cc3-0fbe-4d11-8847-3a018a7c2324 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:05.981250 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be9cc3-0fbe-4d11-8847-3a018a7c2324 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:05.982593 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be9cc3-0fbe-4d11-8847-3a018a7c2324 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:05.984031 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be9cc3-0fbe-4d11-8847-3a018a7c2324 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:05.985660 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 26/52] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:38:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:05.987822 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1705e-9519-4228-9d79-2130f639f402 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:05.988112 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1705e-9519-4228-9d79-2130f639f402 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:05.988389 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1705e-9519-4228-9d79-2130f639f402 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:05.990179 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 27/53] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:05.991251 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be9cc3-0fbe-4d11-8847-3a018a7c2324 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:05.995409 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12c9da-b1b7-4aef-8819-530966e13cb8 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:05.995692 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12c9da-b1b7-4aef-8819-530966e13cb8 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:05.995968 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12c9da-b1b7-4aef-8819-530966e13cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:06.012614 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-5c12c9da-b1b7-4aef-8819-530966e13cb8 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:06.013827 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-5c12c9da-b1b7-4aef-8819-530966e13cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:06.079387 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 28/54] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:38:06.085745 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be9cc3-0fbe-4d11-8847-3a018a7c2324 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:06.102271 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12c9da-b1b7-4aef-8819-530966e13cb8 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:06.118901 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664cd9d8-301f-4c07-99b4-4b482fca0ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:06.119558 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cd9d8-301f-4c07-99b4-4b482fca0ba2 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:06.119838 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cd9d8-301f-4c07-99b4-4b482fca0ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:06.120133 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664cd9d8-301f-4c07-99b4-4b482fca0ba2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:06.120954 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664cd9d8-301f-4c07-99b4-4b482fca0ba2 None admin] RBAC: Adding query filter params (role.id=fc021ed5870a44f5a0f0b8fff994d6f0, scope.domain.id=default, user.id=9e52ccf157d64bf8a84675f802b2f178) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:06.121257 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664cd9d8-301f-4c07-99b4-4b482fca0ba2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:06.122739 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664cd9d8-301f-4c07-99b4-4b482fca0ba2 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:06.131646 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 27/55] 10.222.0.18 () {56 vars in 1322 bytes} [Tue Mar 8 13:38:05 2022] GET /identity/v3/role_assignments?user.id=9e52ccf157d64bf8a84675f802b2f178&scope.domain.id=default&role.id=fc021ed5870a44f5a0f0b8fff994d6f0 => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:06.205368 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12c9da-b1b7-4aef-8819-530966e13cb8 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:06.241545 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1e9d0-3ff9-4780-9ea3-9a0246e10310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:06.242354 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1e9d0-3ff9-4780-9ea3-9a0246e10310 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:06.242629 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1e9d0-3ff9-4780-9ea3-9a0246e10310 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:06.242880 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1e9d0-3ff9-4780-9ea3-9a0246e10310 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:06.244115 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1e9d0-3ff9-4780-9ea3-9a0246e10310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:06.245608 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1e9d0-3ff9-4780-9ea3-9a0246e10310 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:06.247254 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 29/56] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:38:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:06.253088 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664cd9d8-301f-4c07-99b4-4b482fca0ba2 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:06.356068 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664cd9d8-301f-4c07-99b4-4b482fca0ba2 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:06.389180 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567401a5-d006-4ed9-8df4-0af8d7f8a269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:06.389868 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567401a5-d006-4ed9-8df4-0af8d7f8a269 None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:06.390145 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567401a5-d006-4ed9-8df4-0af8d7f8a269 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:06.390417 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567401a5-d006-4ed9-8df4-0af8d7f8a269 None admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:06.391117 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567401a5-d006-4ed9-8df4-0af8d7f8a269 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:06.392549 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567401a5-d006-4ed9-8df4-0af8d7f8a269 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:06.419352 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 28/57] 10.222.0.18 () {60 vars in 1140 bytes} [Tue Mar 8 13:38:06 2022] POST /identity/v3/projects => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:38:08.727539 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968e873-34e3-4432-92ff-d0fb16b194d3 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:08.728494 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968e873-34e3-4432-92ff-d0fb16b194d3 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:08.728494 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968e873-34e3-4432-92ff-d0fb16b194d3 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:08.731334 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 30/58] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:08.737754 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33865f-27df-464d-a6f1-5151ef8586f3 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:08.738446 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33865f-27df-464d-a6f1-5151ef8586f3 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:08.738725 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33865f-27df-464d-a6f1-5151ef8586f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:08.758113 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-3b33865f-27df-464d-a6f1-5151ef8586f3 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:08.759239 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-3b33865f-27df-464d-a6f1-5151ef8586f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:08.827823 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 29/59] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:08.854844 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968e873-34e3-4432-92ff-d0fb16b194d3 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:08.969065 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968e873-34e3-4432-92ff-d0fb16b194d3 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:09.002671 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8590f-4d24-4fd4-9acb-8bff13f004b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:09.003453 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8590f-4d24-4fd4-9acb-8bff13f004b5 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:09.003734 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8590f-4d24-4fd4-9acb-8bff13f004b5 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:09.003989 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8590f-4d24-4fd4-9acb-8bff13f004b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:09.005192 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8590f-4d24-4fd4-9acb-8bff13f004b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:09.006730 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8590f-4d24-4fd4-9acb-8bff13f004b5 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:09.008415 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 31/60] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:38:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:09.014417 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33865f-27df-464d-a6f1-5151ef8586f3 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:09.138054 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33865f-27df-464d-a6f1-5151ef8586f3 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:09.173722 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d016c78-4cd3-49c2-aec5-84301590f2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:09.174384 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d016c78-4cd3-49c2-aec5-84301590f2f3 None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:09.174665 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d016c78-4cd3-49c2-aec5-84301590f2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:09.174901 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d016c78-4cd3-49c2-aec5-84301590f2f3 None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:09.175650 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d016c78-4cd3-49c2-aec5-84301590f2f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:09.177095 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d016c78-4cd3-49c2-aec5-84301590f2f3 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:09.205809 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 30/61] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Mar 8 13:38:09 2022] POST /identity/v3/users => generated 275 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:38:12.630700 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389f68c-4b6a-4a43-b399-06ea97b72fee None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:12.631682 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389f68c-4b6a-4a43-b399-06ea97b72fee None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:12.632166 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389f68c-4b6a-4a43-b399-06ea97b72fee None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:12.634497 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 32/62] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:12.639486 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c759d4-69dc-4dac-8d8c-6771375b6320 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:12.640293 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c759d4-69dc-4dac-8d8c-6771375b6320 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:12.640758 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c759d4-69dc-4dac-8d8c-6771375b6320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:12.662790 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-52c759d4-69dc-4dac-8d8c-6771375b6320 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:12.663992 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-52c759d4-69dc-4dac-8d8c-6771375b6320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:12.750122 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 31/63] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:12.781135 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389f68c-4b6a-4a43-b399-06ea97b72fee None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:12.783675 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec7eeb-966e-4038-8978-c1b3da730180 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:12.783968 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec7eeb-966e-4038-8978-c1b3da730180 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:12.784246 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec7eeb-966e-4038-8978-c1b3da730180 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:12.786068 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 32/64] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:38:12.791619 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35f4e3-f71f-45d1-a490-b5c49d6ba419 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:12.791902 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35f4e3-f71f-45d1-a490-b5c49d6ba419 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:12.792178 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b35f4e3-f71f-45d1-a490-b5c49d6ba419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:12.809455 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-2b35f4e3-f71f-45d1-a490-b5c49d6ba419 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:12.810637 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-2b35f4e3-f71f-45d1-a490-b5c49d6ba419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:12.937620 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 33/65] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:38:12.944737 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc90ad1-1077-4a91-9e38-818408b9c023 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:12.945025 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc90ad1-1077-4a91-9e38-818408b9c023 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:12.945308 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc90ad1-1077-4a91-9e38-818408b9c023 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:12.947062 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 34/66] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:12.953486 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389f68c-4b6a-4a43-b399-06ea97b72fee None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:12.955303 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8209ec9-a7ba-4727-90ad-96ab36f1749d None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:12.955731 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8209ec9-a7ba-4727-90ad-96ab36f1749d None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:12.956134 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8209ec9-a7ba-4727-90ad-96ab36f1749d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:12.978508 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-f8209ec9-a7ba-4727-90ad-96ab36f1749d None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:12.979675 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f8209ec9-a7ba-4727-90ad-96ab36f1749d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:13.000542 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6132f-dcd4-434f-b8b0-abafc2e0fd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:13.001814 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6132f-dcd4-434f-b8b0-abafc2e0fd59 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:13.002099 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6132f-dcd4-434f-b8b0-abafc2e0fd59 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:13.002524 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6132f-dcd4-434f-b8b0-abafc2e0fd59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:13.012705 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c6132f-dcd4-434f-b8b0-abafc2e0fd59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:13.019674 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-17c6132f-dcd4-434f-b8b0-abafc2e0fd59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:38:13.021195 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 33/67] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:38:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:13.025866 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6132f-dcd4-434f-b8b0-abafc2e0fd59 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:13.057014 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 35/68] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:13.057014 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05554bbd-8d04-4cfc-85d9-1fc2a38079db None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:13.057014 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05554bbd-8d04-4cfc-85d9-1fc2a38079db None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:13.057014 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05554bbd-8d04-4cfc-85d9-1fc2a38079db None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:13.057014 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 36/69] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:13.057014 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05554bbd-8d04-4cfc-85d9-1fc2a38079db None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:13.142199 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6132f-dcd4-434f-b8b0-abafc2e0fd59 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:13.157916 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05554bbd-8d04-4cfc-85d9-1fc2a38079db None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:13.175646 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc63e1-b559-42ee-9c89-2f7a0d327457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:13.176669 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc63e1-b559-42ee-9c89-2f7a0d327457 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:13.177124 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc63e1-b559-42ee-9c89-2f7a0d327457 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:13.178133 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc63e1-b559-42ee-9c89-2f7a0d327457 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:13.190608 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc63e1-b559-42ee-9c89-2f7a0d327457 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:13.191301 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4fc3a2-5505-4895-9e6e-814513dabcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:13.191969 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fc3a2-5505-4895-9e6e-814513dabcd3 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:13.192248 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fc3a2-5505-4895-9e6e-814513dabcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:13.192520 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fc3a2-5505-4895-9e6e-814513dabcd3 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:13.193302 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fc3a2-5505-4895-9e6e-814513dabcd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:13.193631 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fc3a2-5505-4895-9e6e-814513dabcd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:13.195009 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fc3a2-5505-4895-9e6e-814513dabcd3 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:13.198458 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-33dc63e1-b559-42ee-9c89-2f7a0d327457 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 13:38:13.200410 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 34/70] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Mar 8 13:38:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:13.201958 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ffcdd-362f-42c5-939d-b0bdfa8d90b8 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:13.202392 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ffcdd-362f-42c5-939d-b0bdfa8d90b8 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:13.202815 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ffcdd-362f-42c5-939d-b0bdfa8d90b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:13.203496 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 37/71] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:13.204518 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4fc3a2-5505-4895-9e6e-814513dabcd3 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:13.219959 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-7e7ffcdd-362f-42c5-939d-b0bdfa8d90b8 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:13.221757 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-7e7ffcdd-362f-42c5-939d-b0bdfa8d90b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:13.288558 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 35/72] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:13.289785 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ffcdd-362f-42c5-939d-b0bdfa8d90b8 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:13.319889 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4fc3a2-5505-4895-9e6e-814513dabcd3 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:13.352063 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce604715-becf-42a7-b10a-408cc782c232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:13.352948 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce604715-becf-42a7-b10a-408cc782c232 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:13.353412 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce604715-becf-42a7-b10a-408cc782c232 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:13.353844 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce604715-becf-42a7-b10a-408cc782c232 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:13.365768 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce604715-becf-42a7-b10a-408cc782c232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:13.372851 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-ce604715-becf-42a7-b10a-408cc782c232 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 13:38:13.374544 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 38/73] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:13.375518 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce604715-becf-42a7-b10a-408cc782c232 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:13.388160 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ffcdd-362f-42c5-939d-b0bdfa8d90b8 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:13.422911 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d7a9e-eaef-4763-988c-f059095f5ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:13.423573 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d7a9e-eaef-4763-988c-f059095f5ea7 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:13.423853 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d7a9e-eaef-4763-988c-f059095f5ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:13.424123 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d7a9e-eaef-4763-988c-f059095f5ea7 None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:13.424865 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d7a9e-eaef-4763-988c-f059095f5ea7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:13.425167 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d7a9e-eaef-4763-988c-f059095f5ea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:13.426593 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d7a9e-eaef-4763-988c-f059095f5ea7 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:13.435184 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 36/74] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:38:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:13.439765 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d7a9e-eaef-4763-988c-f059095f5ea7 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:13.479257 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce604715-becf-42a7-b10a-408cc782c232 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:13.513107 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f907a-65f5-4064-941d-27e6853043e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:13.514030 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f907a-65f5-4064-941d-27e6853043e5 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:13.514310 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f907a-65f5-4064-941d-27e6853043e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:13.514585 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f907a-65f5-4064-941d-27e6853043e5 None admin] PATH_INFO: `/v3/users/9e52ccf157d64bf8a84675f802b2f178` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:13.516131 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f907a-65f5-4064-941d-27e6853043e5 None admin] RBAC: Authorizing `identity:get_user(user_id=9e52ccf157d64bf8a84675f802b2f178)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:13.517637 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f907a-65f5-4064-941d-27e6853043e5 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:13.519283 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 39/75] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:13 2022] GET /identity/v3/users/9e52ccf157d64bf8a84675f802b2f178 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:13.520034 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f907a-65f5-4064-941d-27e6853043e5 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:13.530823 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d7a9e-eaef-4763-988c-f059095f5ea7 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:13.562192 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6aa9f8-c11d-480a-8fc4-f6f545d4d83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:13.562998 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6aa9f8-c11d-480a-8fc4-f6f545d4d83c None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:13.563270 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6aa9f8-c11d-480a-8fc4-f6f545d4d83c None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:13.563540 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6aa9f8-c11d-480a-8fc4-f6f545d4d83c None admin] PATH_INFO: `/v3/roles/member` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:13.573657 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6aa9f8-c11d-480a-8fc4-f6f545d4d83c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:13.580330 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-8b6aa9f8-c11d-480a-8fc4-f6f545d4d83c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 13:38:13.581535 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 37/76] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:13.582680 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77217556-d387-4f3c-afb5-bb6cc574a906 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:13.582967 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77217556-d387-4f3c-afb5-bb6cc574a906 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:13.583221 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77217556-d387-4f3c-afb5-bb6cc574a906 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:13.585031 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 38/77] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:13.586982 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77217556-d387-4f3c-afb5-bb6cc574a906 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:13.615456 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f907a-65f5-4064-941d-27e6853043e5 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:13.646522 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45164e1e-0ad9-448f-86cb-beb21635659c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:13.647226 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45164e1e-0ad9-448f-86cb-beb21635659c None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:13.647511 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45164e1e-0ad9-448f-86cb-beb21635659c None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:13.647782 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45164e1e-0ad9-448f-86cb-beb21635659c None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:13.648533 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45164e1e-0ad9-448f-86cb-beb21635659c None admin] RBAC: Adding query filter params (name=member) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:13.648835 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45164e1e-0ad9-448f-86cb-beb21635659c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:13.650264 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45164e1e-0ad9-448f-86cb-beb21635659c None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:13.663430 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 40/78] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:13.663430 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45164e1e-0ad9-448f-86cb-beb21635659c None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:13.685347 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77217556-d387-4f3c-afb5-bb6cc574a906 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:13.718097 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a62c72-e030-4544-af68-a8ed10168231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:13.719038 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a62c72-e030-4544-af68-a8ed10168231 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:13.719386 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a62c72-e030-4544-af68-a8ed10168231 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:13.719662 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a62c72-e030-4544-af68-a8ed10168231 None admin] PATH_INFO: `/v3/users/1a3f15d7da12407f871bd0cc9ee78047` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:13.732318 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a62c72-e030-4544-af68-a8ed10168231 None admin] RBAC: Authorizing `identity:get_user(user_id=1a3f15d7da12407f871bd0cc9ee78047)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:13.733824 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a62c72-e030-4544-af68-a8ed10168231 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:13.735504 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 39/79] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:13 2022] GET /identity/v3/users/1a3f15d7da12407f871bd0cc9ee78047 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:13.736272 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a62c72-e030-4544-af68-a8ed10168231 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:13.756501 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45164e1e-0ad9-448f-86cb-beb21635659c None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:13.790196 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec978741-7ed8-4002-bc6f-79d0b88206c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:13.790825 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec978741-7ed8-4002-bc6f-79d0b88206c2 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:13.791105 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec978741-7ed8-4002-bc6f-79d0b88206c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:13.791376 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec978741-7ed8-4002-bc6f-79d0b88206c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:13.828728 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a62c72-e030-4544-af68-a8ed10168231 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:13.852926 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec978741-7ed8-4002-bc6f-79d0b88206c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:13.854417 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec978741-7ed8-4002-bc6f-79d0b88206c2 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:13.860438 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54b230-98a7-4f2e-9be0-ae5f2985d488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:13.861090 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54b230-98a7-4f2e-9be0-ae5f2985d488 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:13.861382 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54b230-98a7-4f2e-9be0-ae5f2985d488 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:13.861659 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54b230-98a7-4f2e-9be0-ae5f2985d488 None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:13.862433 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54b230-98a7-4f2e-9be0-ae5f2985d488 None admin] RBAC: Adding query filter params (name=member) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:13.862734 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54b230-98a7-4f2e-9be0-ae5f2985d488 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:13.864074 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54b230-98a7-4f2e-9be0-ae5f2985d488 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:13.871816 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 40/80] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:13.872937 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ba51a-eeca-4094-9140-3ed3da5ca241 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:13.873223 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ba51a-eeca-4094-9140-3ed3da5ca241 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:13.873529 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ba51a-eeca-4094-9140-3ed3da5ca241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:13.888901 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-8f4ba51a-eeca-4094-9140-3ed3da5ca241 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:13.890134 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-8f4ba51a-eeca-4094-9140-3ed3da5ca241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:13.949231 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 41/81] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:38:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:13.950096 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec978741-7ed8-4002-bc6f-79d0b88206c2 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:13.955902 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 41/82] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:13.956715 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ba51a-eeca-4094-9140-3ed3da5ca241 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:14.046452 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec978741-7ed8-4002-bc6f-79d0b88206c2 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:14.048673 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ba51a-eeca-4094-9140-3ed3da5ca241 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:14.078855 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae28ec-3c56-45f8-acb5-371b58faf581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:14.079671 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae28ec-3c56-45f8-acb5-371b58faf581 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:14.079953 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae28ec-3c56-45f8-acb5-371b58faf581 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:14.080230 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae28ec-3c56-45f8-acb5-371b58faf581 None admin] PATH_INFO: `/v3/users/1a3f15d7da12407f871bd0cc9ee78047` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:14.081423 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae28ec-3c56-45f8-acb5-371b58faf581 None admin] RBAC: Authorizing `identity:get_user(user_id=1a3f15d7da12407f871bd0cc9ee78047)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:14.081794 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667e701-f5da-4612-9e0a-45bfd76dfc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:14.082440 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667e701-f5da-4612-9e0a-45bfd76dfc41 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:14.082723 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667e701-f5da-4612-9e0a-45bfd76dfc41 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:14.082849 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae28ec-3c56-45f8-acb5-371b58faf581 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:14.082996 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b667e701-f5da-4612-9e0a-45bfd76dfc41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:14.084518 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 42/83] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:13 2022] GET /identity/v3/users/1a3f15d7da12407f871bd0cc9ee78047 => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:14.085268 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae28ec-3c56-45f8-acb5-371b58faf581 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:14.150385 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667e701-f5da-4612-9e0a-45bfd76dfc41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:14.151945 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b667e701-f5da-4612-9e0a-45bfd76dfc41 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:14.180524 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae28ec-3c56-45f8-acb5-371b58faf581 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:14.213222 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037f319-260d-4d78-852a-4f51167b116b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:14.214148 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037f319-260d-4d78-852a-4f51167b116b None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:14.214431 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037f319-260d-4d78-852a-4f51167b116b None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:14.214709 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037f319-260d-4d78-852a-4f51167b116b None admin] PATH_INFO: `/v3/users/1a3f15d7da12407f871bd0cc9ee78047` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:14.215973 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037f319-260d-4d78-852a-4f51167b116b None admin] RBAC: Authorizing `identity:get_user(user_id=1a3f15d7da12407f871bd0cc9ee78047)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:14.217384 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037f319-260d-4d78-852a-4f51167b116b None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:14.219039 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 43/84] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:14 2022] GET /identity/v3/users/1a3f15d7da12407f871bd0cc9ee78047 => generated 275 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:14.219797 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037f319-260d-4d78-852a-4f51167b116b None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:14.244071 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 42/85] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:38:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:14.244892 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667e701-f5da-4612-9e0a-45bfd76dfc41 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:14.315922 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037f319-260d-4d78-852a-4f51167b116b None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:14.352459 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0cdcde-65e2-4b15-afbe-5c8127fc05e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:14.353249 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cdcde-65e2-4b15-afbe-5c8127fc05e9 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:14.353573 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cdcde-65e2-4b15-afbe-5c8127fc05e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:14.353847 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0cdcde-65e2-4b15-afbe-5c8127fc05e9 None admin] PATH_INFO: `/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:14.355667 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0cdcde-65e2-4b15-afbe-5c8127fc05e9 None admin] RBAC: Authorizing `identity:get_project(project_id=4b15a0b04df24a618ea34b84d6e6ddd2)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:14.356350 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b667e701-f5da-4612-9e0a-45bfd76dfc41 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:14.358395 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0cdcde-65e2-4b15-afbe-5c8127fc05e9 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:14.360641 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 44/86] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:14 2022] GET /identity/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:14.361186 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0cdcde-65e2-4b15-afbe-5c8127fc05e9 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:14.390488 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd989b3-c10c-4ef5-aada-53b9a8bb16b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:14.391304 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd989b3-c10c-4ef5-aada-53b9a8bb16b9 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:14.391590 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd989b3-c10c-4ef5-aada-53b9a8bb16b9 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:14.391846 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd989b3-c10c-4ef5-aada-53b9a8bb16b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:14.393051 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd989b3-c10c-4ef5-aada-53b9a8bb16b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:14.394547 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd989b3-c10c-4ef5-aada-53b9a8bb16b9 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:14.396364 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 43/87] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:38:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:14.397051 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd989b3-c10c-4ef5-aada-53b9a8bb16b9 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:14.459636 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0cdcde-65e2-4b15-afbe-5c8127fc05e9 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:14.494502 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8543d6-70cc-419a-992b-3688ba960927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:14.495173 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8543d6-70cc-419a-992b-3688ba960927 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:14.495443 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8543d6-70cc-419a-992b-3688ba960927 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:14.495721 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8543d6-70cc-419a-992b-3688ba960927 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:14.499206 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd989b3-c10c-4ef5-aada-53b9a8bb16b9 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:14.531576 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725583c7-5f22-4ef7-9b4e-21cf64ca8b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:14.532224 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725583c7-5f22-4ef7-9b4e-21cf64ca8b45 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:14.532504 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725583c7-5f22-4ef7-9b4e-21cf64ca8b45 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:14.532803 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725583c7-5f22-4ef7-9b4e-21cf64ca8b45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:14.562377 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8543d6-70cc-419a-992b-3688ba960927 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:14.563884 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8543d6-70cc-419a-992b-3688ba960927 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:14.598411 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725583c7-5f22-4ef7-9b4e-21cf64ca8b45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:14.599924 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725583c7-5f22-4ef7-9b4e-21cf64ca8b45 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:14.659772 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 45/88] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:38:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:14.660543 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8543d6-70cc-419a-992b-3688ba960927 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:14.700035 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 44/89] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:38:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:14.700879 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725583c7-5f22-4ef7-9b4e-21cf64ca8b45 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:14.755613 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8543d6-70cc-419a-992b-3688ba960927 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:14.790953 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd497d-32c0-41c3-bc89-6a5656f92341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:14.791819 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd497d-32c0-41c3-bc89-6a5656f92341 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:14.792096 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd497d-32c0-41c3-bc89-6a5656f92341 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:14.792366 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fd497d-32c0-41c3-bc89-6a5656f92341 None admin] PATH_INFO: `/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:14.793716 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd497d-32c0-41c3-bc89-6a5656f92341 None admin] RBAC: Authorizing `identity:get_project(project_id=4b15a0b04df24a618ea34b84d6e6ddd2)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:14.795185 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fd497d-32c0-41c3-bc89-6a5656f92341 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:14.796902 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 46/90] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:14 2022] GET /identity/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:14.797672 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd497d-32c0-41c3-bc89-6a5656f92341 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:14.800164 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725583c7-5f22-4ef7-9b4e-21cf64ca8b45 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:14.836045 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6e7d6-26ca-4261-958d-bb40dca5acdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:14.836705 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6e7d6-26ca-4261-958d-bb40dca5acdf None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:14.836986 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6e7d6-26ca-4261-958d-bb40dca5acdf None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:14.837262 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6e7d6-26ca-4261-958d-bb40dca5acdf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:14.838128 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6e7d6-26ca-4261-958d-bb40dca5acdf None admin] RBAC: Adding query filter params (role.id=fc021ed5870a44f5a0f0b8fff994d6f0, scope.project.id=4b15a0b04df24a618ea34b84d6e6ddd2, user.id=9e52ccf157d64bf8a84675f802b2f178) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:14.838441 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6e7d6-26ca-4261-958d-bb40dca5acdf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:14.839892 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6e7d6-26ca-4261-958d-bb40dca5acdf None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:14.845185 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 45/91] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:38:14 2022] GET /identity/v3/role_assignments?user.id=9e52ccf157d64bf8a84675f802b2f178&scope.project.id=4b15a0b04df24a618ea34b84d6e6ddd2&role.id=fc021ed5870a44f5a0f0b8fff994d6f0 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:14.845987 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6e7d6-26ca-4261-958d-bb40dca5acdf None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:14.897107 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fd497d-32c0-41c3-bc89-6a5656f92341 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:14.935904 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67167962-3492-4e04-8d98-e1ca1e47dac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:14.936747 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67167962-3492-4e04-8d98-e1ca1e47dac1 None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:14.937033 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67167962-3492-4e04-8d98-e1ca1e47dac1 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:14.937312 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67167962-3492-4e04-8d98-e1ca1e47dac1 None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:14.938093 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67167962-3492-4e04-8d98-e1ca1e47dac1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:14.939565 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67167962-3492-4e04-8d98-e1ca1e47dac1 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:14.960912 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 47/92] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Mar 8 13:38:14 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:38:14.961275 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6e7d6-26ca-4261-958d-bb40dca5acdf None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:14.962047 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67167962-3492-4e04-8d98-e1ca1e47dac1 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:15.000748 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498eab31-9589-4c62-80c5-4379c2ceaabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:15.001940 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498eab31-9589-4c62-80c5-4379c2ceaabd None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:15.002367 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498eab31-9589-4c62-80c5-4379c2ceaabd None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:15.002803 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498eab31-9589-4c62-80c5-4379c2ceaabd None admin] PATH_INFO: `/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:15.004344 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498eab31-9589-4c62-80c5-4379c2ceaabd None admin] RBAC: Authorizing `identity:get_project(project_id=4b15a0b04df24a618ea34b84d6e6ddd2)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:15.006183 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498eab31-9589-4c62-80c5-4379c2ceaabd None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:15.008192 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 46/93] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:14 2022] GET /identity/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:15.009129 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498eab31-9589-4c62-80c5-4379c2ceaabd None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:15.075706 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67167962-3492-4e04-8d98-e1ca1e47dac1 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:15.115929 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b7ba0-4cdc-4ce1-8bea-2a372d6bab5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:15.117145 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b7ba0-4cdc-4ce1-8bea-2a372d6bab5f None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:15.117450 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b7ba0-4cdc-4ce1-8bea-2a372d6bab5f None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:15.117732 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b7ba0-4cdc-4ce1-8bea-2a372d6bab5f None admin] PATH_INFO: `/v3/projects/00cf9e3da9ae4eef8d69312fc48cbaa1` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:15.119138 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b7ba0-4cdc-4ce1-8bea-2a372d6bab5f None admin] RBAC: Authorizing `identity:get_project(project_id=00cf9e3da9ae4eef8d69312fc48cbaa1)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:15.120630 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b7ba0-4cdc-4ce1-8bea-2a372d6bab5f None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:15.122995 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 48/94] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:14 2022] GET /identity/v3/projects/00cf9e3da9ae4eef8d69312fc48cbaa1 => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:15.123883 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b7ba0-4cdc-4ce1-8bea-2a372d6bab5f None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:15.134597 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498eab31-9589-4c62-80c5-4379c2ceaabd None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:15.171678 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866d149-f1c8-49ac-b2a7-fa95a4f69891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:15.173416 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866d149-f1c8-49ac-b2a7-fa95a4f69891 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:15.173761 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866d149-f1c8-49ac-b2a7-fa95a4f69891 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:15.174051 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3866d149-f1c8-49ac-b2a7-fa95a4f69891 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:15.174923 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866d149-f1c8-49ac-b2a7-fa95a4f69891 None admin] RBAC: Adding query filter params (role.id=cbd629eb0cbe4cc7b69cc790228cdfc8, scope.project.id=4b15a0b04df24a618ea34b84d6e6ddd2, user.id=1a3f15d7da12407f871bd0cc9ee78047) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:15.175243 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866d149-f1c8-49ac-b2a7-fa95a4f69891 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:15.176702 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3866d149-f1c8-49ac-b2a7-fa95a4f69891 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:15.184224 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 47/95] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:38:15 2022] GET /identity/v3/role_assignments?user.id=1a3f15d7da12407f871bd0cc9ee78047&scope.project.id=4b15a0b04df24a618ea34b84d6e6ddd2&role.id=cbd629eb0cbe4cc7b69cc790228cdfc8 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:15.185073 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866d149-f1c8-49ac-b2a7-fa95a4f69891 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:15.246202 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b7ba0-4cdc-4ce1-8bea-2a372d6bab5f None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:15.291548 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeba33f-f0f9-466a-994b-12d90aaf45f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:15.292526 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeba33f-f0f9-466a-994b-12d90aaf45f7 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:15.294011 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeba33f-f0f9-466a-994b-12d90aaf45f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:15.294905 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeba33f-f0f9-466a-994b-12d90aaf45f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:15.297063 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeba33f-f0f9-466a-994b-12d90aaf45f7 None admin] RBAC: Adding query filter params (role.id=0010e8da2d4b4bb8af05894096d2fc92, scope.project.id=4b15a0b04df24a618ea34b84d6e6ddd2, user.id=1a3f15d7da12407f871bd0cc9ee78047) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:15.297729 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeba33f-f0f9-466a-994b-12d90aaf45f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:15.299745 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeba33f-f0f9-466a-994b-12d90aaf45f7 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:15.308209 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 49/96] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:38:15 2022] GET /identity/v3/role_assignments?user.id=1a3f15d7da12407f871bd0cc9ee78047&scope.project.id=4b15a0b04df24a618ea34b84d6e6ddd2&role.id=0010e8da2d4b4bb8af05894096d2fc92 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:15.321676 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3866d149-f1c8-49ac-b2a7-fa95a4f69891 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:15.365613 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5afb9a-a5db-40d5-af1f-d3d6ccbb77eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:15.366691 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5afb9a-a5db-40d5-af1f-d3d6ccbb77eb None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:15.367192 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5afb9a-a5db-40d5-af1f-d3d6ccbb77eb None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:15.367664 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5afb9a-a5db-40d5-af1f-d3d6ccbb77eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:15.368773 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5afb9a-a5db-40d5-af1f-d3d6ccbb77eb None admin] RBAC: Adding query filter params (role.id=0010e8da2d4b4bb8af05894096d2fc92, scope.project.id=00cf9e3da9ae4eef8d69312fc48cbaa1, user.id=1a3f15d7da12407f871bd0cc9ee78047) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:15.369318 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5afb9a-a5db-40d5-af1f-d3d6ccbb77eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:15.371111 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5afb9a-a5db-40d5-af1f-d3d6ccbb77eb None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:15.377918 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 48/97] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:38:15 2022] GET /identity/v3/role_assignments?user.id=1a3f15d7da12407f871bd0cc9ee78047&scope.project.id=00cf9e3da9ae4eef8d69312fc48cbaa1&role.id=0010e8da2d4b4bb8af05894096d2fc92 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:18.113996 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cd1e0-94ef-4027-b1d8-94a4e33eb29b None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:18.114605 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cd1e0-94ef-4027-b1d8-94a4e33eb29b None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:18.114605 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3cd1e0-94ef-4027-b1d8-94a4e33eb29b None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:18.116364 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 50/98] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:18.121627 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859ea87-fd7b-49de-b11b-77f918a0740c None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:18.122081 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859ea87-fd7b-49de-b11b-77f918a0740c None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:18.122263 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8859ea87-fd7b-49de-b11b-77f918a0740c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:18.147371 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-8859ea87-fd7b-49de-b11b-77f918a0740c None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:18.148567 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-8859ea87-fd7b-49de-b11b-77f918a0740c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:18.156389 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e85a1-35e8-4ba1-9ef1-dfca955c9d9c None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:18.156666 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e85a1-35e8-4ba1-9ef1-dfca955c9d9c None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:18.156935 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e85a1-35e8-4ba1-9ef1-dfca955c9d9c None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:18.158929 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 51/99] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:38:18.164585 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae15d1d-a2e6-47b3-828c-bbc503a35d1d None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:18.164870 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae15d1d-a2e6-47b3-828c-bbc503a35d1d None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:18.165145 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae15d1d-a2e6-47b3-828c-bbc503a35d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:18.194454 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-cae15d1d-a2e6-47b3-828c-bbc503a35d1d None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:18.196023 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-cae15d1d-a2e6-47b3-828c-bbc503a35d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:18.239232 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 49/100] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:18.240611 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc06fc-1f34-4b16-a64a-897c9cc4b061 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:18.240894 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc06fc-1f34-4b16-a64a-897c9cc4b061 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:18.241194 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc06fc-1f34-4b16-a64a-897c9cc4b061 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:18.247220 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 50/101] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:18.253403 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacb846-30aa-464f-810f-b9e7ee1bd13f None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:18.253403 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacb846-30aa-464f-810f-b9e7ee1bd13f None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:18.253403 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacb846-30aa-464f-810f-b9e7ee1bd13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:18.281297 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-8bacb846-30aa-464f-810f-b9e7ee1bd13f None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:18.282932 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-8bacb846-30aa-464f-810f-b9e7ee1bd13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:18.335598 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 52/102] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:38:18.336469 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae15d1d-a2e6-47b3-828c-bbc503a35d1d None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:18.355881 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 51/103] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:38:18.372527 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacb846-30aa-464f-810f-b9e7ee1bd13f None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:18.472130 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacb846-30aa-464f-810f-b9e7ee1bd13f None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:18.514374 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba351bbb-c81b-4386-a42a-7b2f9984d0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:18.515487 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba351bbb-c81b-4386-a42a-7b2f9984d0b0 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:18.515907 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba351bbb-c81b-4386-a42a-7b2f9984d0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:18.516328 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba351bbb-c81b-4386-a42a-7b2f9984d0b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:18.537818 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba351bbb-c81b-4386-a42a-7b2f9984d0b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:18.545325 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-ba351bbb-c81b-4386-a42a-7b2f9984d0b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 13:38:18.546953 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 52/104] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:38:18.547890 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba351bbb-c81b-4386-a42a-7b2f9984d0b0 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:18.574037 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae15d1d-a2e6-47b3-828c-bbc503a35d1d None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:18.615136 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7dbcd-4b00-498a-9068-a42b0d114ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:18.616176 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7dbcd-4b00-498a-9068-a42b0d114ff2 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:18.616558 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7dbcd-4b00-498a-9068-a42b0d114ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:18.616894 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7dbcd-4b00-498a-9068-a42b0d114ff2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:18.635669 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7dbcd-4b00-498a-9068-a42b0d114ff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:18.651249 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-ece7dbcd-4b00-498a-9068-a42b0d114ff2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 13:38:18.652852 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 53/105] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Mar 8 13:38:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:18.653751 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7dbcd-4b00-498a-9068-a42b0d114ff2 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:18.700326 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba351bbb-c81b-4386-a42a-7b2f9984d0b0 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:18.732812 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa9376-4500-4a0e-8ecd-3599c289560b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:18.733646 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa9376-4500-4a0e-8ecd-3599c289560b None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:18.733926 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa9376-4500-4a0e-8ecd-3599c289560b None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:18.734270 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa9376-4500-4a0e-8ecd-3599c289560b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:18.745680 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa9376-4500-4a0e-8ecd-3599c289560b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:18.752458 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-fdfa9376-4500-4a0e-8ecd-3599c289560b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:38:18.753918 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 53/106] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:38:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:18.754694 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa9376-4500-4a0e-8ecd-3599c289560b None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:18.790633 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7dbcd-4b00-498a-9068-a42b0d114ff2 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:18.832626 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f9e36-164d-4e4d-9f1b-b7f7276c255d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:18.833978 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f9e36-164d-4e4d-9f1b-b7f7276c255d None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:18.834456 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f9e36-164d-4e4d-9f1b-b7f7276c255d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:18.835044 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f9e36-164d-4e4d-9f1b-b7f7276c255d None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:18.836345 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f9e36-164d-4e4d-9f1b-b7f7276c255d None admin] RBAC: Adding query filter params (name=member) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:18.836836 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f9e36-164d-4e4d-9f1b-b7f7276c255d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:18.838678 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f9e36-164d-4e4d-9f1b-b7f7276c255d None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:18.848329 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 54/107] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:18.853308 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c584d62-8442-484c-b1b1-99a726f4650b None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:18.853308 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c584d62-8442-484c-b1b1-99a726f4650b None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:18.853308 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c584d62-8442-484c-b1b1-99a726f4650b None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:18.856554 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 55/108] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:18.857948 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c584d62-8442-484c-b1b1-99a726f4650b None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:18.868659 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa9376-4500-4a0e-8ecd-3599c289560b None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:18.910307 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843a008-a15e-4be0-806b-0891312137c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:18.911277 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843a008-a15e-4be0-806b-0891312137c1 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:18.911725 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843a008-a15e-4be0-806b-0891312137c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:18.912475 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843a008-a15e-4be0-806b-0891312137c1 None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:18.913675 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843a008-a15e-4be0-806b-0891312137c1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:18.914072 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843a008-a15e-4be0-806b-0891312137c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:18.915469 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843a008-a15e-4be0-806b-0891312137c1 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:18.924323 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 54/109] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:38:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:18.925131 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843a008-a15e-4be0-806b-0891312137c1 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:18.971305 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c584d62-8442-484c-b1b1-99a726f4650b None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:19.003222 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a204302-e7f8-4868-92e1-b7150426fc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:19.003906 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a204302-e7f8-4868-92e1-b7150426fc0c None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:19.004190 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a204302-e7f8-4868-92e1-b7150426fc0c None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:19.004463 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a204302-e7f8-4868-92e1-b7150426fc0c None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:19.005299 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a204302-e7f8-4868-92e1-b7150426fc0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:19.005658 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a204302-e7f8-4868-92e1-b7150426fc0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:19.007003 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a204302-e7f8-4868-92e1-b7150426fc0c None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:19.015314 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 56/110] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:19.016543 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb938d7-1e75-4cf3-b57d-5bf871bbc083 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:19.016771 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb938d7-1e75-4cf3-b57d-5bf871bbc083 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:19.017045 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb938d7-1e75-4cf3-b57d-5bf871bbc083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:19.023809 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843a008-a15e-4be0-806b-0891312137c1 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:19.033958 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-7fb938d7-1e75-4cf3-b57d-5bf871bbc083 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:19.035144 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-7fb938d7-1e75-4cf3-b57d-5bf871bbc083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:19.055723 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ee940-5066-4a69-9403-8754bc50bfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:19.056607 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ee940-5066-4a69-9403-8754bc50bfbe None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:19.056891 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ee940-5066-4a69-9403-8754bc50bfbe None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:19.057164 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ee940-5066-4a69-9403-8754bc50bfbe None admin] PATH_INFO: `/v3/users/1a3f15d7da12407f871bd0cc9ee78047` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:19.058392 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ee940-5066-4a69-9403-8754bc50bfbe None admin] RBAC: Authorizing `identity:get_user(user_id=1a3f15d7da12407f871bd0cc9ee78047)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:19.059834 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ee940-5066-4a69-9403-8754bc50bfbe None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:19.061480 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 55/111] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:18 2022] GET /identity/v3/users/1a3f15d7da12407f871bd0cc9ee78047 => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:19.065946 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4bf60-5865-4b92-a808-e905372e0daf None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:19.065946 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4bf60-5865-4b92-a808-e905372e0daf None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:19.065946 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4bf60-5865-4b92-a808-e905372e0daf None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:19.065946 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 56/112] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:19.065946 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4bf60-5865-4b92-a808-e905372e0daf None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:19.103639 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 57/113] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:19.104465 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb938d7-1e75-4cf3-b57d-5bf871bbc083 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:19.164472 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4bf60-5865-4b92-a808-e905372e0daf None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:19.199939 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0f352-72a7-471e-b9fe-7b0f2cb5f4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:19.201067 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0f352-72a7-471e-b9fe-7b0f2cb5f4dd None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:19.201439 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0f352-72a7-471e-b9fe-7b0f2cb5f4dd None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:19.201719 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0f352-72a7-471e-b9fe-7b0f2cb5f4dd None admin] PATH_INFO: `/v3/users/1a3f15d7da12407f871bd0cc9ee78047` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:19.203151 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0f352-72a7-471e-b9fe-7b0f2cb5f4dd None admin] RBAC: Authorizing `identity:get_user(user_id=1a3f15d7da12407f871bd0cc9ee78047)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:19.203738 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb938d7-1e75-4cf3-b57d-5bf871bbc083 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:19.204656 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d0f352-72a7-471e-b9fe-7b0f2cb5f4dd None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:19.211171 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 57/114] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:19 2022] GET /identity/v3/users/1a3f15d7da12407f871bd0cc9ee78047 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:19.211171 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73588c02-f45a-4a3f-8787-0e9b7415cc31 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:19.211171 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73588c02-f45a-4a3f-8787-0e9b7415cc31 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:19.211171 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73588c02-f45a-4a3f-8787-0e9b7415cc31 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:19.211171 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 58/115] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:19.211603 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73588c02-f45a-4a3f-8787-0e9b7415cc31 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:19.239356 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9977315-aab3-47db-9e26-f5d501aed6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:19.240244 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9977315-aab3-47db-9e26-f5d501aed6ca None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:19.240522 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9977315-aab3-47db-9e26-f5d501aed6ca None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:19.240796 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9977315-aab3-47db-9e26-f5d501aed6ca None admin] PATH_INFO: `/v3/users/9e52ccf157d64bf8a84675f802b2f178` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:19.242009 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9977315-aab3-47db-9e26-f5d501aed6ca None admin] RBAC: Authorizing `identity:get_user(user_id=9e52ccf157d64bf8a84675f802b2f178)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:19.243446 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9977315-aab3-47db-9e26-f5d501aed6ca None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:19.245064 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 58/116] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:19 2022] GET /identity/v3/users/9e52ccf157d64bf8a84675f802b2f178 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:19.246278 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947572d-553e-4d46-9d18-171936988fac None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:19.246568 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947572d-553e-4d46-9d18-171936988fac None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:19.246841 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947572d-553e-4d46-9d18-171936988fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:19.263234 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-e947572d-553e-4d46-9d18-171936988fac None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:19.264396 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-e947572d-553e-4d46-9d18-171936988fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:19.309540 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73588c02-f45a-4a3f-8787-0e9b7415cc31 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:19.328901 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 59/117] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:19.341514 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947572d-553e-4d46-9d18-171936988fac None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:19.354520 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea664136-fb26-4585-8164-6de420393c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:19.355397 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea664136-fb26-4585-8164-6de420393c7d None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:19.355684 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea664136-fb26-4585-8164-6de420393c7d None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:19.355960 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea664136-fb26-4585-8164-6de420393c7d None admin] PATH_INFO: `/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:19.357202 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea664136-fb26-4585-8164-6de420393c7d None admin] RBAC: Authorizing `identity:get_project(project_id=4b15a0b04df24a618ea34b84d6e6ddd2)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:19.358700 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea664136-fb26-4585-8164-6de420393c7d None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:19.360387 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 59/118] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:19 2022] GET /identity/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:19.361143 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea664136-fb26-4585-8164-6de420393c7d None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:19.423896 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947572d-553e-4d46-9d18-171936988fac None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:19.453438 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea664136-fb26-4585-8164-6de420393c7d None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:19.454991 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4863e96-ef76-42c8-9950-8503c2dd9f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:19.455788 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4863e96-ef76-42c8-9950-8503c2dd9f38 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:19.456065 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4863e96-ef76-42c8-9950-8503c2dd9f38 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:19.456340 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4863e96-ef76-42c8-9950-8503c2dd9f38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:19.457539 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4863e96-ef76-42c8-9950-8503c2dd9f38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:19.459033 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4863e96-ef76-42c8-9950-8503c2dd9f38 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:19.460648 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 60/119] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:38:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:19.462704 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6749f47-4ee3-4d41-a609-7b9f58fc8bca None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:19.462963 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6749f47-4ee3-4d41-a609-7b9f58fc8bca None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:19.463239 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6749f47-4ee3-4d41-a609-7b9f58fc8bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:19.479676 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-e6749f47-4ee3-4d41-a609-7b9f58fc8bca None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:19.480867 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-e6749f47-4ee3-4d41-a609-7b9f58fc8bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:19.486463 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12491aa8-8f07-4095-8964-c10391950b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:19.487322 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12491aa8-8f07-4095-8964-c10391950b2f None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:19.487607 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12491aa8-8f07-4095-8964-c10391950b2f None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:19.487886 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12491aa8-8f07-4095-8964-c10391950b2f None admin] PATH_INFO: `/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:19.489070 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12491aa8-8f07-4095-8964-c10391950b2f None admin] RBAC: Authorizing `identity:get_project(project_id=4b15a0b04df24a618ea34b84d6e6ddd2)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:19.490615 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12491aa8-8f07-4095-8964-c10391950b2f None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:19.496891 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 60/120] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:19 2022] GET /identity/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2 => generated 298 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:19.496891 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12491aa8-8f07-4095-8964-c10391950b2f None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:19.545333 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 61/121] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:19.546268 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6749f47-4ee3-4d41-a609-7b9f58fc8bca None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:19.586747 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12491aa8-8f07-4095-8964-c10391950b2f None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:19.617599 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5f8d1-1b50-42fe-8003-37fbb4472b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:19.618452 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5f8d1-1b50-42fe-8003-37fbb4472b21 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:19.618735 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5f8d1-1b50-42fe-8003-37fbb4472b21 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:19.619014 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5f8d1-1b50-42fe-8003-37fbb4472b21 None admin] PATH_INFO: `/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:19.620194 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5f8d1-1b50-42fe-8003-37fbb4472b21 None admin] RBAC: Authorizing `identity:get_project(project_id=4b15a0b04df24a618ea34b84d6e6ddd2)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:19.621699 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5f8d1-1b50-42fe-8003-37fbb4472b21 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:19.623435 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 61/122] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:19 2022] GET /identity/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2 => generated 298 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:19.625284 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5f8d1-1b50-42fe-8003-37fbb4472b21 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:19.638450 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6749f47-4ee3-4d41-a609-7b9f58fc8bca None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:19.671271 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ccd34-aa2c-45d4-879d-a9fbed46a0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:19.672077 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ccd34-aa2c-45d4-879d-a9fbed46a0a0 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:19.672350 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ccd34-aa2c-45d4-879d-a9fbed46a0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:19.672623 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ccd34-aa2c-45d4-879d-a9fbed46a0a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:19.683142 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ccd34-aa2c-45d4-879d-a9fbed46a0a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:19.689927 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-aa9ccd34-aa2c-45d4-879d-a9fbed46a0a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 13:38:19.691123 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 62/123] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:19.691871 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ccd34-aa2c-45d4-879d-a9fbed46a0a0 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:19.719930 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5f8d1-1b50-42fe-8003-37fbb4472b21 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:19.753401 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c56fd-e268-4dfc-a472-93865e135e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:19.754309 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c56fd-e268-4dfc-a472-93865e135e7b None admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:19.754592 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c56fd-e268-4dfc-a472-93865e135e7b None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:19.754900 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c56fd-e268-4dfc-a472-93865e135e7b None admin] PATH_INFO: `/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2/users/1a3f15d7da12407f871bd0cc9ee78047/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:19.756943 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c56fd-e268-4dfc-a472-93865e135e7b None admin] RBAC: Authorizing `identity:create_grant(project_id=4b15a0b04df24a618ea34b84d6e6ddd2, user_id=1a3f15d7da12407f871bd0cc9ee78047, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:19.758414 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c56fd-e268-4dfc-a472-93865e135e7b None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:19.772230 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 62/124] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Mar 8 13:38:19 2022] PUT /identity/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2/users/1a3f15d7da12407f871bd0cc9ee78047/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:38:19.772996 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c56fd-e268-4dfc-a472-93865e135e7b None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:19.787225 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ccd34-aa2c-45d4-879d-a9fbed46a0a0 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:19.822284 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b53a6-3ba3-40d0-b003-29735da71c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:19.822954 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b53a6-3ba3-40d0-b003-29735da71c2f None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:19.823238 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b53a6-3ba3-40d0-b003-29735da71c2f None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:19.823514 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b53a6-3ba3-40d0-b003-29735da71c2f None admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:19.824232 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b53a6-3ba3-40d0-b003-29735da71c2f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:19.825716 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b53a6-3ba3-40d0-b003-29735da71c2f None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:19.853479 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 63/125] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Mar 8 13:38:19 2022] POST /identity/v3/projects => generated 302 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:38:19.855086 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b53a6-3ba3-40d0-b003-29735da71c2f None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:19.890820 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c56fd-e268-4dfc-a472-93865e135e7b None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:19.929136 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664b707-582f-489f-83df-8ba4813ea478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:19.930466 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664b707-582f-489f-83df-8ba4813ea478 None admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:19.931008 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664b707-582f-489f-83df-8ba4813ea478 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:19.931482 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664b707-582f-489f-83df-8ba4813ea478 None admin] PATH_INFO: `/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2/users/1a3f15d7da12407f871bd0cc9ee78047/roles/cbd629eb0cbe4cc7b69cc790228cdfc8` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:19.934779 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664b707-582f-489f-83df-8ba4813ea478 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b15a0b04df24a618ea34b84d6e6ddd2, user_id=1a3f15d7da12407f871bd0cc9ee78047, role_id=cbd629eb0cbe4cc7b69cc790228cdfc8)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:19.936959 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664b707-582f-489f-83df-8ba4813ea478 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:19.959227 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 63/126] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Mar 8 13:38:19 2022] PUT /identity/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2/users/1a3f15d7da12407f871bd0cc9ee78047/roles/cbd629eb0cbe4cc7b69cc790228cdfc8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:38:19.960596 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664b707-582f-489f-83df-8ba4813ea478 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:19.992908 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b53a6-3ba3-40d0-b003-29735da71c2f None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:20.043693 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d47e5-6d7c-4813-b829-459430af00c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:20.045023 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d47e5-6d7c-4813-b829-459430af00c6 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:20.045317 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d47e5-6d7c-4813-b829-459430af00c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:20.046408 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d47e5-6d7c-4813-b829-459430af00c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:20.059049 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d47e5-6d7c-4813-b829-459430af00c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:20.066471 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-720d47e5-6d7c-4813-b829-459430af00c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 13:38:20.067778 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 64/127] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:20.068633 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d47e5-6d7c-4813-b829-459430af00c6 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:20.104130 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664b707-582f-489f-83df-8ba4813ea478 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:20.139610 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d689981-91a6-469d-8bc4-5c2f13bd3549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:20.140522 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d689981-91a6-469d-8bc4-5c2f13bd3549 None admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:20.140803 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d689981-91a6-469d-8bc4-5c2f13bd3549 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:20.141076 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d689981-91a6-469d-8bc4-5c2f13bd3549 None admin] PATH_INFO: `/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2/users/9e52ccf157d64bf8a84675f802b2f178/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:20.144279 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d689981-91a6-469d-8bc4-5c2f13bd3549 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b15a0b04df24a618ea34b84d6e6ddd2, user_id=9e52ccf157d64bf8a84675f802b2f178, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:20.145898 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d689981-91a6-469d-8bc4-5c2f13bd3549 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:20.161050 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 64/128] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Mar 8 13:38:19 2022] PUT /identity/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2/users/9e52ccf157d64bf8a84675f802b2f178/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:38:20.162325 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d689981-91a6-469d-8bc4-5c2f13bd3549 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:20.181882 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d47e5-6d7c-4813-b829-459430af00c6 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:20.225313 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e012a3-e345-42f2-abff-5d1646f9ab0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:20.225960 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e012a3-e345-42f2-abff-5d1646f9ab0a None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:20.226266 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e012a3-e345-42f2-abff-5d1646f9ab0a None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:20.226540 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e012a3-e345-42f2-abff-5d1646f9ab0a None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:20.227359 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e012a3-e345-42f2-abff-5d1646f9ab0a None admin] RBAC: Adding query filter params (name=member) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:20.227674 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e012a3-e345-42f2-abff-5d1646f9ab0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:20.229071 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e012a3-e345-42f2-abff-5d1646f9ab0a None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:20.238430 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 65/129] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:20.244203 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e012a3-e345-42f2-abff-5d1646f9ab0a None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:20.270565 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d689981-91a6-469d-8bc4-5c2f13bd3549 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:20.306657 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c10e36-a706-4d33-8e9d-ba452d5fc6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:20.307390 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c10e36-a706-4d33-8e9d-ba452d5fc6a6 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:20.307677 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c10e36-a706-4d33-8e9d-ba452d5fc6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:20.308045 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c10e36-a706-4d33-8e9d-ba452d5fc6a6 None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:20.308816 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c10e36-a706-4d33-8e9d-ba452d5fc6a6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:20.309126 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c10e36-a706-4d33-8e9d-ba452d5fc6a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:20.310573 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c10e36-a706-4d33-8e9d-ba452d5fc6a6 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:20.319758 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 65/130] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:20.325645 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c10e36-a706-4d33-8e9d-ba452d5fc6a6 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:20.432469 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e012a3-e345-42f2-abff-5d1646f9ab0a None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:20.444010 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c10e36-a706-4d33-8e9d-ba452d5fc6a6 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:20.495930 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f4ead-3e21-42f2-b497-23fb0caf0e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:20.496728 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f4ead-3e21-42f2-b497-23fb0caf0e6d None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:20.497006 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f4ead-3e21-42f2-b497-23fb0caf0e6d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:20.497278 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f4ead-3e21-42f2-b497-23fb0caf0e6d None admin] PATH_INFO: `/v3/users/1a3f15d7da12407f871bd0cc9ee78047` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:20.498877 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f4ead-3e21-42f2-b497-23fb0caf0e6d None admin] RBAC: Authorizing `identity:get_user(user_id=1a3f15d7da12407f871bd0cc9ee78047)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:20.500325 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f4ead-3e21-42f2-b497-23fb0caf0e6d None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:20.502183 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 66/131] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:20 2022] GET /identity/v3/users/1a3f15d7da12407f871bd0cc9ee78047 => generated 275 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:20.503687 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004be058-7782-4195-a305-8de9e79dd894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:20.504569 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004be058-7782-4195-a305-8de9e79dd894 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:20.504902 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004be058-7782-4195-a305-8de9e79dd894 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:20.505176 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004be058-7782-4195-a305-8de9e79dd894 None admin] PATH_INFO: `/v3/users/5e5b7e5b08a74b808c11bd36df8504f5` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:20.509087 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f4ead-3e21-42f2-b497-23fb0caf0e6d None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:20.531917 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004be058-7782-4195-a305-8de9e79dd894 None admin] RBAC: Authorizing `identity:get_user(user_id=5e5b7e5b08a74b808c11bd36df8504f5)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:20.533453 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004be058-7782-4195-a305-8de9e79dd894 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:20.535332 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 66/132] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:20 2022] GET /identity/v3/users/5e5b7e5b08a74b808c11bd36df8504f5 => generated 289 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:20.541808 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004be058-7782-4195-a305-8de9e79dd894 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:20.653767 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004be058-7782-4195-a305-8de9e79dd894 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:20.696456 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bec410-f7b5-4a3b-a163-8c7c1f6cedd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:20.697245 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bec410-f7b5-4a3b-a163-8c7c1f6cedd5 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:20.697548 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bec410-f7b5-4a3b-a163-8c7c1f6cedd5 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:20.697874 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bec410-f7b5-4a3b-a163-8c7c1f6cedd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:20.719650 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f4ead-3e21-42f2-b497-23fb0caf0e6d None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:20.755353 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19f2c9-56ed-491f-a7b9-a032b68a9cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:20.756144 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19f2c9-56ed-491f-a7b9-a032b68a9cf5 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:20.756427 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19f2c9-56ed-491f-a7b9-a032b68a9cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:20.757029 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19f2c9-56ed-491f-a7b9-a032b68a9cf5 None admin] PATH_INFO: `/v3/projects/00cf9e3da9ae4eef8d69312fc48cbaa1` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:20.759835 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19f2c9-56ed-491f-a7b9-a032b68a9cf5 None admin] RBAC: Authorizing `identity:get_project(project_id=00cf9e3da9ae4eef8d69312fc48cbaa1)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:20.760476 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19f2c9-56ed-491f-a7b9-a032b68a9cf5 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:20.762729 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 67/133] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:20 2022] GET /identity/v3/projects/00cf9e3da9ae4eef8d69312fc48cbaa1 => generated 312 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:20.768691 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19f2c9-56ed-491f-a7b9-a032b68a9cf5 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:20.843730 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bec410-f7b5-4a3b-a163-8c7c1f6cedd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:20.845274 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bec410-f7b5-4a3b-a163-8c7c1f6cedd5 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:20.875399 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19f2c9-56ed-491f-a7b9-a032b68a9cf5 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:20.911479 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c6e7d-a25a-4690-896f-46e149f0b549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:20.912835 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c6e7d-a25a-4690-896f-46e149f0b549 None admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:20.913117 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c6e7d-a25a-4690-896f-46e149f0b549 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:20.913417 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85c6e7d-a25a-4690-896f-46e149f0b549 None admin] PATH_INFO: `/v3/projects/00cf9e3da9ae4eef8d69312fc48cbaa1/users/1a3f15d7da12407f871bd0cc9ee78047/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:20.915900 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c6e7d-a25a-4690-896f-46e149f0b549 None admin] RBAC: Authorizing `identity:create_grant(project_id=00cf9e3da9ae4eef8d69312fc48cbaa1, user_id=1a3f15d7da12407f871bd0cc9ee78047, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:20.917338 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85c6e7d-a25a-4690-896f-46e149f0b549 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:20.937745 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 68/134] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Mar 8 13:38:20 2022] PUT /identity/v3/projects/00cf9e3da9ae4eef8d69312fc48cbaa1/users/1a3f15d7da12407f871bd0cc9ee78047/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:38:21.004631 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 67/135] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:38:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 13:38:21.010864 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c6e7d-a25a-4690-896f-46e149f0b549 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:21.117011 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85c6e7d-a25a-4690-896f-46e149f0b549 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:21.152714 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c668a-e86a-44bb-8208-59b85db9bbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:21.154041 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c668a-e86a-44bb-8208-59b85db9bbb0 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:21.154539 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c668a-e86a-44bb-8208-59b85db9bbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:21.155061 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c668a-e86a-44bb-8208-59b85db9bbb0 None admin] PATH_INFO: `/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:21.156548 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c668a-e86a-44bb-8208-59b85db9bbb0 None admin] RBAC: Authorizing `identity:get_project(project_id=4b15a0b04df24a618ea34b84d6e6ddd2)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:21.158220 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c668a-e86a-44bb-8208-59b85db9bbb0 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:21.160482 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 69/136] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:21 2022] GET /identity/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:21.167370 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bec410-f7b5-4a3b-a163-8c7c1f6cedd5 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:21.270085 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bec410-f7b5-4a3b-a163-8c7c1f6cedd5 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:21.305120 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1ca23-a587-40ac-8425-ae486258f7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:21.306610 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1ca23-a587-40ac-8425-ae486258f7ce None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:21.307090 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1ca23-a587-40ac-8425-ae486258f7ce None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:21.307594 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1ca23-a587-40ac-8425-ae486258f7ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:21.308640 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1ca23-a587-40ac-8425-ae486258f7ce None admin] RBAC: Adding query filter params (role.id=c1a7741dcd074a12bea71d598fec4554, scope.project.id=4b15a0b04df24a618ea34b84d6e6ddd2, user.id=5e5b7e5b08a74b808c11bd36df8504f5) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:21.309147 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1ca23-a587-40ac-8425-ae486258f7ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:21.310876 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1ca23-a587-40ac-8425-ae486258f7ce None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:21.317210 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 68/137] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:38:21 2022] GET /identity/v3/role_assignments?user.id=5e5b7e5b08a74b808c11bd36df8504f5&scope.project.id=4b15a0b04df24a618ea34b84d6e6ddd2&role.id=c1a7741dcd074a12bea71d598fec4554 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:22.711292 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9eb3f-1471-4aa8-9bb6-8f6191ebf384 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:22.711788 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9eb3f-1471-4aa8-9bb6-8f6191ebf384 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:22.711859 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9eb3f-1471-4aa8-9bb6-8f6191ebf384 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:22.713824 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 70/138] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:22.719001 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e0284-8d7e-4673-ae9c-9985c43f0028 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:22.719392 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e0284-8d7e-4673-ae9c-9985c43f0028 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:22.719550 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e0284-8d7e-4673-ae9c-9985c43f0028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:22.736399 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-f73e0284-8d7e-4673-ae9c-9985c43f0028 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:22.737629 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-f73e0284-8d7e-4673-ae9c-9985c43f0028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:22.804365 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 69/139] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:22.828392 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9eb3f-1471-4aa8-9bb6-8f6191ebf384 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:22.930404 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9eb3f-1471-4aa8-9bb6-8f6191ebf384 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:22.963862 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6cd43-b041-4583-9763-8f383034d045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:22.964661 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6cd43-b041-4583-9763-8f383034d045 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:22.964946 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6cd43-b041-4583-9763-8f383034d045 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:22.965221 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6cd43-b041-4583-9763-8f383034d045 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:22.966417 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6cd43-b041-4583-9763-8f383034d045 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:22.967868 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff6cd43-b041-4583-9763-8f383034d045 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:22.969688 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 71/140] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:38:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:22.975108 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e0284-8d7e-4673-ae9c-9985c43f0028 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:23.073559 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e0284-8d7e-4673-ae9c-9985c43f0028 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:23.106402 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73541a3-b9a1-4100-90c1-eeb937085f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:23.107076 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73541a3-b9a1-4100-90c1-eeb937085f5a None admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:23.107358 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73541a3-b9a1-4100-90c1-eeb937085f5a None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:23.107632 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73541a3-b9a1-4100-90c1-eeb937085f5a None admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:23.108358 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73541a3-b9a1-4100-90c1-eeb937085f5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:23.109851 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73541a3-b9a1-4100-90c1-eeb937085f5a None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:23.144381 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 70/141] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Mar 8 13:38:22 2022] POST /identity/v3/users => generated 283 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:38:23.276625 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af7d0d-0308-486d-b4de-dd1d37f905ca None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:23.276961 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af7d0d-0308-486d-b4de-dd1d37f905ca None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:23.277176 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af7d0d-0308-486d-b4de-dd1d37f905ca None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:23.279170 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 72/142] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:23.284897 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3b5d3-d69f-418b-aa01-22fecacfb730 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:23.285172 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3b5d3-d69f-418b-aa01-22fecacfb730 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:23.285484 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e3b5d3-d69f-418b-aa01-22fecacfb730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:23.306437 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-97e3b5d3-d69f-418b-aa01-22fecacfb730 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:23.307653 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-97e3b5d3-d69f-418b-aa01-22fecacfb730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:23.384975 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 71/143] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:23.419846 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af7d0d-0308-486d-b4de-dd1d37f905ca None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:23.544834 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af7d0d-0308-486d-b4de-dd1d37f905ca None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:23.578669 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b206755-209c-41d7-9574-a11f8766ee54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:23.579477 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b206755-209c-41d7-9574-a11f8766ee54 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:23.579760 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b206755-209c-41d7-9574-a11f8766ee54 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:23.580034 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b206755-209c-41d7-9574-a11f8766ee54 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:23.590570 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b206755-209c-41d7-9574-a11f8766ee54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:23.597589 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-8b206755-209c-41d7-9574-a11f8766ee54 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 13:38:23.599056 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 73/144] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:23.604710 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3b5d3-d69f-418b-aa01-22fecacfb730 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:23.701291 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e3b5d3-d69f-418b-aa01-22fecacfb730 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:23.735067 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a52176-ca38-448f-b6f2-19fb014edcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:23.735825 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a52176-ca38-448f-b6f2-19fb014edcf4 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:23.736003 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a52176-ca38-448f-b6f2-19fb014edcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:23.736278 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a52176-ca38-448f-b6f2-19fb014edcf4 None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:23.737039 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a52176-ca38-448f-b6f2-19fb014edcf4 None admin] RBAC: Adding query filter params (name=member) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:23.737345 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a52176-ca38-448f-b6f2-19fb014edcf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:23.738846 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a52176-ca38-448f-b6f2-19fb014edcf4 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:23.747990 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 72/145] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:23.753480 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b206755-209c-41d7-9574-a11f8766ee54 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:23.862219 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b206755-209c-41d7-9574-a11f8766ee54 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:23.895947 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e04b4-a23f-4edf-883c-6cc5fa546478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:23.897176 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e04b4-a23f-4edf-883c-6cc5fa546478 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:23.897706 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e04b4-a23f-4edf-883c-6cc5fa546478 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:23.898179 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e04b4-a23f-4edf-883c-6cc5fa546478 None admin] PATH_INFO: `/v3/users/1a3f15d7da12407f871bd0cc9ee78047` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:23.899575 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e04b4-a23f-4edf-883c-6cc5fa546478 None admin] RBAC: Authorizing `identity:get_user(user_id=1a3f15d7da12407f871bd0cc9ee78047)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:23.901211 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e04b4-a23f-4edf-883c-6cc5fa546478 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:23.903076 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 74/146] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:23 2022] GET /identity/v3/users/1a3f15d7da12407f871bd0cc9ee78047 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:23.908813 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a52176-ca38-448f-b6f2-19fb014edcf4 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:23.934794 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9c144-6db4-4fe0-a940-f65214fcf9c1 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:23.935416 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9c144-6db4-4fe0-a940-f65214fcf9c1 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:23.935884 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9c144-6db4-4fe0-a940-f65214fcf9c1 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:23.937879 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 75/147] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:23.943340 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157ba59-cf89-472f-829a-363b7d13b43e None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:23.943902 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157ba59-cf89-472f-829a-363b7d13b43e None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:23.944377 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157ba59-cf89-472f-829a-363b7d13b43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:23.964035 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-9157ba59-cf89-472f-829a-363b7d13b43e None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:23.965554 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-9157ba59-cf89-472f-829a-363b7d13b43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:24.015766 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a52176-ca38-448f-b6f2-19fb014edcf4 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:24.045636 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 76/148] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:38:24.052777 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87be98-1a65-4c7e-b410-8b83266bddf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:24.053663 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87be98-1a65-4c7e-b410-8b83266bddf6 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:24.054080 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87be98-1a65-4c7e-b410-8b83266bddf6 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:24.054507 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87be98-1a65-4c7e-b410-8b83266bddf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:24.133879 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157ba59-cf89-472f-829a-363b7d13b43e None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:24.142025 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87be98-1a65-4c7e-b410-8b83266bddf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:24.143501 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87be98-1a65-4c7e-b410-8b83266bddf6 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:24.240713 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 73/149] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:38:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:24.267069 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87be98-1a65-4c7e-b410-8b83266bddf6 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:24.268053 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157ba59-cf89-472f-829a-363b7d13b43e None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:24.303425 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152ec4a-ec95-48c7-920f-e21091e1ebfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:24.304573 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152ec4a-ec95-48c7-920f-e21091e1ebfb None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:24.305047 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152ec4a-ec95-48c7-920f-e21091e1ebfb None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:24.305572 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152ec4a-ec95-48c7-920f-e21091e1ebfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:24.316824 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152ec4a-ec95-48c7-920f-e21091e1ebfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:24.324073 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-4152ec4a-ec95-48c7-920f-e21091e1ebfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:38:24.325579 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 77/150] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:38:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:38:24.331687 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152ec4a-ec95-48c7-920f-e21091e1ebfb None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:24.387264 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87be98-1a65-4c7e-b410-8b83266bddf6 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:24.430525 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152ec4a-ec95-48c7-920f-e21091e1ebfb None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:24.431370 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c8f55-9054-41c6-9c34-2d3ef2a12d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:24.432335 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c8f55-9054-41c6-9c34-2d3ef2a12d38 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:24.432661 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c8f55-9054-41c6-9c34-2d3ef2a12d38 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:24.432996 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c8f55-9054-41c6-9c34-2d3ef2a12d38 None admin] PATH_INFO: `/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:24.434304 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c8f55-9054-41c6-9c34-2d3ef2a12d38 None admin] RBAC: Authorizing `identity:get_project(project_id=4b15a0b04df24a618ea34b84d6e6ddd2)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:24.435984 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733c8f55-9054-41c6-9c34-2d3ef2a12d38 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:24.438122 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 74/151] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:24 2022] GET /identity/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:24.455663 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c8f55-9054-41c6-9c34-2d3ef2a12d38 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:24.473397 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7060d-b91f-4467-b250-9394f1869fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:24.473397 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7060d-b91f-4467-b250-9394f1869fae None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:24.473397 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7060d-b91f-4467-b250-9394f1869fae None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:24.473397 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7060d-b91f-4467-b250-9394f1869fae None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:24.473802 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff7060d-b91f-4467-b250-9394f1869fae None admin] RBAC: Adding query filter params (name=admin) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:24.473802 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff7060d-b91f-4467-b250-9394f1869fae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:24.474566 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff7060d-b91f-4467-b250-9394f1869fae None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:24.483555 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 78/152] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:24.485226 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22039370-32ba-4e91-9098-74c7918f2633 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:24.485668 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22039370-32ba-4e91-9098-74c7918f2633 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:24.486113 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22039370-32ba-4e91-9098-74c7918f2633 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:24.487963 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 79/153] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:24.494250 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f0f72-f683-44ac-92e3-10863afd63a5 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:24.494795 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f0f72-f683-44ac-92e3-10863afd63a5 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:24.495264 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f0f72-f683-44ac-92e3-10863afd63a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:24.514401 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-b60f0f72-f683-44ac-92e3-10863afd63a5 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:24.515936 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-b60f0f72-f683-44ac-92e3-10863afd63a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:24.584920 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 80/154] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:24.586190 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f0f72-f683-44ac-92e3-10863afd63a5 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:24.604107 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c8f55-9054-41c6-9c34-2d3ef2a12d38 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:24.643372 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1389dd-d897-4ece-b028-6b622f7bae6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:24.644361 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1389dd-d897-4ece-b028-6b622f7bae6d None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:24.644931 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1389dd-d897-4ece-b028-6b622f7bae6d None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:24.645446 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1389dd-d897-4ece-b028-6b622f7bae6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:24.646478 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1389dd-d897-4ece-b028-6b622f7bae6d None admin] RBAC: Adding query filter params (role.id=0010e8da2d4b4bb8af05894096d2fc92, scope.project.id=4b15a0b04df24a618ea34b84d6e6ddd2, user.id=1a3f15d7da12407f871bd0cc9ee78047) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:24.647002 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1389dd-d897-4ece-b028-6b622f7bae6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:24.648648 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1389dd-d897-4ece-b028-6b622f7bae6d None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:24.655018 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 75/155] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:38:24 2022] GET /identity/v3/role_assignments?user.id=1a3f15d7da12407f871bd0cc9ee78047&scope.project.id=4b15a0b04df24a618ea34b84d6e6ddd2&role.id=0010e8da2d4b4bb8af05894096d2fc92 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:24.656133 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1389dd-d897-4ece-b028-6b622f7bae6d None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:24.684447 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f0f72-f683-44ac-92e3-10863afd63a5 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:24.720650 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225fe87a-782c-4b2a-8a61-bb345d8a9fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:24.721822 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fe87a-782c-4b2a-8a61-bb345d8a9fe4 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:24.722233 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fe87a-782c-4b2a-8a61-bb345d8a9fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:24.722633 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225fe87a-782c-4b2a-8a61-bb345d8a9fe4 None admin] PATH_INFO: `/v3/users/9e52ccf157d64bf8a84675f802b2f178` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:24.724023 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225fe87a-782c-4b2a-8a61-bb345d8a9fe4 None admin] RBAC: Authorizing `identity:get_user(user_id=9e52ccf157d64bf8a84675f802b2f178)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:24.725703 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225fe87a-782c-4b2a-8a61-bb345d8a9fe4 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:24.727525 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 81/156] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:24 2022] GET /identity/v3/users/9e52ccf157d64bf8a84675f802b2f178 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:24.733114 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225fe87a-782c-4b2a-8a61-bb345d8a9fe4 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:24.757434 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1389dd-d897-4ece-b028-6b622f7bae6d None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:24.794183 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca1ca2-596c-40f1-8a68-58c1fb727a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:24.795529 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca1ca2-596c-40f1-8a68-58c1fb727a14 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:24.795989 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca1ca2-596c-40f1-8a68-58c1fb727a14 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:24.796442 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca1ca2-596c-40f1-8a68-58c1fb727a14 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:24.807390 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca1ca2-596c-40f1-8a68-58c1fb727a14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:24.815037 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-1eca1ca2-596c-40f1-8a68-58c1fb727a14 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 13:38:24.817484 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 76/157] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Mar 8 13:38:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:24.823861 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca1ca2-596c-40f1-8a68-58c1fb727a14 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:24.838770 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225fe87a-782c-4b2a-8a61-bb345d8a9fe4 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:24.874397 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13850488-aab1-494b-9761-807bc289781b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:24.875332 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13850488-aab1-494b-9761-807bc289781b None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:24.875759 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13850488-aab1-494b-9761-807bc289781b None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:24.876170 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13850488-aab1-494b-9761-807bc289781b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:24.932489 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca1ca2-596c-40f1-8a68-58c1fb727a14 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:24.945397 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13850488-aab1-494b-9761-807bc289781b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:24.947116 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13850488-aab1-494b-9761-807bc289781b None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:24.966940 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19c10e-b328-4b25-af9b-8c1ac6cd10ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:24.967976 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19c10e-b328-4b25-af9b-8c1ac6cd10ac None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:24.968478 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19c10e-b328-4b25-af9b-8c1ac6cd10ac None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:24.968934 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19c10e-b328-4b25-af9b-8c1ac6cd10ac None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:24.969915 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19c10e-b328-4b25-af9b-8c1ac6cd10ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:24.970406 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19c10e-b328-4b25-af9b-8c1ac6cd10ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:24.971998 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19c10e-b328-4b25-af9b-8c1ac6cd10ac None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:24.981133 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 77/158] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:38:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:24.982852 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37c139-2934-451e-9147-e78220b0945c None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:24.986009 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37c139-2934-451e-9147-e78220b0945c None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:24.986515 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37c139-2934-451e-9147-e78220b0945c None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:24.988626 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 78/159] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:24.990128 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd3900-6123-4083-a3e9-3cbe65db7606 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:24.990599 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd3900-6123-4083-a3e9-3cbe65db7606 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:24.991079 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd3900-6123-4083-a3e9-3cbe65db7606 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:24.992848 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 79/160] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:24.996529 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58c720-3a5c-401b-97b9-357aa6b58395 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:24.997323 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58c720-3a5c-401b-97b9-357aa6b58395 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:24.997803 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c58c720-3a5c-401b-97b9-357aa6b58395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:25.014902 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-5c58c720-3a5c-401b-97b9-357aa6b58395 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:25.016392 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-5c58c720-3a5c-401b-97b9-357aa6b58395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:25.047581 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 82/161] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:38:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 13:38:25.048666 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13850488-aab1-494b-9761-807bc289781b None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:25.084453 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 80/162] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:25.085926 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a0b9a-9f1f-41e6-a276-3d7cf5e202e3 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:25.086307 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a0b9a-9f1f-41e6-a276-3d7cf5e202e3 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:25.086674 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a0b9a-9f1f-41e6-a276-3d7cf5e202e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:25.114676 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-127a0b9a-9f1f-41e6-a276-3d7cf5e202e3 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:25.116018 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-127a0b9a-9f1f-41e6-a276-3d7cf5e202e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:25.149745 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13850488-aab1-494b-9761-807bc289781b None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:25.184888 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d20661-dc9e-4194-bf2a-c6ecbebc3e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:25.186053 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d20661-dc9e-4194-bf2a-c6ecbebc3e6a None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:25.186468 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d20661-dc9e-4194-bf2a-c6ecbebc3e6a None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:25.186897 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d20661-dc9e-4194-bf2a-c6ecbebc3e6a None admin] PATH_INFO: `/v3/users/1a3f15d7da12407f871bd0cc9ee78047` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:25.188303 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d20661-dc9e-4194-bf2a-c6ecbebc3e6a None admin] RBAC: Authorizing `identity:get_user(user_id=1a3f15d7da12407f871bd0cc9ee78047)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:25.189941 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d20661-dc9e-4194-bf2a-c6ecbebc3e6a None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:25.191818 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 83/163] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:25 2022] GET /identity/v3/users/1a3f15d7da12407f871bd0cc9ee78047 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:25.192767 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d20661-dc9e-4194-bf2a-c6ecbebc3e6a None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:25.265482 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 81/164] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:25.266273 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a0b9a-9f1f-41e6-a276-3d7cf5e202e3 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:25.290873 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d20661-dc9e-4194-bf2a-c6ecbebc3e6a None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:25.324625 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f8be6-5153-49ea-b926-2abd3d464097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:25.325761 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f8be6-5153-49ea-b926-2abd3d464097 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:25.326174 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f8be6-5153-49ea-b926-2abd3d464097 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:25.326605 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f8be6-5153-49ea-b926-2abd3d464097 None admin] PATH_INFO: `/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:25.327962 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f8be6-5153-49ea-b926-2abd3d464097 None admin] RBAC: Authorizing `identity:get_project(project_id=4b15a0b04df24a618ea34b84d6e6ddd2)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:25.329608 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f8be6-5153-49ea-b926-2abd3d464097 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:25.331516 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 84/165] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:25 2022] GET /identity/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:25.332478 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f8be6-5153-49ea-b926-2abd3d464097 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:25.429230 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f8be6-5153-49ea-b926-2abd3d464097 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:25.462515 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1c318-26a6-4aba-8c90-6b4fa4834377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:25.463402 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1c318-26a6-4aba-8c90-6b4fa4834377 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:25.463818 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1c318-26a6-4aba-8c90-6b4fa4834377 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:25.464233 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1c318-26a6-4aba-8c90-6b4fa4834377 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:25.485097 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a0b9a-9f1f-41e6-a276-3d7cf5e202e3 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:25.534495 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1c318-26a6-4aba-8c90-6b4fa4834377 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:25.536221 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1c318-26a6-4aba-8c90-6b4fa4834377 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:25.566945 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101dca8a-181e-4e9a-8705-e46985a4f10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:25.567753 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dca8a-181e-4e9a-8705-e46985a4f10e None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:25.568032 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dca8a-181e-4e9a-8705-e46985a4f10e None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:25.568305 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dca8a-181e-4e9a-8705-e46985a4f10e None admin] PATH_INFO: `/v3/roles/member` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:25.602209 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101dca8a-181e-4e9a-8705-e46985a4f10e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:25.609147 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-101dca8a-181e-4e9a-8705-e46985a4f10e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 13:38:25.610979 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 82/166] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:25.611941 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101dca8a-181e-4e9a-8705-e46985a4f10e None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:25.632411 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 85/167] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:38:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:25.633555 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1c318-26a6-4aba-8c90-6b4fa4834377 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:25.755048 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1c318-26a6-4aba-8c90-6b4fa4834377 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:25.791978 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48730e7f-f986-4b8b-937d-477a66c5ea0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:25.792908 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48730e7f-f986-4b8b-937d-477a66c5ea0d None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:25.793375 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48730e7f-f986-4b8b-937d-477a66c5ea0d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:25.793842 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48730e7f-f986-4b8b-937d-477a66c5ea0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:25.794854 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48730e7f-f986-4b8b-937d-477a66c5ea0d None admin] RBAC: Adding query filter params (role.id=fc021ed5870a44f5a0f0b8fff994d6f0, scope.project.id=4b15a0b04df24a618ea34b84d6e6ddd2, user.id=9e52ccf157d64bf8a84675f802b2f178) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:25.795341 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48730e7f-f986-4b8b-937d-477a66c5ea0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:25.796927 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48730e7f-f986-4b8b-937d-477a66c5ea0d None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:25.803697 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 86/168] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:38:25 2022] GET /identity/v3/role_assignments?user.id=9e52ccf157d64bf8a84675f802b2f178&scope.project.id=4b15a0b04df24a618ea34b84d6e6ddd2&role.id=fc021ed5870a44f5a0f0b8fff994d6f0 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:25.804677 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48730e7f-f986-4b8b-937d-477a66c5ea0d None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:25.843668 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101dca8a-181e-4e9a-8705-e46985a4f10e None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:25.918028 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48730e7f-f986-4b8b-937d-477a66c5ea0d None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:25.937529 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cfe754-414a-48c6-9fc1-72698fa1932b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:25.938453 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfe754-414a-48c6-9fc1-72698fa1932b None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:25.938777 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfe754-414a-48c6-9fc1-72698fa1932b None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:25.939123 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfe754-414a-48c6-9fc1-72698fa1932b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:25.962983 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cfe754-414a-48c6-9fc1-72698fa1932b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:25.963896 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0f9c6-aaee-4cd1-a486-210eec8f4751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:25.964821 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0f9c6-aaee-4cd1-a486-210eec8f4751 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:25.965265 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0f9c6-aaee-4cd1-a486-210eec8f4751 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:25.965757 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0f9c6-aaee-4cd1-a486-210eec8f4751 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:25.966684 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0f9c6-aaee-4cd1-a486-210eec8f4751 None admin] RBAC: Adding query filter params (name=member) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:25.973992 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-b9cfe754-414a-48c6-9fc1-72698fa1932b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 13:38:25.974559 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0f9c6-aaee-4cd1-a486-210eec8f4751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:25.976132 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0f9c6-aaee-4cd1-a486-210eec8f4751 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:25.983667 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 83/169] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:25.987107 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 87/170] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:25.988155 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cfe754-414a-48c6-9fc1-72698fa1932b None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:25.992785 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0f9c6-aaee-4cd1-a486-210eec8f4751 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:26.102158 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0f9c6-aaee-4cd1-a486-210eec8f4751 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:26.140226 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378ce38-fde3-41c3-a2e1-4462bf199cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:26.141321 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378ce38-fde3-41c3-a2e1-4462bf199cd4 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:26.141945 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378ce38-fde3-41c3-a2e1-4462bf199cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:26.142386 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378ce38-fde3-41c3-a2e1-4462bf199cd4 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:26.143649 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378ce38-fde3-41c3-a2e1-4462bf199cd4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:26.144142 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378ce38-fde3-41c3-a2e1-4462bf199cd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:26.145885 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378ce38-fde3-41c3-a2e1-4462bf199cd4 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:26.155783 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 88/171] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:26.157098 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378ce38-fde3-41c3-a2e1-4462bf199cd4 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:26.243689 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cfe754-414a-48c6-9fc1-72698fa1932b None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:26.266901 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378ce38-fde3-41c3-a2e1-4462bf199cd4 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:26.304010 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e4948-d019-48a2-9042-140373219f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:26.305320 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e4948-d019-48a2-9042-140373219f17 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:26.305925 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e4948-d019-48a2-9042-140373219f17 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:26.306367 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e4948-d019-48a2-9042-140373219f17 None admin] PATH_INFO: `/v3/users/1a3f15d7da12407f871bd0cc9ee78047` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:26.308229 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e4948-d019-48a2-9042-140373219f17 None admin] RBAC: Authorizing `identity:get_user(user_id=1a3f15d7da12407f871bd0cc9ee78047)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:26.310012 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e4948-d019-48a2-9042-140373219f17 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:26.311970 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 89/172] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:26 2022] GET /identity/v3/users/1a3f15d7da12407f871bd0cc9ee78047 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:26.312890 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e4948-d019-48a2-9042-140373219f17 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:26.317381 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9ab93-488b-4037-830d-009248bf086c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:26.317381 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9ab93-488b-4037-830d-009248bf086c None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:26.317381 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9ab93-488b-4037-830d-009248bf086c None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:26.317381 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9ab93-488b-4037-830d-009248bf086c None admin] PATH_INFO: `/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:26.317697 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c9ab93-488b-4037-830d-009248bf086c None admin] RBAC: Authorizing `identity:get_project(project_id=4b15a0b04df24a618ea34b84d6e6ddd2)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:26.318762 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c9ab93-488b-4037-830d-009248bf086c None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:26.320616 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 84/173] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:25 2022] GET /identity/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2 => generated 298 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:26.330525 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9ab93-488b-4037-830d-009248bf086c None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:26.426429 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e4948-d019-48a2-9042-140373219f17 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:26.463021 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b0241-18f4-4c6a-9e0f-6fc0e7730f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:26.464193 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b0241-18f4-4c6a-9e0f-6fc0e7730f2d None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:26.464838 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b0241-18f4-4c6a-9e0f-6fc0e7730f2d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:26.465289 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883b0241-18f4-4c6a-9e0f-6fc0e7730f2d None admin] PATH_INFO: `/v3/users/5e5b7e5b08a74b808c11bd36df8504f5` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:26.467145 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b0241-18f4-4c6a-9e0f-6fc0e7730f2d None admin] RBAC: Authorizing `identity:get_user(user_id=5e5b7e5b08a74b808c11bd36df8504f5)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:26.469076 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883b0241-18f4-4c6a-9e0f-6fc0e7730f2d None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:26.471521 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 90/174] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:26 2022] GET /identity/v3/users/5e5b7e5b08a74b808c11bd36df8504f5 => generated 289 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:26.472630 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b0241-18f4-4c6a-9e0f-6fc0e7730f2d None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:26.563508 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9ab93-488b-4037-830d-009248bf086c None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:26.581774 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883b0241-18f4-4c6a-9e0f-6fc0e7730f2d None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:26.618125 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec1c7d-bcae-486c-8dd3-780214dd0841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:26.619411 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec1c7d-bcae-486c-8dd3-780214dd0841 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:26.619870 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec1c7d-bcae-486c-8dd3-780214dd0841 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:26.620444 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec1c7d-bcae-486c-8dd3-780214dd0841 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:26.621596 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec1c7d-bcae-486c-8dd3-780214dd0841 None admin] RBAC: Adding query filter params (role.id=cbd629eb0cbe4cc7b69cc790228cdfc8, scope.project.id=4b15a0b04df24a618ea34b84d6e6ddd2, user.id=1a3f15d7da12407f871bd0cc9ee78047) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:26.622078 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec1c7d-bcae-486c-8dd3-780214dd0841 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:26.624179 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec1c7d-bcae-486c-8dd3-780214dd0841 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:26.628930 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769a9fe-d7b3-4a59-b3a7-243e9b267bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:26.629732 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769a9fe-d7b3-4a59-b3a7-243e9b267bbf None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:26.630084 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769a9fe-d7b3-4a59-b3a7-243e9b267bbf None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:26.630430 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769a9fe-d7b3-4a59-b3a7-243e9b267bbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:26.631602 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 91/175] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:38:26 2022] GET /identity/v3/role_assignments?user.id=1a3f15d7da12407f871bd0cc9ee78047&scope.project.id=4b15a0b04df24a618ea34b84d6e6ddd2&role.id=cbd629eb0cbe4cc7b69cc790228cdfc8 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:26.632624 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec1c7d-bcae-486c-8dd3-780214dd0841 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:26.778683 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769a9fe-d7b3-4a59-b3a7-243e9b267bbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:26.781910 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e769a9fe-d7b3-4a59-b3a7-243e9b267bbf None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:26.843524 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec1c7d-bcae-486c-8dd3-780214dd0841 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:26.919042 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956af599-2d9d-46a1-91ce-cbab239b1055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:26.920140 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 85/176] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:38:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:26.920997 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956af599-2d9d-46a1-91ce-cbab239b1055 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:26.921371 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956af599-2d9d-46a1-91ce-cbab239b1055 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:26.921658 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956af599-2d9d-46a1-91ce-cbab239b1055 None admin] PATH_INFO: `/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:26.925197 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956af599-2d9d-46a1-91ce-cbab239b1055 None admin] RBAC: Authorizing `identity:get_project(project_id=4b15a0b04df24a618ea34b84d6e6ddd2)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:26.925975 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769a9fe-d7b3-4a59-b3a7-243e9b267bbf None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:26.926791 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956af599-2d9d-46a1-91ce-cbab239b1055 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:26.930152 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 92/177] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:26 2022] GET /identity/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2 => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:26.934709 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956af599-2d9d-46a1-91ce-cbab239b1055 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:27.051781 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769a9fe-d7b3-4a59-b3a7-243e9b267bbf None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:27.107902 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51032bb-10b9-43e0-b131-949e5e7af955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:27.109131 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51032bb-10b9-43e0-b131-949e5e7af955 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:27.109623 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51032bb-10b9-43e0-b131-949e5e7af955 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:27.110099 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51032bb-10b9-43e0-b131-949e5e7af955 None admin] PATH_INFO: `/v3/projects/00cf9e3da9ae4eef8d69312fc48cbaa1` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:27.111480 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51032bb-10b9-43e0-b131-949e5e7af955 None admin] RBAC: Authorizing `identity:get_project(project_id=00cf9e3da9ae4eef8d69312fc48cbaa1)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:27.113134 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51032bb-10b9-43e0-b131-949e5e7af955 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:27.115191 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 86/178] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:26 2022] GET /identity/v3/projects/00cf9e3da9ae4eef8d69312fc48cbaa1 => generated 312 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:27.121051 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956af599-2d9d-46a1-91ce-cbab239b1055 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:27.121344 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51032bb-10b9-43e0-b131-949e5e7af955 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:27.164288 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bec805-1684-4b2a-8ebf-92ee64f645ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:27.165766 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bec805-1684-4b2a-8ebf-92ee64f645ea None admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:27.166696 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bec805-1684-4b2a-8ebf-92ee64f645ea None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:27.167310 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bec805-1684-4b2a-8ebf-92ee64f645ea None admin] PATH_INFO: `/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2/users/5e5b7e5b08a74b808c11bd36df8504f5/roles/c1a7741dcd074a12bea71d598fec4554` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:27.169871 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bec805-1684-4b2a-8ebf-92ee64f645ea None admin] RBAC: Authorizing `identity:create_grant(project_id=4b15a0b04df24a618ea34b84d6e6ddd2, user_id=5e5b7e5b08a74b808c11bd36df8504f5, role_id=c1a7741dcd074a12bea71d598fec4554)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:27.171791 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bec805-1684-4b2a-8ebf-92ee64f645ea None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:27.198874 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 93/179] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Mar 8 13:38:26 2022] PUT /identity/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2/users/5e5b7e5b08a74b808c11bd36df8504f5/roles/c1a7741dcd074a12bea71d598fec4554 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:38:27.263849 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51032bb-10b9-43e0-b131-949e5e7af955 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:27.298379 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce30e4-e8ab-48f4-85a2-ebe6af38b287 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:27.298714 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce30e4-e8ab-48f4-85a2-ebe6af38b287 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:27.298934 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce30e4-e8ab-48f4-85a2-ebe6af38b287 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:27.300954 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 94/180] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:38:27.304025 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497415c-612b-4d41-8fe7-2f2a40712005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:27.304662 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497415c-612b-4d41-8fe7-2f2a40712005 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:27.304941 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497415c-612b-4d41-8fe7-2f2a40712005 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:27.305214 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a497415c-612b-4d41-8fe7-2f2a40712005 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:27.306087 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497415c-612b-4d41-8fe7-2f2a40712005 None admin] RBAC: Adding query filter params (role.id=0010e8da2d4b4bb8af05894096d2fc92, scope.project.id=00cf9e3da9ae4eef8d69312fc48cbaa1, user.id=1a3f15d7da12407f871bd0cc9ee78047) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:27.306398 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497415c-612b-4d41-8fe7-2f2a40712005 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:27.307855 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a131f-93ea-4c9b-8dcd-12b02e95e76d None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:27.307977 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a497415c-612b-4d41-8fe7-2f2a40712005 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:27.308446 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a131f-93ea-4c9b-8dcd-12b02e95e76d None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:27.308897 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78a131f-93ea-4c9b-8dcd-12b02e95e76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:27.315010 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 87/181] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:38:27 2022] GET /identity/v3/role_assignments?user.id=1a3f15d7da12407f871bd0cc9ee78047&scope.project.id=00cf9e3da9ae4eef8d69312fc48cbaa1&role.id=0010e8da2d4b4bb8af05894096d2fc92 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:27.338406 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-f78a131f-93ea-4c9b-8dcd-12b02e95e76d None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:27.339625 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f78a131f-93ea-4c9b-8dcd-12b02e95e76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:27.417432 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 95/182] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:27.443806 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497415c-612b-4d41-8fe7-2f2a40712005 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:27.569254 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a497415c-612b-4d41-8fe7-2f2a40712005 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:27.574066 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802113a7-75f7-4285-8d51-1a3e02fc6a86 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:27.574343 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802113a7-75f7-4285-8d51-1a3e02fc6a86 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:27.574610 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802113a7-75f7-4285-8d51-1a3e02fc6a86 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:27.576842 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 96/183] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:38:27.584460 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f79a16-39c9-4928-a93c-4d9266c9f49c None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:27.584951 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f79a16-39c9-4928-a93c-4d9266c9f49c None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:27.585318 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f79a16-39c9-4928-a93c-4d9266c9f49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:27.614040 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-72f79a16-39c9-4928-a93c-4d9266c9f49c None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:27.615002 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90d8d9-ce8f-4d20-bb38-7de9e6578a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:27.615260 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-72f79a16-39c9-4928-a93c-4d9266c9f49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:27.615820 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90d8d9-ce8f-4d20-bb38-7de9e6578a68 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:27.616095 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90d8d9-ce8f-4d20-bb38-7de9e6578a68 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:27.616364 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90d8d9-ce8f-4d20-bb38-7de9e6578a68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:27.632429 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90d8d9-ce8f-4d20-bb38-7de9e6578a68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:27.640717 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-ff90d8d9-ce8f-4d20-bb38-7de9e6578a68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:38:27.642281 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 88/184] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:38:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:27.648172 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90d8d9-ce8f-4d20-bb38-7de9e6578a68 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:27.689488 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 97/185] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:27.714760 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f79a16-39c9-4928-a93c-4d9266c9f49c None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:27.776405 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90d8d9-ce8f-4d20-bb38-7de9e6578a68 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:27.821581 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fe629-fda0-4da3-9fa9-c2d9a1ca5a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:27.822870 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fe629-fda0-4da3-9fa9-c2d9a1ca5a82 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:27.823289 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fe629-fda0-4da3-9fa9-c2d9a1ca5a82 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:27.823673 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0fe629-fda0-4da3-9fa9-c2d9a1ca5a82 None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:27.824689 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fe629-fda0-4da3-9fa9-c2d9a1ca5a82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:27.825543 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fe629-fda0-4da3-9fa9-c2d9a1ca5a82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:27.827543 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0fe629-fda0-4da3-9fa9-c2d9a1ca5a82 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:27.830230 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f79a16-39c9-4928-a93c-4d9266c9f49c None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:27.838629 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 89/186] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:27.844409 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fe629-fda0-4da3-9fa9-c2d9a1ca5a82 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:27.876464 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748cedb-b44c-494f-a361-80316b891ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:27.877502 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748cedb-b44c-494f-a361-80316b891ad7 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:27.878035 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748cedb-b44c-494f-a361-80316b891ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:27.878401 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748cedb-b44c-494f-a361-80316b891ad7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:27.891376 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748cedb-b44c-494f-a361-80316b891ad7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:27.901192 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-f748cedb-b44c-494f-a361-80316b891ad7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 13:38:27.903106 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 98/187] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Mar 8 13:38:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:27.909718 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748cedb-b44c-494f-a361-80316b891ad7 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:27.962725 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0fe629-fda0-4da3-9fa9-c2d9a1ca5a82 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:28.000662 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60b731-d430-4cc2-81e8-1e1aed197474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:28.001913 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60b731-d430-4cc2-81e8-1e1aed197474 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:28.002197 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60b731-d430-4cc2-81e8-1e1aed197474 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:28.002485 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60b731-d430-4cc2-81e8-1e1aed197474 None admin] PATH_INFO: `/v3/users/19cf2aeca31645829cd9e78948413041` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:28.015650 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60b731-d430-4cc2-81e8-1e1aed197474 None admin] RBAC: Authorizing `identity:get_user(user_id=19cf2aeca31645829cd9e78948413041)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:28.017130 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60b731-d430-4cc2-81e8-1e1aed197474 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:28.023496 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 90/188] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:27 2022] GET /identity/v3/users/19cf2aeca31645829cd9e78948413041 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:28.023496 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d7317-56f2-4bc7-a638-1bad2a14b8f2 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:28.023496 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d7317-56f2-4bc7-a638-1bad2a14b8f2 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:28.023496 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d7317-56f2-4bc7-a638-1bad2a14b8f2 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:28.023496 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 91/189] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:28.024335 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d7317-56f2-4bc7-a638-1bad2a14b8f2 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:28.029380 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748cedb-b44c-494f-a361-80316b891ad7 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:28.063843 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f650e-5630-4d43-bb9c-c009355bd0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:28.065148 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f650e-5630-4d43-bb9c-c009355bd0de None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:28.065630 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f650e-5630-4d43-bb9c-c009355bd0de None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:28.066458 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f650e-5630-4d43-bb9c-c009355bd0de None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:28.067378 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f650e-5630-4d43-bb9c-c009355bd0de None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:28.068128 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f650e-5630-4d43-bb9c-c009355bd0de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:28.070124 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f650e-5630-4d43-bb9c-c009355bd0de None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:28.080504 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 99/190] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:38:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:28.081914 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234c950-8759-400e-9c7a-45eafcea3041 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:28.082445 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234c950-8759-400e-9c7a-45eafcea3041 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:28.082903 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234c950-8759-400e-9c7a-45eafcea3041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:28.099677 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-a234c950-8759-400e-9c7a-45eafcea3041 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:28.100853 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-a234c950-8759-400e-9c7a-45eafcea3041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:28.124441 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d7317-56f2-4bc7-a638-1bad2a14b8f2 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:28.157546 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525bdd9-bfbf-40b7-a462-97158aadd9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:28.158190 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525bdd9-bfbf-40b7-a462-97158aadd9b0 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:28.158471 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525bdd9-bfbf-40b7-a462-97158aadd9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:28.158746 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525bdd9-bfbf-40b7-a462-97158aadd9b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:28.169676 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 100/191] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:28.170342 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234c950-8759-400e-9c7a-45eafcea3041 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:28.236188 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2525bdd9-bfbf-40b7-a462-97158aadd9b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:28.237694 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2525bdd9-bfbf-40b7-a462-97158aadd9b0 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:28.267775 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234c950-8759-400e-9c7a-45eafcea3041 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:28.299528 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b237e49-15e5-402d-a87e-5c343539339c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:28.300396 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b237e49-15e5-402d-a87e-5c343539339c None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:28.300676 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b237e49-15e5-402d-a87e-5c343539339c None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:28.300968 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b237e49-15e5-402d-a87e-5c343539339c None admin] PATH_INFO: `/v3/users/19cf2aeca31645829cd9e78948413041` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:28.302189 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b237e49-15e5-402d-a87e-5c343539339c None admin] RBAC: Authorizing `identity:get_user(user_id=19cf2aeca31645829cd9e78948413041)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:28.303615 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b237e49-15e5-402d-a87e-5c343539339c None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:28.309877 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 101/192] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:28 2022] GET /identity/v3/users/19cf2aeca31645829cd9e78948413041 => generated 283 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:28.309877 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b237e49-15e5-402d-a87e-5c343539339c None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:28.334221 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 92/193] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:38:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:28.334823 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525bdd9-bfbf-40b7-a462-97158aadd9b0 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:28.414082 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b237e49-15e5-402d-a87e-5c343539339c None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:28.428310 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525bdd9-bfbf-40b7-a462-97158aadd9b0 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:28.448634 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b882983-f1c7-47ea-9761-9259378e7fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:28.449458 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b882983-f1c7-47ea-9761-9259378e7fea None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:28.449739 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b882983-f1c7-47ea-9761-9259378e7fea None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:28.450013 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b882983-f1c7-47ea-9761-9259378e7fea None admin] PATH_INFO: `/v3/domains/default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:28.451162 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b882983-f1c7-47ea-9761-9259378e7fea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:28.452596 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b882983-f1c7-47ea-9761-9259378e7fea None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:28.454375 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 102/194] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:38:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:28.455129 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b882983-f1c7-47ea-9761-9259378e7fea None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:28.468347 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83265dc-6b7a-43cf-8b76-47b3248a3363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:28.468347 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83265dc-6b7a-43cf-8b76-47b3248a3363 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:28.468347 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83265dc-6b7a-43cf-8b76-47b3248a3363 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:28.468347 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83265dc-6b7a-43cf-8b76-47b3248a3363 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:28.542007 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83265dc-6b7a-43cf-8b76-47b3248a3363 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:28.543503 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83265dc-6b7a-43cf-8b76-47b3248a3363 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:28.554140 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b882983-f1c7-47ea-9761-9259378e7fea None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:28.590554 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131e0ad-1c41-4747-abd2-9c767e3537c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:28.591331 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131e0ad-1c41-4747-abd2-9c767e3537c2 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:28.591603 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131e0ad-1c41-4747-abd2-9c767e3537c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:28.591867 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131e0ad-1c41-4747-abd2-9c767e3537c2 None admin] PATH_INFO: `/v3/projects/cd5e8c45edab4920a609685e45710f9c` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:28.593049 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131e0ad-1c41-4747-abd2-9c767e3537c2 None admin] RBAC: Authorizing `identity:get_project(project_id=cd5e8c45edab4920a609685e45710f9c)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:28.594539 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131e0ad-1c41-4747-abd2-9c767e3537c2 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:28.601112 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 103/195] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:28 2022] GET /identity/v3/projects/cd5e8c45edab4920a609685e45710f9c => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:28.601112 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131e0ad-1c41-4747-abd2-9c767e3537c2 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:28.643297 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 93/196] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:38:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:28.644390 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83265dc-6b7a-43cf-8b76-47b3248a3363 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:28.697328 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131e0ad-1c41-4747-abd2-9c767e3537c2 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:28.729577 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a204d11-7e6a-4b4b-bf12-c3a43389132d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:28.730242 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a204d11-7e6a-4b4b-bf12-c3a43389132d None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:28.730518 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a204d11-7e6a-4b4b-bf12-c3a43389132d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:28.730785 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a204d11-7e6a-4b4b-bf12-c3a43389132d None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:28.731487 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a204d11-7e6a-4b4b-bf12-c3a43389132d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:28.732902 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a204d11-7e6a-4b4b-bf12-c3a43389132d None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:28.737008 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83265dc-6b7a-43cf-8b76-47b3248a3363 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:28.760898 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 104/197] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Mar 8 13:38:28 2022] POST /identity/v3/users => generated 297 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:38:28.760898 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a204d11-7e6a-4b4b-bf12-c3a43389132d None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:28.771431 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87066be5-9b73-4459-9770-372fe648951f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:28.772119 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87066be5-9b73-4459-9770-372fe648951f None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:28.772398 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87066be5-9b73-4459-9770-372fe648951f None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:28.772670 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87066be5-9b73-4459-9770-372fe648951f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:28.773554 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87066be5-9b73-4459-9770-372fe648951f None admin] RBAC: Adding query filter params (role.id=fc021ed5870a44f5a0f0b8fff994d6f0, scope.project.id=cd5e8c45edab4920a609685e45710f9c, user.id=19cf2aeca31645829cd9e78948413041) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:28.773868 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87066be5-9b73-4459-9770-372fe648951f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:28.775371 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87066be5-9b73-4459-9770-372fe648951f None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:28.781969 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 94/198] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:38:28 2022] GET /identity/v3/role_assignments?user.id=19cf2aeca31645829cd9e78948413041&scope.project.id=cd5e8c45edab4920a609685e45710f9c&role.id=fc021ed5870a44f5a0f0b8fff994d6f0 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:28.873701 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a204d11-7e6a-4b4b-bf12-c3a43389132d None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:28.912173 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433ccb03-de91-4f42-953e-09df27922f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:28.913108 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ccb03-de91-4f42-953e-09df27922f2a None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:28.913412 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ccb03-de91-4f42-953e-09df27922f2a None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:28.913690 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433ccb03-de91-4f42-953e-09df27922f2a None admin] PATH_INFO: `/v3/projects/cd5e8c45edab4920a609685e45710f9c` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:28.915368 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ccb03-de91-4f42-953e-09df27922f2a None admin] RBAC: Authorizing `identity:get_project(project_id=cd5e8c45edab4920a609685e45710f9c)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:28.916411 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433ccb03-de91-4f42-953e-09df27922f2a None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:28.918402 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 105/199] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:28 2022] GET /identity/v3/projects/cd5e8c45edab4920a609685e45710f9c => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:28.924429 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87066be5-9b73-4459-9770-372fe648951f None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:29.032573 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87066be5-9b73-4459-9770-372fe648951f None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:29.067618 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba4ec4-f0d4-4e04-b9c9-0ee8a82d97bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:29.068498 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba4ec4-f0d4-4e04-b9c9-0ee8a82d97bd None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:29.068907 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba4ec4-f0d4-4e04-b9c9-0ee8a82d97bd None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:29.069329 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba4ec4-f0d4-4e04-b9c9-0ee8a82d97bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:29.070331 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba4ec4-f0d4-4e04-b9c9-0ee8a82d97bd None admin] RBAC: Adding query filter params (role.id=cbd629eb0cbe4cc7b69cc790228cdfc8, scope.project.id=cd5e8c45edab4920a609685e45710f9c, user.id=19cf2aeca31645829cd9e78948413041) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:29.070774 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba4ec4-f0d4-4e04-b9c9-0ee8a82d97bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:29.072347 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba4ec4-f0d4-4e04-b9c9-0ee8a82d97bd None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:29.078561 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 95/200] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:38:28 2022] GET /identity/v3/role_assignments?user.id=19cf2aeca31645829cd9e78948413041&scope.project.id=cd5e8c45edab4920a609685e45710f9c&role.id=cbd629eb0cbe4cc7b69cc790228cdfc8 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:29.799993 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0572f-9c74-45d1-a01f-8dd17b619650 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:29.801034 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0572f-9c74-45d1-a01f-8dd17b619650 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:29.801633 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a0572f-9c74-45d1-a01f-8dd17b619650 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:29.803722 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 106/201] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:29.809028 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33fcb1-0719-4046-97e3-42a2e98c9fb8 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:29.809551 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33fcb1-0719-4046-97e3-42a2e98c9fb8 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:29.810026 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c33fcb1-0719-4046-97e3-42a2e98c9fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:29.838277 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-7c33fcb1-0719-4046-97e3-42a2e98c9fb8 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:29.839778 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-7c33fcb1-0719-4046-97e3-42a2e98c9fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:29.908627 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 96/202] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:29.943903 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0572f-9c74-45d1-a01f-8dd17b619650 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:30.070148 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a0572f-9c74-45d1-a01f-8dd17b619650 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:30.108410 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17617c69-3146-4d94-be18-8fdd51c03aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:30.109217 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17617c69-3146-4d94-be18-8fdd51c03aa9 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:30.109523 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17617c69-3146-4d94-be18-8fdd51c03aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:30.109794 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17617c69-3146-4d94-be18-8fdd51c03aa9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:30.125782 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17617c69-3146-4d94-be18-8fdd51c03aa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:30.132803 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-17617c69-3146-4d94-be18-8fdd51c03aa9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 13:38:30.134358 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 107/203] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:30.140261 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33fcb1-0719-4046-97e3-42a2e98c9fb8 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:30.262483 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c33fcb1-0719-4046-97e3-42a2e98c9fb8 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:30.296697 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd299974-7a89-48ad-aa9f-f621ca8275f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:30.297707 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd299974-7a89-48ad-aa9f-f621ca8275f4 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:30.298190 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd299974-7a89-48ad-aa9f-f621ca8275f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:30.298661 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd299974-7a89-48ad-aa9f-f621ca8275f4 None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:30.299586 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd299974-7a89-48ad-aa9f-f621ca8275f4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:30.300068 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd299974-7a89-48ad-aa9f-f621ca8275f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:30.301795 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd299974-7a89-48ad-aa9f-f621ca8275f4 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:30.310384 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 97/204] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:30.315997 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17617c69-3146-4d94-be18-8fdd51c03aa9 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:30.460869 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17617c69-3146-4d94-be18-8fdd51c03aa9 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:30.530945 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ff699-33ef-4203-8e48-3a1a72228b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:30.531853 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ff699-33ef-4203-8e48-3a1a72228b45 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:30.532128 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ff699-33ef-4203-8e48-3a1a72228b45 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:30.532396 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ff699-33ef-4203-8e48-3a1a72228b45 None admin] PATH_INFO: `/v3/users/5e5b7e5b08a74b808c11bd36df8504f5` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:30.533641 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ff699-33ef-4203-8e48-3a1a72228b45 None admin] RBAC: Authorizing `identity:get_user(user_id=5e5b7e5b08a74b808c11bd36df8504f5)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:30.535158 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ff699-33ef-4203-8e48-3a1a72228b45 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:30.537413 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 108/205] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:30 2022] GET /identity/v3/users/5e5b7e5b08a74b808c11bd36df8504f5 => generated 289 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:30.546502 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd299974-7a89-48ad-aa9f-f621ca8275f4 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:30.708959 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd299974-7a89-48ad-aa9f-f621ca8275f4 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:30.753958 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc992a-0bed-4ce0-b1f9-65ec6e06a5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:30.754566 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc992a-0bed-4ce0-b1f9-65ec6e06a5ee None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:30.754844 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc992a-0bed-4ce0-b1f9-65ec6e06a5ee None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:30.755116 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc992a-0bed-4ce0-b1f9-65ec6e06a5ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:30.840587 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc992a-0bed-4ce0-b1f9-65ec6e06a5ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:30.842073 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc992a-0bed-4ce0-b1f9-65ec6e06a5ee None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:30.963777 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 98/206] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:38:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:30.968912 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ff699-33ef-4203-8e48-3a1a72228b45 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:31.112010 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ff699-33ef-4203-8e48-3a1a72228b45 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:31.157990 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ee30f-a20f-42e4-a439-ccfdca581e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:31.159144 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ee30f-a20f-42e4-a439-ccfdca581e1d None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:31.159588 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ee30f-a20f-42e4-a439-ccfdca581e1d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:31.160151 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ee30f-a20f-42e4-a439-ccfdca581e1d None admin] PATH_INFO: `/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:31.161858 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ee30f-a20f-42e4-a439-ccfdca581e1d None admin] RBAC: Authorizing `identity:get_project(project_id=4b15a0b04df24a618ea34b84d6e6ddd2)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:31.166767 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ee30f-a20f-42e4-a439-ccfdca581e1d None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:31.168741 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 109/207] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:30 2022] GET /identity/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:31.174549 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc992a-0bed-4ce0-b1f9-65ec6e06a5ee None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:31.336161 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc992a-0bed-4ce0-b1f9-65ec6e06a5ee None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:31.343607 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39f70b-0ce4-4163-8872-ec1269fe2b36 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:31.344217 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39f70b-0ce4-4163-8872-ec1269fe2b36 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:31.344694 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39f70b-0ce4-4163-8872-ec1269fe2b36 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:31.346692 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 110/208] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:38:31.354274 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b46eac-3066-42b8-a9f3-1dd1ed35fc62 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:31.354547 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b46eac-3066-42b8-a9f3-1dd1ed35fc62 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:31.354825 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b46eac-3066-42b8-a9f3-1dd1ed35fc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:31.384337 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-57b46eac-3066-42b8-a9f3-1dd1ed35fc62 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:31.385469 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-57b46eac-3066-42b8-a9f3-1dd1ed35fc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:31.401563 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4a0ec-8a22-4a0e-bc14-90283ec70e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:31.402226 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4a0ec-8a22-4a0e-bc14-90283ec70e97 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:31.402504 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4a0ec-8a22-4a0e-bc14-90283ec70e97 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:31.402783 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4a0ec-8a22-4a0e-bc14-90283ec70e97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:31.403617 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4a0ec-8a22-4a0e-bc14-90283ec70e97 None admin] RBAC: Adding query filter params (role.id=c1a7741dcd074a12bea71d598fec4554, scope.project.id=4b15a0b04df24a618ea34b84d6e6ddd2, user.id=5e5b7e5b08a74b808c11bd36df8504f5) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:31.403924 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4a0ec-8a22-4a0e-bc14-90283ec70e97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:31.405430 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4a0ec-8a22-4a0e-bc14-90283ec70e97 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:31.414995 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 99/209] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:38:31 2022] GET /identity/v3/role_assignments?user.id=5e5b7e5b08a74b808c11bd36df8504f5&scope.project.id=4b15a0b04df24a618ea34b84d6e6ddd2&role.id=c1a7741dcd074a12bea71d598fec4554 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:31.482823 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 111/210] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:38:31.505785 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4a0ec-8a22-4a0e-bc14-90283ec70e97 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:31.643192 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4a0ec-8a22-4a0e-bc14-90283ec70e97 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:31.686051 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48857fb3-1a51-44bf-bbf9-5d58e74d819b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:31.686858 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48857fb3-1a51-44bf-bbf9-5d58e74d819b None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:31.687146 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48857fb3-1a51-44bf-bbf9-5d58e74d819b None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:31.687420 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48857fb3-1a51-44bf-bbf9-5d58e74d819b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:31.702436 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48857fb3-1a51-44bf-bbf9-5d58e74d819b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:31.709660 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-48857fb3-1a51-44bf-bbf9-5d58e74d819b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:38:31.710442 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e75f50-aece-4341-b57e-2783f0b1eada None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:31.710738 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e75f50-aece-4341-b57e-2783f0b1eada None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:31.710994 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e75f50-aece-4341-b57e-2783f0b1eada None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:31.711215 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 100/211] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:38:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:31.712904 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 112/212] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:38:31.716958 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48857fb3-1a51-44bf-bbf9-5d58e74d819b None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:31.723124 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f5a3b-80f5-4a2e-8e92-1dbfa40023d4 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:31.723406 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f5a3b-80f5-4a2e-8e92-1dbfa40023d4 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:31.723677 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f5a3b-80f5-4a2e-8e92-1dbfa40023d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:31.769486 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-886f5a3b-80f5-4a2e-8e92-1dbfa40023d4 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:31.770712 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-886f5a3b-80f5-4a2e-8e92-1dbfa40023d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:31.818599 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48857fb3-1a51-44bf-bbf9-5d58e74d819b None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:31.852953 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b46529-1574-4af4-861e-0273db1a4caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:31.853654 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b46529-1574-4af4-861e-0273db1a4caf None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:31.853936 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b46529-1574-4af4-861e-0273db1a4caf None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:31.854210 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b46529-1574-4af4-861e-0273db1a4caf None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:31.854966 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b46529-1574-4af4-861e-0273db1a4caf None admin] RBAC: Adding query filter params (name=admin) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:31.855273 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b46529-1574-4af4-861e-0273db1a4caf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:31.856677 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b46529-1574-4af4-861e-0273db1a4caf None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:31.865432 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 101/213] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:31.870917 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b46529-1574-4af4-861e-0273db1a4caf None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:31.898128 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 113/214] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:31.923579 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f5a3b-80f5-4a2e-8e92-1dbfa40023d4 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:31.986296 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b46529-1574-4af4-861e-0273db1a4caf None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:32.021250 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083dbbb6-ff2d-44f8-b553-381edbb7b811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:32.022365 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dbbb6-ff2d-44f8-b553-381edbb7b811 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:32.022774 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dbbb6-ff2d-44f8-b553-381edbb7b811 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:32.023176 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083dbbb6-ff2d-44f8-b553-381edbb7b811 None admin] PATH_INFO: `/v3/users/19cf2aeca31645829cd9e78948413041` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:32.024552 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083dbbb6-ff2d-44f8-b553-381edbb7b811 None admin] RBAC: Authorizing `identity:get_user(user_id=19cf2aeca31645829cd9e78948413041)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:32.026076 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083dbbb6-ff2d-44f8-b553-381edbb7b811 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:32.027693 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 102/215] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:31 2022] GET /identity/v3/users/19cf2aeca31645829cd9e78948413041 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:32.028939 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a147fbe-3f67-49ed-85d2-1b62cbf884e4 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:32.029313 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a147fbe-3f67-49ed-85d2-1b62cbf884e4 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:32.029609 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a147fbe-3f67-49ed-85d2-1b62cbf884e4 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:32.031240 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 103/216] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:32.034571 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff516406-ca0c-49a7-8ab9-7cd5d810c945 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:32.034918 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff516406-ca0c-49a7-8ab9-7cd5d810c945 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:32.035193 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff516406-ca0c-49a7-8ab9-7cd5d810c945 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:32.037275 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 104/217] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:32.040239 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff516406-ca0c-49a7-8ab9-7cd5d810c945 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:32.041029 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f5a3b-80f5-4a2e-8e92-1dbfa40023d4 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:32.072945 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46543b11-d080-4270-b6df-52eabf6e8514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:32.073768 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46543b11-d080-4270-b6df-52eabf6e8514 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:32.074050 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46543b11-d080-4270-b6df-52eabf6e8514 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:32.074320 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46543b11-d080-4270-b6df-52eabf6e8514 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:32.083890 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46543b11-d080-4270-b6df-52eabf6e8514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:32.090788 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-46543b11-d080-4270-b6df-52eabf6e8514 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 13:38:32.092014 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 114/218] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:38:32.093132 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c83f1-1f94-438a-a4f0-ba3567a01d5d None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:32.093405 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c83f1-1f94-438a-a4f0-ba3567a01d5d None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:32.093677 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c83f1-1f94-438a-a4f0-ba3567a01d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:32.109250 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-db1c83f1-1f94-438a-a4f0-ba3567a01d5d None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:32.110445 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-db1c83f1-1f94-438a-a4f0-ba3567a01d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:32.136317 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff516406-ca0c-49a7-8ab9-7cd5d810c945 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:32.175116 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 115/219] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:32.176715 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e8129-21fb-41f7-afc1-d1148df1e5ce None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:32.177154 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e8129-21fb-41f7-afc1-d1148df1e5ce None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:32.177616 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e8129-21fb-41f7-afc1-d1148df1e5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:32.197802 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ff8ac-e30c-401c-8b83-eb41e46b1961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:32.199232 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ff8ac-e30c-401c-8b83-eb41e46b1961 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:32.199504 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ff8ac-e30c-401c-8b83-eb41e46b1961 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:32.199782 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ff8ac-e30c-401c-8b83-eb41e46b1961 None admin] PATH_INFO: `/v3/projects/cd5e8c45edab4920a609685e45710f9c` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:32.201076 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ff8ac-e30c-401c-8b83-eb41e46b1961 None admin] RBAC: Authorizing `identity:get_project(project_id=cd5e8c45edab4920a609685e45710f9c)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:32.202614 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243ff8ac-e30c-401c-8b83-eb41e46b1961 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:32.204479 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 105/220] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:32 2022] GET /identity/v3/projects/cd5e8c45edab4920a609685e45710f9c => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:32.205271 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ff8ac-e30c-401c-8b83-eb41e46b1961 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:32.211685 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-bc8e8129-21fb-41f7-afc1-d1148df1e5ce None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:32.212976 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-bc8e8129-21fb-41f7-afc1-d1148df1e5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:32.280229 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 116/221] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:32.281386 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e8129-21fb-41f7-afc1-d1148df1e5ce None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:32.323321 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ff8ac-e30c-401c-8b83-eb41e46b1961 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:32.354674 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6f676-0cbe-4495-ae44-ec6ace4b64c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:32.355341 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6f676-0cbe-4495-ae44-ec6ace4b64c8 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:32.355624 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6f676-0cbe-4495-ae44-ec6ace4b64c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:32.355896 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6f676-0cbe-4495-ae44-ec6ace4b64c8 None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:32.356647 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6f676-0cbe-4495-ae44-ec6ace4b64c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:32.356954 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6f676-0cbe-4495-ae44-ec6ace4b64c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:32.358375 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6f676-0cbe-4495-ae44-ec6ace4b64c8 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:32.366395 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 106/222] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:32.370968 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6f676-0cbe-4495-ae44-ec6ace4b64c8 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:32.383522 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e8129-21fb-41f7-afc1-d1148df1e5ce None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:32.418135 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f59889-62aa-4cd5-be37-a4162f7c28f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:32.418948 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f59889-62aa-4cd5-be37-a4162f7c28f4 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:32.419222 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f59889-62aa-4cd5-be37-a4162f7c28f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:32.419489 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f59889-62aa-4cd5-be37-a4162f7c28f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:32.430116 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f59889-62aa-4cd5-be37-a4162f7c28f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:32.437441 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-46f59889-62aa-4cd5-be37-a4162f7c28f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 13:38:32.438694 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 117/223] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Mar 8 13:38:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:32.445430 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f59889-62aa-4cd5-be37-a4162f7c28f4 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:32.475151 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6f676-0cbe-4495-ae44-ec6ace4b64c8 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:32.506591 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1174a6-4f45-4fd0-8bfa-f8107374f8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:32.507485 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1174a6-4f45-4fd0-8bfa-f8107374f8a5 None admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:32.507755 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1174a6-4f45-4fd0-8bfa-f8107374f8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:32.508019 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1174a6-4f45-4fd0-8bfa-f8107374f8a5 None admin] PATH_INFO: `/v3/projects/cd5e8c45edab4920a609685e45710f9c/users/19cf2aeca31645829cd9e78948413041/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:32.510006 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1174a6-4f45-4fd0-8bfa-f8107374f8a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd5e8c45edab4920a609685e45710f9c, user_id=19cf2aeca31645829cd9e78948413041, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:32.511450 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1174a6-4f45-4fd0-8bfa-f8107374f8a5 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:32.525611 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 107/224] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Mar 8 13:38:32 2022] PUT /identity/v3/projects/cd5e8c45edab4920a609685e45710f9c/users/19cf2aeca31645829cd9e78948413041/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:38:32.526256 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1174a6-4f45-4fd0-8bfa-f8107374f8a5 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:32.541346 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f59889-62aa-4cd5-be37-a4162f7c28f4 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:32.578356 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3c704-ded7-446c-8570-3bb72e9abaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:32.579175 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3c704-ded7-446c-8570-3bb72e9abaac None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:32.579456 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3c704-ded7-446c-8570-3bb72e9abaac None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:32.579730 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3c704-ded7-446c-8570-3bb72e9abaac None admin] PATH_INFO: `/v3/domains/default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:32.581055 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3c704-ded7-446c-8570-3bb72e9abaac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:32.582678 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3c704-ded7-446c-8570-3bb72e9abaac None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:32.589540 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 118/225] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:38:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:32.590539 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3c704-ded7-446c-8570-3bb72e9abaac None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:32.629658 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1174a6-4f45-4fd0-8bfa-f8107374f8a5 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:32.663136 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482ee06-3a73-4800-9ed8-36d6daf9c45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:32.664129 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482ee06-3a73-4800-9ed8-36d6daf9c45b None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:32.664461 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482ee06-3a73-4800-9ed8-36d6daf9c45b None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:32.664794 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482ee06-3a73-4800-9ed8-36d6daf9c45b None admin] PATH_INFO: `/v3/users/e4375a1a3d6f40538fe4ccd35d1e5a8e` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:32.679148 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6482ee06-3a73-4800-9ed8-36d6daf9c45b None admin] RBAC: Authorizing `identity:get_user(user_id=e4375a1a3d6f40538fe4ccd35d1e5a8e)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:32.680815 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6482ee06-3a73-4800-9ed8-36d6daf9c45b None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:32.682581 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 108/226] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:32 2022] GET /identity/v3/users/e4375a1a3d6f40538fe4ccd35d1e5a8e => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:32.687876 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482ee06-3a73-4800-9ed8-36d6daf9c45b None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:32.691152 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3c704-ded7-446c-8570-3bb72e9abaac None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:32.728111 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f1b47-9cf4-4663-8445-d27f0587d4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:32.729017 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f1b47-9cf4-4663-8445-d27f0587d4e5 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:32.729289 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f1b47-9cf4-4663-8445-d27f0587d4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:32.729655 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f1b47-9cf4-4663-8445-d27f0587d4e5 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:32.730402 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f1b47-9cf4-4663-8445-d27f0587d4e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:32.730700 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f1b47-9cf4-4663-8445-d27f0587d4e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:32.732087 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f1b47-9cf4-4663-8445-d27f0587d4e5 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:32.740511 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 119/227] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:38:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:32.742125 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f1b47-9cf4-4663-8445-d27f0587d4e5 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:32.785184 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482ee06-3a73-4800-9ed8-36d6daf9c45b None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:32.819151 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67c23a-efa4-44c3-81c3-62ad9ef0b515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:32.819818 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67c23a-efa4-44c3-81c3-62ad9ef0b515 None admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:32.820094 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67c23a-efa4-44c3-81c3-62ad9ef0b515 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:32.820363 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67c23a-efa4-44c3-81c3-62ad9ef0b515 None admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:32.821072 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67c23a-efa4-44c3-81c3-62ad9ef0b515 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:32.822562 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be67c23a-efa4-44c3-81c3-62ad9ef0b515 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:32.836632 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f1b47-9cf4-4663-8445-d27f0587d4e5 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:32.843153 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 109/228] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Mar 8 13:38:32 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:38:32.856574 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67c23a-efa4-44c3-81c3-62ad9ef0b515 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:32.872272 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5a5ef-2f03-4724-b75a-47af703bd9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:32.872983 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5a5ef-2f03-4724-b75a-47af703bd9a7 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:32.873260 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5a5ef-2f03-4724-b75a-47af703bd9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:32.873608 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5a5ef-2f03-4724-b75a-47af703bd9a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:32.945732 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5a5ef-2f03-4724-b75a-47af703bd9a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:32.947465 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5a5ef-2f03-4724-b75a-47af703bd9a7 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:32.966225 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67c23a-efa4-44c3-81c3-62ad9ef0b515 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:33.001767 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2b606-3596-4329-94e9-cd1f24a40ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:33.003081 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2b606-3596-4329-94e9-cd1f24a40ffb None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:33.003641 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2b606-3596-4329-94e9-cd1f24a40ffb None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:33.004141 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2b606-3596-4329-94e9-cd1f24a40ffb None admin] PATH_INFO: `/v3/users/19cf2aeca31645829cd9e78948413041` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:33.005725 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2b606-3596-4329-94e9-cd1f24a40ffb None admin] RBAC: Authorizing `identity:get_user(user_id=19cf2aeca31645829cd9e78948413041)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:33.007446 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2b606-3596-4329-94e9-cd1f24a40ffb None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:33.009388 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 110/229] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:32 2022] GET /identity/v3/users/19cf2aeca31645829cd9e78948413041 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:33.015163 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2b606-3596-4329-94e9-cd1f24a40ffb None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:33.071970 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 120/230] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:38:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:33.078369 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5a5ef-2f03-4724-b75a-47af703bd9a7 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:33.143419 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2b606-3596-4329-94e9-cd1f24a40ffb None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:33.186210 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67505d-9b63-4ed3-993b-522bfff3d5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:33.187090 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67505d-9b63-4ed3-993b-522bfff3d5d2 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:33.187372 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67505d-9b63-4ed3-993b-522bfff3d5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:33.187650 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67505d-9b63-4ed3-993b-522bfff3d5d2 None admin] PATH_INFO: `/v3/projects/cd5e8c45edab4920a609685e45710f9c` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:33.189559 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67505d-9b63-4ed3-993b-522bfff3d5d2 None admin] RBAC: Authorizing `identity:get_project(project_id=cd5e8c45edab4920a609685e45710f9c)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:33.191411 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67505d-9b63-4ed3-993b-522bfff3d5d2 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:33.193347 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 111/231] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:33 2022] GET /identity/v3/projects/cd5e8c45edab4920a609685e45710f9c => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:33.199617 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67505d-9b63-4ed3-993b-522bfff3d5d2 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:33.207171 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5a5ef-2f03-4724-b75a-47af703bd9a7 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:33.245900 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612e6f2-b5fc-47e9-941c-9407834a6836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:33.247109 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612e6f2-b5fc-47e9-941c-9407834a6836 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:33.247585 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612e6f2-b5fc-47e9-941c-9407834a6836 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:33.248064 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612e6f2-b5fc-47e9-941c-9407834a6836 None admin] PATH_INFO: `/v3/projects/cd5e8c45edab4920a609685e45710f9c` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:33.249465 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612e6f2-b5fc-47e9-941c-9407834a6836 None admin] RBAC: Authorizing `identity:get_project(project_id=cd5e8c45edab4920a609685e45710f9c)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:33.251094 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612e6f2-b5fc-47e9-941c-9407834a6836 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:33.252978 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 121/232] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:33 2022] GET /identity/v3/projects/cd5e8c45edab4920a609685e45710f9c => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:33.258782 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612e6f2-b5fc-47e9-941c-9407834a6836 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:33.305707 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67505d-9b63-4ed3-993b-522bfff3d5d2 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:33.338276 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3516e-f4de-47fd-b68a-89a96f594e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:33.339165 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3516e-f4de-47fd-b68a-89a96f594e63 None admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:33.339436 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3516e-f4de-47fd-b68a-89a96f594e63 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:33.339710 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3516e-f4de-47fd-b68a-89a96f594e63 None admin] PATH_INFO: `/v3/projects/cd5e8c45edab4920a609685e45710f9c/users/19cf2aeca31645829cd9e78948413041/roles/cbd629eb0cbe4cc7b69cc790228cdfc8` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:33.341953 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c3516e-f4de-47fd-b68a-89a96f594e63 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd5e8c45edab4920a609685e45710f9c, user_id=19cf2aeca31645829cd9e78948413041, role_id=cbd629eb0cbe4cc7b69cc790228cdfc8)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:33.343400 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c3516e-f4de-47fd-b68a-89a96f594e63 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:33.363168 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 112/233] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Mar 8 13:38:33 2022] PUT /identity/v3/projects/cd5e8c45edab4920a609685e45710f9c/users/19cf2aeca31645829cd9e78948413041/roles/cbd629eb0cbe4cc7b69cc790228cdfc8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:38:33.378456 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612e6f2-b5fc-47e9-941c-9407834a6836 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:33.437920 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f9fec-5833-4bf1-b950-faf9d59dc5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:33.438985 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f9fec-5833-4bf1-b950-faf9d59dc5e6 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:33.439450 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f9fec-5833-4bf1-b950-faf9d59dc5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:33.439899 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f9fec-5833-4bf1-b950-faf9d59dc5e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:33.441057 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f9fec-5833-4bf1-b950-faf9d59dc5e6 None admin] RBAC: Adding query filter params (role.id=0010e8da2d4b4bb8af05894096d2fc92, scope.project.id=cd5e8c45edab4920a609685e45710f9c, user.id=e4375a1a3d6f40538fe4ccd35d1e5a8e) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:33.441661 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f9fec-5833-4bf1-b950-faf9d59dc5e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:33.443420 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f9fec-5833-4bf1-b950-faf9d59dc5e6 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:33.454520 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 122/234] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:38:33 2022] GET /identity/v3/role_assignments?user.id=e4375a1a3d6f40538fe4ccd35d1e5a8e&scope.project.id=cd5e8c45edab4920a609685e45710f9c&role.id=0010e8da2d4b4bb8af05894096d2fc92 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:35.234943 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58055b38-e29d-428f-803d-0ab9a623e61f None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:35.235479 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58055b38-e29d-428f-803d-0ab9a623e61f None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:35.235479 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58055b38-e29d-428f-803d-0ab9a623e61f None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:35.237654 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 113/235] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:35.243048 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81bcfb-d53e-46af-b54b-a6602c1dbff6 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:35.243446 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81bcfb-d53e-46af-b54b-a6602c1dbff6 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:35.243641 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81bcfb-d53e-46af-b54b-a6602c1dbff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:35.265254 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-4b81bcfb-d53e-46af-b54b-a6602c1dbff6 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:35.266446 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-4b81bcfb-d53e-46af-b54b-a6602c1dbff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:35.348632 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 123/236] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:35.390838 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58055b38-e29d-428f-803d-0ab9a623e61f None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:35.431817 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09757513-c1b2-446f-8e5c-ca12ef0c25df None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:35.432118 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09757513-c1b2-446f-8e5c-ca12ef0c25df None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:35.432365 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09757513-c1b2-446f-8e5c-ca12ef0c25df None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:35.434364 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 124/237] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:38:35.439226 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de4c7c-a800-4cd7-b709-c4516406238e None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:35.439516 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de4c7c-a800-4cd7-b709-c4516406238e None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:35.439799 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de4c7c-a800-4cd7-b709-c4516406238e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:35.462350 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-c8de4c7c-a800-4cd7-b709-c4516406238e None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:35.463542 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-c8de4c7c-a800-4cd7-b709-c4516406238e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:35.559058 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58055b38-e29d-428f-803d-0ab9a623e61f None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:35.578144 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 125/238] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:38:35.607366 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ebdf1-5b57-4912-975e-3b1a9f068f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:35.608252 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ebdf1-5b57-4912-975e-3b1a9f068f0b None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:35.608531 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ebdf1-5b57-4912-975e-3b1a9f068f0b None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:35.608803 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ebdf1-5b57-4912-975e-3b1a9f068f0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:35.609923 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de4c7c-a800-4cd7-b709-c4516406238e None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:35.633724 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ebdf1-5b57-4912-975e-3b1a9f068f0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:35.640558 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-567ebdf1-5b57-4912-975e-3b1a9f068f0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:38:35.641814 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 114/239] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:38:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:35.647690 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ebdf1-5b57-4912-975e-3b1a9f068f0b None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:35.719823 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de4c7c-a800-4cd7-b709-c4516406238e None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:35.767016 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4be39-79ea-4a55-8921-76ff8f03605d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:35.768168 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4be39-79ea-4a55-8921-76ff8f03605d None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:35.768633 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4be39-79ea-4a55-8921-76ff8f03605d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:35.769208 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4be39-79ea-4a55-8921-76ff8f03605d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:35.793125 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4be39-79ea-4a55-8921-76ff8f03605d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:35.805455 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-e0a4be39-79ea-4a55-8921-76ff8f03605d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 13:38:35.810434 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 126/240] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:35.816328 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4be39-79ea-4a55-8921-76ff8f03605d None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:35.861215 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ebdf1-5b57-4912-975e-3b1a9f068f0b None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:35.943860 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc800c7-9f03-4634-a522-57b6ab6c14ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:35.944311 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc800c7-9f03-4634-a522-57b6ab6c14ac None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:35.944595 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc800c7-9f03-4634-a522-57b6ab6c14ac None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:35.944871 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc800c7-9f03-4634-a522-57b6ab6c14ac None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:35.945719 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc800c7-9f03-4634-a522-57b6ab6c14ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:35.945971 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc800c7-9f03-4634-a522-57b6ab6c14ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:35.947377 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc800c7-9f03-4634-a522-57b6ab6c14ac None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:35.950883 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4be39-79ea-4a55-8921-76ff8f03605d None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:35.968558 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 115/241] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:35.974211 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc800c7-9f03-4634-a522-57b6ab6c14ac None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:35.992312 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e19fe-a84f-460d-a427-33ef4e5335da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:35.993307 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e19fe-a84f-460d-a427-33ef4e5335da None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:35.993835 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e19fe-a84f-460d-a427-33ef4e5335da None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:35.994287 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e19fe-a84f-460d-a427-33ef4e5335da None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:35.995241 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e19fe-a84f-460d-a427-33ef4e5335da None admin] RBAC: Adding query filter params (name=reader) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:35.995732 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e19fe-a84f-460d-a427-33ef4e5335da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:35.997793 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e19fe-a84f-460d-a427-33ef4e5335da None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:36.015650 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 127/242] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:36.021749 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e19fe-a84f-460d-a427-33ef4e5335da None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:36.138710 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e19fe-a84f-460d-a427-33ef4e5335da None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:36.141083 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc800c7-9f03-4634-a522-57b6ab6c14ac None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:36.173883 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e591f-e72d-4a8a-86cd-f60d66b16e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:36.174915 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e591f-e72d-4a8a-86cd-f60d66b16e05 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:36.175307 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e591f-e72d-4a8a-86cd-f60d66b16e05 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:36.175672 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e591f-e72d-4a8a-86cd-f60d66b16e05 None admin] PATH_INFO: `/v3/users/19cf2aeca31645829cd9e78948413041` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:36.176956 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e591f-e72d-4a8a-86cd-f60d66b16e05 None admin] RBAC: Authorizing `identity:get_user(user_id=19cf2aeca31645829cd9e78948413041)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:36.178704 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e591f-e72d-4a8a-86cd-f60d66b16e05 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:36.179051 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb231e6b-b174-482f-8ca0-789a4689d64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:36.180070 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb231e6b-b174-482f-8ca0-789a4689d64c None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:36.180495 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb231e6b-b174-482f-8ca0-789a4689d64c None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:36.180890 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb231e6b-b174-482f-8ca0-789a4689d64c None admin] PATH_INFO: `/v3/users/28f1ebbfa1aa4cdeba5e484248de0035` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:36.185633 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 116/243] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:35 2022] GET /identity/v3/users/19cf2aeca31645829cd9e78948413041 => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:36.187110 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebc741-48fd-430c-a261-cfea6996ef56 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:36.187491 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebc741-48fd-430c-a261-cfea6996ef56 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:36.187908 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ebc741-48fd-430c-a261-cfea6996ef56 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:36.193576 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 117/244] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:36.194982 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975010d-8be1-41b4-9f50-0d7fce316a1f None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:36.195266 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975010d-8be1-41b4-9f50-0d7fce316a1f None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:36.195537 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975010d-8be1-41b4-9f50-0d7fce316a1f None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:36.197301 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 118/245] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:36.198318 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb231e6b-b174-482f-8ca0-789a4689d64c None admin] RBAC: Authorizing `identity:get_user(user_id=28f1ebbfa1aa4cdeba5e484248de0035)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:36.198433 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975010d-8be1-41b4-9f50-0d7fce316a1f None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:36.198991 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb231e6b-b174-482f-8ca0-789a4689d64c None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:36.200673 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 128/246] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:36 2022] GET /identity/v3/users/28f1ebbfa1aa4cdeba5e484248de0035 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:36.201863 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124a03f-965a-487f-bef0-8f77a2515628 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:36.202146 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124a03f-965a-487f-bef0-8f77a2515628 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:36.202412 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124a03f-965a-487f-bef0-8f77a2515628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:36.218225 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-2124a03f-965a-487f-bef0-8f77a2515628 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:36.219371 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-2124a03f-965a-487f-bef0-8f77a2515628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:36.289478 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 129/247] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:36.289478 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88495f3c-3216-440d-9a4d-a92e3911bfe2 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:36.289478 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88495f3c-3216-440d-9a4d-a92e3911bfe2 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:36.289478 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88495f3c-3216-440d-9a4d-a92e3911bfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:36.305396 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975010d-8be1-41b4-9f50-0d7fce316a1f None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:36.312268 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-88495f3c-3216-440d-9a4d-a92e3911bfe2 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:36.313459 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-88495f3c-3216-440d-9a4d-a92e3911bfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:36.341013 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6f7c3-3cbd-4399-9784-6bdbb2ba3f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:36.341690 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6f7c3-3cbd-4399-9784-6bdbb2ba3f9c None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:36.341964 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6f7c3-3cbd-4399-9784-6bdbb2ba3f9c None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:36.342234 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b6f7c3-3cbd-4399-9784-6bdbb2ba3f9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:36.379348 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 130/248] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:36.381658 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88495f3c-3216-440d-9a4d-a92e3911bfe2 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:36.414785 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6f7c3-3cbd-4399-9784-6bdbb2ba3f9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:36.416291 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b6f7c3-3cbd-4399-9784-6bdbb2ba3f9c None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:36.473132 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88495f3c-3216-440d-9a4d-a92e3911bfe2 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:36.504787 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89d0c0-8374-4f91-9c65-dc970019878c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:36.505456 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89d0c0-8374-4f91-9c65-dc970019878c None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:36.505732 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89d0c0-8374-4f91-9c65-dc970019878c None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:36.505996 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89d0c0-8374-4f91-9c65-dc970019878c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:36.511252 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 119/249] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:38:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:36.512081 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6f7c3-3cbd-4399-9784-6bdbb2ba3f9c None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:36.569385 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89d0c0-8374-4f91-9c65-dc970019878c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:36.570750 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89d0c0-8374-4f91-9c65-dc970019878c None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:36.603151 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b6f7c3-3cbd-4399-9784-6bdbb2ba3f9c None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:36.633934 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928adf5-d171-4a91-b3fa-bdbe9cf763b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:36.634720 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928adf5-d171-4a91-b3fa-bdbe9cf763b2 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:36.634995 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928adf5-d171-4a91-b3fa-bdbe9cf763b2 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:36.635265 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928adf5-d171-4a91-b3fa-bdbe9cf763b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:36.636424 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928adf5-d171-4a91-b3fa-bdbe9cf763b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:36.637911 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7928adf5-d171-4a91-b3fa-bdbe9cf763b2 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:36.639501 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 120/250] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:38:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:36.640276 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928adf5-d171-4a91-b3fa-bdbe9cf763b2 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:36.667111 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 131/251] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:38:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:36.668455 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61786dfb-f4a9-48e0-af87-0c994ecf5152 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:36.668711 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61786dfb-f4a9-48e0-af87-0c994ecf5152 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:36.669019 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61786dfb-f4a9-48e0-af87-0c994ecf5152 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:36.671773 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 132/252] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:36.672559 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61786dfb-f4a9-48e0-af87-0c994ecf5152 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:36.732421 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928adf5-d171-4a91-b3fa-bdbe9cf763b2 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:36.764504 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61786dfb-f4a9-48e0-af87-0c994ecf5152 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:36.766217 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4f971-9bbf-4661-b2fd-2895de4bdb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:36.767008 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4f971-9bbf-4661-b2fd-2895de4bdb6b None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:36.767285 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4f971-9bbf-4661-b2fd-2895de4bdb6b None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:36.767560 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4f971-9bbf-4661-b2fd-2895de4bdb6b None admin] PATH_INFO: `/v3/roles/member` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:36.777940 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4f971-9bbf-4661-b2fd-2895de4bdb6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:36.784906 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-fbb4f971-9bbf-4661-b2fd-2895de4bdb6b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 13:38:36.786435 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 121/253] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:36.787195 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4f971-9bbf-4661-b2fd-2895de4bdb6b None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:36.796780 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddd499-71d3-4d58-a66c-efff49344d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:36.797678 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddd499-71d3-4d58-a66c-efff49344d8b None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:36.797953 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddd499-71d3-4d58-a66c-efff49344d8b None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:36.798217 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddd499-71d3-4d58-a66c-efff49344d8b None admin] PATH_INFO: `/v3/projects/cd5e8c45edab4920a609685e45710f9c` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:36.799422 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddd499-71d3-4d58-a66c-efff49344d8b None admin] RBAC: Authorizing `identity:get_project(project_id=cd5e8c45edab4920a609685e45710f9c)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:36.800884 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddd499-71d3-4d58-a66c-efff49344d8b None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:36.807334 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 133/254] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:36 2022] GET /identity/v3/projects/cd5e8c45edab4920a609685e45710f9c => generated 302 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:36.807334 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddd499-71d3-4d58-a66c-efff49344d8b None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:36.878934 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4f971-9bbf-4661-b2fd-2895de4bdb6b None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:36.898527 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddd499-71d3-4d58-a66c-efff49344d8b None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:36.912631 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de2a32-a0b2-4d58-a753-9deb7439a777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:36.913283 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de2a32-a0b2-4d58-a753-9deb7439a777 None admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:36.913589 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de2a32-a0b2-4d58-a753-9deb7439a777 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:36.913850 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de2a32-a0b2-4d58-a753-9deb7439a777 None admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:36.914571 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de2a32-a0b2-4d58-a753-9deb7439a777 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:36.916037 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de2a32-a0b2-4d58-a753-9deb7439a777 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:36.931237 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07265ae2-00f9-4b6c-9da3-5c3ab020245a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:36.932095 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07265ae2-00f9-4b6c-9da3-5c3ab020245a None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:36.932372 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07265ae2-00f9-4b6c-9da3-5c3ab020245a None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:36.932639 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07265ae2-00f9-4b6c-9da3-5c3ab020245a None admin] PATH_INFO: `/v3/projects/cd5e8c45edab4920a609685e45710f9c` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:36.934022 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07265ae2-00f9-4b6c-9da3-5c3ab020245a None admin] RBAC: Authorizing `identity:get_project(project_id=cd5e8c45edab4920a609685e45710f9c)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:36.935431 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07265ae2-00f9-4b6c-9da3-5c3ab020245a None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:36.935831 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 122/255] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Mar 8 13:38:36 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:38:36.937050 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796db4ad-6a00-46c5-ab02-d0bdf44b2f92 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:36.942221 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796db4ad-6a00-46c5-ab02-d0bdf44b2f92 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:36.942385 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 134/256] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:36 2022] GET /identity/v3/projects/cd5e8c45edab4920a609685e45710f9c => generated 302 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:36.942463 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796db4ad-6a00-46c5-ab02-d0bdf44b2f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:36.942531 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07265ae2-00f9-4b6c-9da3-5c3ab020245a None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:36.962379 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-796db4ad-6a00-46c5-ab02-d0bdf44b2f92 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:36.963960 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-796db4ad-6a00-46c5-ab02-d0bdf44b2f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:37.038172 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 123/257] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:37.039179 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796db4ad-6a00-46c5-ab02-d0bdf44b2f92 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:37.058312 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07265ae2-00f9-4b6c-9da3-5c3ab020245a None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:37.095782 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af380ba-62c4-45c8-affe-cd635b1fe758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:37.096458 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af380ba-62c4-45c8-affe-cd635b1fe758 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:37.096764 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af380ba-62c4-45c8-affe-cd635b1fe758 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:37.097121 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af380ba-62c4-45c8-affe-cd635b1fe758 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:37.097889 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af380ba-62c4-45c8-affe-cd635b1fe758 None admin] RBAC: Adding query filter params (name=member) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:37.098187 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af380ba-62c4-45c8-affe-cd635b1fe758 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:37.099579 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af380ba-62c4-45c8-affe-cd635b1fe758 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:37.108804 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 135/258] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:37.114269 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af380ba-62c4-45c8-affe-cd635b1fe758 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:37.145943 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796db4ad-6a00-46c5-ab02-d0bdf44b2f92 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:37.185642 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f7ae3-17f0-4265-a9c9-bfa0f601379e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:37.186308 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f7ae3-17f0-4265-a9c9-bfa0f601379e None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:37.186587 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f7ae3-17f0-4265-a9c9-bfa0f601379e None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:37.186858 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f7ae3-17f0-4265-a9c9-bfa0f601379e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:37.189199 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f7ae3-17f0-4265-a9c9-bfa0f601379e None admin] RBAC: Adding query filter params (role.id=fc021ed5870a44f5a0f0b8fff994d6f0, scope.project.id=cd5e8c45edab4920a609685e45710f9c, user.id=19cf2aeca31645829cd9e78948413041) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:37.189199 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f7ae3-17f0-4265-a9c9-bfa0f601379e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:37.189511 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f7ae3-17f0-4265-a9c9-bfa0f601379e None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:37.195275 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 124/259] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:38:37 2022] GET /identity/v3/role_assignments?user.id=19cf2aeca31645829cd9e78948413041&scope.project.id=cd5e8c45edab4920a609685e45710f9c&role.id=fc021ed5870a44f5a0f0b8fff994d6f0 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:37.196460 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f7ae3-17f0-4265-a9c9-bfa0f601379e None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:37.246281 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af380ba-62c4-45c8-affe-cd635b1fe758 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:37.290913 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f0b44-e3f8-421a-85eb-17d4a96f4855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:37.291578 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f0b44-e3f8-421a-85eb-17d4a96f4855 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:37.291852 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f0b44-e3f8-421a-85eb-17d4a96f4855 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:37.292127 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f0b44-e3f8-421a-85eb-17d4a96f4855 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:37.293061 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f0b44-e3f8-421a-85eb-17d4a96f4855 None admin] RBAC: Adding query filter params (role.id=c1a7741dcd074a12bea71d598fec4554, scope.project.id=cd5e8c45edab4920a609685e45710f9c, user.id=28f1ebbfa1aa4cdeba5e484248de0035) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:37.294304 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f0b44-e3f8-421a-85eb-17d4a96f4855 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:37.295854 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f0b44-e3f8-421a-85eb-17d4a96f4855 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:37.302138 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 136/260] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:38:37 2022] GET /identity/v3/role_assignments?user.id=28f1ebbfa1aa4cdeba5e484248de0035&scope.project.id=cd5e8c45edab4920a609685e45710f9c&role.id=c1a7741dcd074a12bea71d598fec4554 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:37.302820 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f0b44-e3f8-421a-85eb-17d4a96f4855 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:37.318154 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f7ae3-17f0-4265-a9c9-bfa0f601379e None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:37.356480 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6b2c3-b562-45ff-bc47-9b2cd6ed3063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:37.357329 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6b2c3-b562-45ff-bc47-9b2cd6ed3063 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:37.357634 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6b2c3-b562-45ff-bc47-9b2cd6ed3063 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:37.357899 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c6b2c3-b562-45ff-bc47-9b2cd6ed3063 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:37.374273 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c6b2c3-b562-45ff-bc47-9b2cd6ed3063 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:37.380903 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-40c6b2c3-b562-45ff-bc47-9b2cd6ed3063 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 13:38:37.382514 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 125/261] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Mar 8 13:38:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:37.390508 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6b2c3-b562-45ff-bc47-9b2cd6ed3063 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:37.463815 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f0b44-e3f8-421a-85eb-17d4a96f4855 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:37.558107 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf5ef0-aa58-4f18-9835-54c5ba6f92fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:37.559397 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf5ef0-aa58-4f18-9835-54c5ba6f92fe None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:37.559860 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf5ef0-aa58-4f18-9835-54c5ba6f92fe None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:37.560313 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf5ef0-aa58-4f18-9835-54c5ba6f92fe None admin] PATH_INFO: `/v3/users/e4375a1a3d6f40538fe4ccd35d1e5a8e` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:37.561968 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf5ef0-aa58-4f18-9835-54c5ba6f92fe None admin] RBAC: Authorizing `identity:get_user(user_id=e4375a1a3d6f40538fe4ccd35d1e5a8e)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:37.563604 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf5ef0-aa58-4f18-9835-54c5ba6f92fe None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:37.564175 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c6b2c3-b562-45ff-bc47-9b2cd6ed3063 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:37.566157 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 137/262] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:37 2022] GET /identity/v3/users/e4375a1a3d6f40538fe4ccd35d1e5a8e => generated 297 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:37.571302 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf5ef0-aa58-4f18-9835-54c5ba6f92fe None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:37.604797 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517db1c-a417-4035-800c-d10fb09db80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:37.605500 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517db1c-a417-4035-800c-d10fb09db80e None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:37.605783 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517db1c-a417-4035-800c-d10fb09db80e None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:37.606057 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517db1c-a417-4035-800c-d10fb09db80e None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:37.606815 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517db1c-a417-4035-800c-d10fb09db80e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:37.607122 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517db1c-a417-4035-800c-d10fb09db80e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:37.609498 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517db1c-a417-4035-800c-d10fb09db80e None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:37.619182 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 126/263] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:38:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:37.624618 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517db1c-a417-4035-800c-d10fb09db80e None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:37.678120 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf5ef0-aa58-4f18-9835-54c5ba6f92fe None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:37.712854 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52a50d-3b64-462c-bace-8a153b7a2e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:37.714207 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52a50d-3b64-462c-bace-8a153b7a2e86 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:37.714680 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52a50d-3b64-462c-bace-8a153b7a2e86 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:37.715134 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52a50d-3b64-462c-bace-8a153b7a2e86 None admin] PATH_INFO: `/v3/projects/cd5e8c45edab4920a609685e45710f9c` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:37.716577 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52a50d-3b64-462c-bace-8a153b7a2e86 None admin] RBAC: Authorizing `identity:get_project(project_id=cd5e8c45edab4920a609685e45710f9c)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:37.718313 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52a50d-3b64-462c-bace-8a153b7a2e86 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:37.720610 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 138/264] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:37 2022] GET /identity/v3/projects/cd5e8c45edab4920a609685e45710f9c => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:37.725919 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52a50d-3b64-462c-bace-8a153b7a2e86 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:37.735547 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517db1c-a417-4035-800c-d10fb09db80e None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:37.805380 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c77a44-121f-475d-8ddf-317b645c3d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:37.806271 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c77a44-121f-475d-8ddf-317b645c3d6d None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:37.806552 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c77a44-121f-475d-8ddf-317b645c3d6d None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:37.806828 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c77a44-121f-475d-8ddf-317b645c3d6d None admin] PATH_INFO: `/v3/users/19cf2aeca31645829cd9e78948413041` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:37.808047 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c77a44-121f-475d-8ddf-317b645c3d6d None admin] RBAC: Authorizing `identity:get_user(user_id=19cf2aeca31645829cd9e78948413041)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:37.817575 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c77a44-121f-475d-8ddf-317b645c3d6d None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:37.819563 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 127/265] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:37 2022] GET /identity/v3/users/19cf2aeca31645829cd9e78948413041 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:37.824894 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c77a44-121f-475d-8ddf-317b645c3d6d None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:37.832622 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52a50d-3b64-462c-bace-8a153b7a2e86 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:37.869289 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139dfc62-f83a-4b42-a0bf-ff02da24489a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:37.870105 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139dfc62-f83a-4b42-a0bf-ff02da24489a None admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:37.870385 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139dfc62-f83a-4b42-a0bf-ff02da24489a None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:37.870656 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139dfc62-f83a-4b42-a0bf-ff02da24489a None admin] PATH_INFO: `/v3/projects/cd5e8c45edab4920a609685e45710f9c/users/e4375a1a3d6f40538fe4ccd35d1e5a8e/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:37.876933 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139dfc62-f83a-4b42-a0bf-ff02da24489a None admin] RBAC: Authorizing `identity:create_grant(project_id=cd5e8c45edab4920a609685e45710f9c, user_id=e4375a1a3d6f40538fe4ccd35d1e5a8e, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:37.878472 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139dfc62-f83a-4b42-a0bf-ff02da24489a None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:37.904592 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 139/266] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Mar 8 13:38:37 2022] PUT /identity/v3/projects/cd5e8c45edab4920a609685e45710f9c/users/e4375a1a3d6f40538fe4ccd35d1e5a8e/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:38:37.992801 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c77a44-121f-475d-8ddf-317b645c3d6d None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:38.045627 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8450a85-44c3-49cd-b32a-2597b3f5f666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:38.046673 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8450a85-44c3-49cd-b32a-2597b3f5f666 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:38.047139 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8450a85-44c3-49cd-b32a-2597b3f5f666 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:38.047616 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8450a85-44c3-49cd-b32a-2597b3f5f666 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:38.125752 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8450a85-44c3-49cd-b32a-2597b3f5f666 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:38.127215 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8450a85-44c3-49cd-b32a-2597b3f5f666 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:38.228935 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 128/267] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:38:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 13:38:38.234388 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139dfc62-f83a-4b42-a0bf-ff02da24489a None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:38.364351 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139dfc62-f83a-4b42-a0bf-ff02da24489a None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:38.398186 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58741619-d7f7-4097-9d11-afaedab26c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:38.399064 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58741619-d7f7-4097-9d11-afaedab26c6b None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:38.399344 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58741619-d7f7-4097-9d11-afaedab26c6b None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:38.399619 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58741619-d7f7-4097-9d11-afaedab26c6b None admin] PATH_INFO: `/v3/projects/cd5e8c45edab4920a609685e45710f9c` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:38.400812 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58741619-d7f7-4097-9d11-afaedab26c6b None admin] RBAC: Authorizing `identity:get_project(project_id=cd5e8c45edab4920a609685e45710f9c)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:38.402278 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58741619-d7f7-4097-9d11-afaedab26c6b None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:38.404293 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 140/268] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:38 2022] GET /identity/v3/projects/cd5e8c45edab4920a609685e45710f9c => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:38.410190 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8450a85-44c3-49cd-b32a-2597b3f5f666 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:38.508716 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8450a85-44c3-49cd-b32a-2597b3f5f666 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:38.542433 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd1d9d-4521-41c1-80d6-d21dee020c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:38.543099 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd1d9d-4521-41c1-80d6-d21dee020c1c None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:38.543373 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd1d9d-4521-41c1-80d6-d21dee020c1c None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:38.543638 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd1d9d-4521-41c1-80d6-d21dee020c1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:38.544477 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd1d9d-4521-41c1-80d6-d21dee020c1c None admin] RBAC: Adding query filter params (role.id=cbd629eb0cbe4cc7b69cc790228cdfc8, scope.project.id=cd5e8c45edab4920a609685e45710f9c, user.id=19cf2aeca31645829cd9e78948413041) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:38.544787 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd1d9d-4521-41c1-80d6-d21dee020c1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:38.546262 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd1d9d-4521-41c1-80d6-d21dee020c1c None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:38.552438 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 129/269] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:38:38 2022] GET /identity/v3/role_assignments?user.id=19cf2aeca31645829cd9e78948413041&scope.project.id=cd5e8c45edab4920a609685e45710f9c&role.id=cbd629eb0cbe4cc7b69cc790228cdfc8 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:39.717861 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4832a00-6c7b-47fb-b03d-abf3ac7ccd41 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:39.718382 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4832a00-6c7b-47fb-b03d-abf3ac7ccd41 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:39.718382 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4832a00-6c7b-47fb-b03d-abf3ac7ccd41 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:39.720592 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 141/270] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:39.726615 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff17ae-f43f-4642-ba60-6c559e529247 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:39.727552 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff17ae-f43f-4642-ba60-6c559e529247 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:39.728027 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff17ae-f43f-4642-ba60-6c559e529247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:39.745086 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-7cff17ae-f43f-4642-ba60-6c559e529247 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:39.746568 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-7cff17ae-f43f-4642-ba60-6c559e529247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:39.812195 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 130/271] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:39.835919 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4832a00-6c7b-47fb-b03d-abf3ac7ccd41 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:39.937585 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4832a00-6c7b-47fb-b03d-abf3ac7ccd41 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:39.947504 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d702b68-d352-4359-9967-6aae6aaca704 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:39.947791 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d702b68-d352-4359-9967-6aae6aaca704 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:39.948054 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d702b68-d352-4359-9967-6aae6aaca704 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:39.950025 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 131/272] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:38:39.955376 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce903c8-9260-49eb-b630-f42a13e12b17 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:39.955530 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce903c8-9260-49eb-b630-f42a13e12b17 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:39.955806 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce903c8-9260-49eb-b630-f42a13e12b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:39.972646 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-bce903c8-9260-49eb-b630-f42a13e12b17 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:39.973855 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-bce903c8-9260-49eb-b630-f42a13e12b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:39.980310 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677b0c8-8e84-4616-abf8-1278f6b42abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:39.981403 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677b0c8-8e84-4616-abf8-1278f6b42abe None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:39.981881 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677b0c8-8e84-4616-abf8-1278f6b42abe None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:39.982344 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677b0c8-8e84-4616-abf8-1278f6b42abe None admin] PATH_INFO: `/v3/roles/member` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:39.994236 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677b0c8-8e84-4616-abf8-1278f6b42abe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:40.001442 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-6677b0c8-8e84-4616-abf8-1278f6b42abe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 13:38:40.003203 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 142/273] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:40.009087 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677b0c8-8e84-4616-abf8-1278f6b42abe None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:40.048239 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 132/274] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:40.059651 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad669f-e114-445b-bf70-736641c42022 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:40.059933 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad669f-e114-445b-bf70-736641c42022 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:40.060214 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ad669f-e114-445b-bf70-736641c42022 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:40.062400 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 133/275] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:40.067605 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889e1b9-7cef-4bed-880f-ea3855e7ca8d None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:40.068138 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889e1b9-7cef-4bed-880f-ea3855e7ca8d None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:40.068610 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889e1b9-7cef-4bed-880f-ea3855e7ca8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:40.087822 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-5889e1b9-7cef-4bed-880f-ea3855e7ca8d None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:40.089228 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-5889e1b9-7cef-4bed-880f-ea3855e7ca8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:40.120081 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677b0c8-8e84-4616-abf8-1278f6b42abe None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:40.153253 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169d61a-fbc2-46d2-924c-c983a491a3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:40.153948 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 134/276] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:38:40.154142 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169d61a-fbc2-46d2-924c-c983a491a3bc None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:40.154370 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169d61a-fbc2-46d2-924c-c983a491a3bc None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:40.154637 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9169d61a-fbc2-46d2-924c-c983a491a3bc None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:40.155455 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169d61a-fbc2-46d2-924c-c983a491a3bc None admin] RBAC: Adding query filter params (name=member) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:40.155761 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169d61a-fbc2-46d2-924c-c983a491a3bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:40.157127 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9169d61a-fbc2-46d2-924c-c983a491a3bc None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:40.158209 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889e1b9-7cef-4bed-880f-ea3855e7ca8d None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:40.170486 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 143/277] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:40.171878 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169d61a-fbc2-46d2-924c-c983a491a3bc None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:40.256983 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889e1b9-7cef-4bed-880f-ea3855e7ca8d None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:40.264856 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9169d61a-fbc2-46d2-924c-c983a491a3bc None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:40.290281 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5aac8c-f02b-4a77-8858-3521395ffc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:40.291075 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aac8c-f02b-4a77-8858-3521395ffc43 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:40.291353 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aac8c-f02b-4a77-8858-3521395ffc43 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:40.291617 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5aac8c-f02b-4a77-8858-3521395ffc43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:40.292860 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5aac8c-f02b-4a77-8858-3521395ffc43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:40.294274 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5aac8c-f02b-4a77-8858-3521395ffc43 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:40.295898 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 135/278] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:38:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:40.296654 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5aac8c-f02b-4a77-8858-3521395ffc43 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:40.300624 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01b4ce-2f6b-4546-9a1a-540144c6e356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:40.301809 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01b4ce-2f6b-4546-9a1a-540144c6e356 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:40.302092 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01b4ce-2f6b-4546-9a1a-540144c6e356 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:40.302358 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01b4ce-2f6b-4546-9a1a-540144c6e356 None admin] PATH_INFO: `/v3/users/f056753e9a174543a1dbbe2bd1594e1f` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:40.315480 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01b4ce-2f6b-4546-9a1a-540144c6e356 None admin] RBAC: Authorizing `identity:get_user(user_id=f056753e9a174543a1dbbe2bd1594e1f)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:40.316856 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01b4ce-2f6b-4546-9a1a-540144c6e356 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:40.318697 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 144/279] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:40 2022] GET /identity/v3/users/f056753e9a174543a1dbbe2bd1594e1f => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:40.319271 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01b4ce-2f6b-4546-9a1a-540144c6e356 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:40.398915 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5aac8c-f02b-4a77-8858-3521395ffc43 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:40.416861 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01b4ce-2f6b-4546-9a1a-540144c6e356 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:40.435083 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb8c33-e552-476c-8544-2110f81c01d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:40.435876 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb8c33-e552-476c-8544-2110f81c01d1 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:40.436579 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb8c33-e552-476c-8544-2110f81c01d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:40.436859 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb8c33-e552-476c-8544-2110f81c01d1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:40.447251 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb8c33-e552-476c-8544-2110f81c01d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:40.449379 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b876a7fe-ebb5-40a6-8882-f61fedf1e359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:40.450048 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876a7fe-ebb5-40a6-8882-f61fedf1e359 None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:40.450330 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876a7fe-ebb5-40a6-8882-f61fedf1e359 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:40.450586 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876a7fe-ebb5-40a6-8882-f61fedf1e359 None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:40.451289 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876a7fe-ebb5-40a6-8882-f61fedf1e359 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:40.452713 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b876a7fe-ebb5-40a6-8882-f61fedf1e359 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:40.454010 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-6bdb8c33-e552-476c-8544-2110f81c01d1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 13:38:40.455182 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 136/280] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:40.456014 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb8c33-e552-476c-8544-2110f81c01d1 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:40.475955 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 145/281] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Mar 8 13:38:40 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:38:40.477256 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49421bc6-39b3-4cbd-a156-37f10176ae38 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:40.477572 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49421bc6-39b3-4cbd-a156-37f10176ae38 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:40.478058 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49421bc6-39b3-4cbd-a156-37f10176ae38 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:40.479776 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 146/282] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:40.480535 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49421bc6-39b3-4cbd-a156-37f10176ae38 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:40.570949 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb8c33-e552-476c-8544-2110f81c01d1 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:40.598397 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49421bc6-39b3-4cbd-a156-37f10176ae38 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:40.605226 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cf87b-8024-411a-a91b-61706063602e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:40.605928 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cf87b-8024-411a-a91b-61706063602e None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:40.606227 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cf87b-8024-411a-a91b-61706063602e None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:40.606478 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cf87b-8024-411a-a91b-61706063602e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:40.607314 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0cf87b-8024-411a-a91b-61706063602e None admin] RBAC: Adding query filter params (role.id=0010e8da2d4b4bb8af05894096d2fc92, user.id=f056753e9a174543a1dbbe2bd1594e1f, scope.system=all) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:40.607620 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0cf87b-8024-411a-a91b-61706063602e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:40.609119 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0cf87b-8024-411a-a91b-61706063602e None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:40.625394 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 137/283] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Mar 8 13:38:40 2022] GET /identity/v3/role_assignments?user.id=f056753e9a174543a1dbbe2bd1594e1f&scope.system=all&role.id=0010e8da2d4b4bb8af05894096d2fc92 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:40.625394 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8909a1-2090-4dfc-84e1-edf61eecd2af None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:40.625394 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8909a1-2090-4dfc-84e1-edf61eecd2af None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:40.625394 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8909a1-2090-4dfc-84e1-edf61eecd2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:40.646698 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-9d8909a1-2090-4dfc-84e1-edf61eecd2af None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:40.648160 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-9d8909a1-2090-4dfc-84e1-edf61eecd2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:40.649064 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509ebd7-e961-453a-8fed-24e44431b234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:40.649856 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509ebd7-e961-453a-8fed-24e44431b234 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:40.650201 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509ebd7-e961-453a-8fed-24e44431b234 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:40.650587 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b509ebd7-e961-453a-8fed-24e44431b234 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:40.651436 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509ebd7-e961-453a-8fed-24e44431b234 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:40.651846 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509ebd7-e961-453a-8fed-24e44431b234 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:40.653369 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b509ebd7-e961-453a-8fed-24e44431b234 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:40.663801 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 147/284] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:40.669433 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509ebd7-e961-453a-8fed-24e44431b234 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:40.741012 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 138/285] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:40.767482 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8909a1-2090-4dfc-84e1-edf61eecd2af None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:40.788901 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b509ebd7-e961-453a-8fed-24e44431b234 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:40.827100 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dabebf-5aaa-4779-bdd7-b769d22d8448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:40.827904 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dabebf-5aaa-4779-bdd7-b769d22d8448 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:40.828209 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dabebf-5aaa-4779-bdd7-b769d22d8448 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:40.828448 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dabebf-5aaa-4779-bdd7-b769d22d8448 None admin] PATH_INFO: `/v3/users/28f1ebbfa1aa4cdeba5e484248de0035` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:40.829712 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dabebf-5aaa-4779-bdd7-b769d22d8448 None admin] RBAC: Authorizing `identity:get_user(user_id=28f1ebbfa1aa4cdeba5e484248de0035)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:40.831180 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dabebf-5aaa-4779-bdd7-b769d22d8448 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:40.833653 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 148/286] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:40 2022] GET /identity/v3/users/28f1ebbfa1aa4cdeba5e484248de0035 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:40.838962 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dabebf-5aaa-4779-bdd7-b769d22d8448 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:40.875623 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8909a1-2090-4dfc-84e1-edf61eecd2af None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:40.914828 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb047262-47bb-4383-af5a-0f273cd8305d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:40.916030 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb047262-47bb-4383-af5a-0f273cd8305d None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:40.916531 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb047262-47bb-4383-af5a-0f273cd8305d None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:40.916997 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb047262-47bb-4383-af5a-0f273cd8305d None admin] PATH_INFO: `/v3/roles/member` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:40.931587 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb047262-47bb-4383-af5a-0f273cd8305d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:40.939262 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-bb047262-47bb-4383-af5a-0f273cd8305d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 13:38:40.945514 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 139/287] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:40.947866 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb047262-47bb-4383-af5a-0f273cd8305d None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:41.053612 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb047262-47bb-4383-af5a-0f273cd8305d None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:41.062081 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dabebf-5aaa-4779-bdd7-b769d22d8448 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:41.088527 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6186b8-63af-4b4a-b10f-e0cd748322a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:41.089628 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6186b8-63af-4b4a-b10f-e0cd748322a1 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:41.090126 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6186b8-63af-4b4a-b10f-e0cd748322a1 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:41.090592 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6186b8-63af-4b4a-b10f-e0cd748322a1 None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:41.091542 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6186b8-63af-4b4a-b10f-e0cd748322a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:41.092039 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6186b8-63af-4b4a-b10f-e0cd748322a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:41.093654 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6186b8-63af-4b4a-b10f-e0cd748322a1 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:41.095680 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa7dec-e82c-443c-9734-9a66f6b30fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:41.096718 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa7dec-e82c-443c-9734-9a66f6b30fef None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:41.097111 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa7dec-e82c-443c-9734-9a66f6b30fef None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:41.097526 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa7dec-e82c-443c-9734-9a66f6b30fef None admin] PATH_INFO: `/v3/projects/cd5e8c45edab4920a609685e45710f9c` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:41.098842 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa7dec-e82c-443c-9734-9a66f6b30fef None admin] RBAC: Authorizing `identity:get_project(project_id=cd5e8c45edab4920a609685e45710f9c)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:41.100586 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa7dec-e82c-443c-9734-9a66f6b30fef None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:41.102573 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 149/288] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:40 2022] GET /identity/v3/projects/cd5e8c45edab4920a609685e45710f9c => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:41.104261 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 140/289] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:41.108693 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa7dec-e82c-443c-9734-9a66f6b30fef None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:41.110161 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6186b8-63af-4b4a-b10f-e0cd748322a1 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:41.206250 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa7dec-e82c-443c-9734-9a66f6b30fef None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:41.216950 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6186b8-63af-4b4a-b10f-e0cd748322a1 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:41.239710 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277aac9e-f8e8-47b2-8add-9e8e4105facc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:41.240699 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277aac9e-f8e8-47b2-8add-9e8e4105facc None admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:41.241040 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277aac9e-f8e8-47b2-8add-9e8e4105facc None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:41.241396 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277aac9e-f8e8-47b2-8add-9e8e4105facc None admin] PATH_INFO: `/v3/projects/cd5e8c45edab4920a609685e45710f9c/users/28f1ebbfa1aa4cdeba5e484248de0035/roles/c1a7741dcd074a12bea71d598fec4554` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:41.243452 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277aac9e-f8e8-47b2-8add-9e8e4105facc None admin] RBAC: Authorizing `identity:create_grant(project_id=cd5e8c45edab4920a609685e45710f9c, user_id=28f1ebbfa1aa4cdeba5e484248de0035, role_id=c1a7741dcd074a12bea71d598fec4554)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:41.244944 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277aac9e-f8e8-47b2-8add-9e8e4105facc None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:41.251173 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc644c-1d48-410a-b749-14a45166b88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:41.252378 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc644c-1d48-410a-b749-14a45166b88d None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:41.252746 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc644c-1d48-410a-b749-14a45166b88d None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:41.253236 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc644c-1d48-410a-b749-14a45166b88d None admin] PATH_INFO: `/v3/users/e4375a1a3d6f40538fe4ccd35d1e5a8e` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:41.254408 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc644c-1d48-410a-b749-14a45166b88d None admin] RBAC: Authorizing `identity:get_user(user_id=e4375a1a3d6f40538fe4ccd35d1e5a8e)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:41.255943 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc644c-1d48-410a-b749-14a45166b88d None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:41.257873 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 141/290] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:41 2022] GET /identity/v3/users/e4375a1a3d6f40538fe4ccd35d1e5a8e => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:41.262729 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 150/291] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Mar 8 13:38:41 2022] PUT /identity/v3/projects/cd5e8c45edab4920a609685e45710f9c/users/28f1ebbfa1aa4cdeba5e484248de0035/roles/c1a7741dcd074a12bea71d598fec4554 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:38:41.266831 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc644c-1d48-410a-b749-14a45166b88d None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:41.401719 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc644c-1d48-410a-b749-14a45166b88d None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:41.446579 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e66328-64bc-4c12-8613-ae3f49d0418e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:41.447573 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e66328-64bc-4c12-8613-ae3f49d0418e None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:41.448044 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e66328-64bc-4c12-8613-ae3f49d0418e None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:41.448492 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e66328-64bc-4c12-8613-ae3f49d0418e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:41.528948 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e66328-64bc-4c12-8613-ae3f49d0418e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:41.530469 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e66328-64bc-4c12-8613-ae3f49d0418e None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:41.628658 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 142/292] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:38:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 13:38:41.634692 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277aac9e-f8e8-47b2-8add-9e8e4105facc None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:41.733628 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277aac9e-f8e8-47b2-8add-9e8e4105facc None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:41.768917 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89109aa3-739e-41a3-a42f-474ed1edfb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:41.769798 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89109aa3-739e-41a3-a42f-474ed1edfb9e None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:41.770079 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89109aa3-739e-41a3-a42f-474ed1edfb9e None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:41.770347 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89109aa3-739e-41a3-a42f-474ed1edfb9e None admin] PATH_INFO: `/v3/projects/cd5e8c45edab4920a609685e45710f9c` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:41.774079 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89109aa3-739e-41a3-a42f-474ed1edfb9e None admin] RBAC: Authorizing `identity:get_project(project_id=cd5e8c45edab4920a609685e45710f9c)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:41.775519 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89109aa3-739e-41a3-a42f-474ed1edfb9e None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:41.777613 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 151/293] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:41 2022] GET /identity/v3/projects/cd5e8c45edab4920a609685e45710f9c => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:41.783445 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e66328-64bc-4c12-8613-ae3f49d0418e None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:41.941886 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e66328-64bc-4c12-8613-ae3f49d0418e None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:41.978950 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e58a24-7edf-4e0b-8397-ef864494caaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:41.979609 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e58a24-7edf-4e0b-8397-ef864494caaf None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:41.979885 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e58a24-7edf-4e0b-8397-ef864494caaf None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:41.980154 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e58a24-7edf-4e0b-8397-ef864494caaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:41.980976 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e58a24-7edf-4e0b-8397-ef864494caaf None admin] RBAC: Adding query filter params (role.id=0010e8da2d4b4bb8af05894096d2fc92, scope.project.id=cd5e8c45edab4920a609685e45710f9c, user.id=e4375a1a3d6f40538fe4ccd35d1e5a8e) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:41.981279 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e58a24-7edf-4e0b-8397-ef864494caaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:41.982970 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e58a24-7edf-4e0b-8397-ef864494caaf None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:41.989193 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 143/294] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:38:41 2022] GET /identity/v3/role_assignments?user.id=e4375a1a3d6f40538fe4ccd35d1e5a8e&scope.project.id=cd5e8c45edab4920a609685e45710f9c&role.id=0010e8da2d4b4bb8af05894096d2fc92 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:43.125911 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b328c6a-368f-45cd-ad40-782c98bedc66 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:43.126432 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b328c6a-368f-45cd-ad40-782c98bedc66 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:43.126532 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b328c6a-368f-45cd-ad40-782c98bedc66 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:43.128804 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 152/295] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:43.133943 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015a45c-2c26-4c07-ae15-d50b5b83b3d9 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:43.134723 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015a45c-2c26-4c07-ae15-d50b5b83b3d9 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:43.135182 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015a45c-2c26-4c07-ae15-d50b5b83b3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:43.153702 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-a015a45c-2c26-4c07-ae15-d50b5b83b3d9 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:43.155397 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-a015a45c-2c26-4c07-ae15-d50b5b83b3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:43.241576 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 144/296] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:43.265163 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b328c6a-368f-45cd-ad40-782c98bedc66 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:43.365616 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b328c6a-368f-45cd-ad40-782c98bedc66 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:43.398738 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5ee90-ff10-4220-ade6-0ae82f23bbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:43.399871 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5ee90-ff10-4220-ade6-0ae82f23bbed None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:43.400333 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5ee90-ff10-4220-ade6-0ae82f23bbed None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:43.400784 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5ee90-ff10-4220-ade6-0ae82f23bbed None admin] PATH_INFO: `/v3/domains/default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:43.402166 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5ee90-ff10-4220-ade6-0ae82f23bbed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:43.403768 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5ee90-ff10-4220-ade6-0ae82f23bbed None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:43.405913 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 153/297] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:38:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:43.412128 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015a45c-2c26-4c07-ae15-d50b5b83b3d9 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:43.443463 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9aedb-a5c9-46c7-8520-07d8f0f73c9f None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:43.444088 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9aedb-a5c9-46c7-8520-07d8f0f73c9f None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:43.444544 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9aedb-a5c9-46c7-8520-07d8f0f73c9f None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:43.447866 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 154/298] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:38:43.455098 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3f8d5-72f4-4c93-9fd8-2d8352c525a6 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:43.455779 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3f8d5-72f4-4c93-9fd8-2d8352c525a6 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:43.456238 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f3f8d5-72f4-4c93-9fd8-2d8352c525a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:43.477117 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-d8f3f8d5-72f4-4c93-9fd8-2d8352c525a6 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:43.478826 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-d8f3f8d5-72f4-4c93-9fd8-2d8352c525a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:43.519502 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015a45c-2c26-4c07-ae15-d50b5b83b3d9 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:43.553975 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7c63e-4b46-489a-aac2-3330bcbdb92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:43.554858 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7c63e-4b46-489a-aac2-3330bcbdb92e None admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:43.555236 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7c63e-4b46-489a-aac2-3330bcbdb92e None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:43.555604 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7c63e-4b46-489a-aac2-3330bcbdb92e None admin] PATH_INFO: `/v3/groups` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:43.557399 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7c63e-4b46-489a-aac2-3330bcbdb92e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:43.557999 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7c63e-4b46-489a-aac2-3330bcbdb92e None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:43.565488 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 155/299] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:38:43.574034 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 145/300] 10.222.0.18 () {60 vars in 1134 bytes} [Tue Mar 8 13:38:43 2022] POST /identity/v3/groups => generated 229 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:38:43.582901 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3f8d5-72f4-4c93-9fd8-2d8352c525a6 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:43.592738 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f509f1d-a54d-4386-8b1c-4427fc97257c None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:43.593117 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f509f1d-a54d-4386-8b1c-4427fc97257c None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:43.593429 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f509f1d-a54d-4386-8b1c-4427fc97257c None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:43.595670 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 146/301] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:43.603173 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db847588-d16c-4979-b85b-2f42a2cf7dae None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:43.603512 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db847588-d16c-4979-b85b-2f42a2cf7dae None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:43.603791 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db847588-d16c-4979-b85b-2f42a2cf7dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:43.625108 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-db847588-d16c-4979-b85b-2f42a2cf7dae None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:43.626747 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-db847588-d16c-4979-b85b-2f42a2cf7dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:43.705389 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 147/302] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:38:43.705649 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f3f8d5-72f4-4c93-9fd8-2d8352c525a6 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:43.726196 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db847588-d16c-4979-b85b-2f42a2cf7dae None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:43.742657 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b557ee2-f334-4f0d-91af-0bc71333b925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:43.743520 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b557ee2-f334-4f0d-91af-0bc71333b925 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:43.743805 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b557ee2-f334-4f0d-91af-0bc71333b925 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:43.744040 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b557ee2-f334-4f0d-91af-0bc71333b925 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:43.755572 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b557ee2-f334-4f0d-91af-0bc71333b925 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:43.765157 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-1b557ee2-f334-4f0d-91af-0bc71333b925 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 13:38:43.765157 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 156/303] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:43.771728 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b557ee2-f334-4f0d-91af-0bc71333b925 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:43.845447 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db847588-d16c-4979-b85b-2f42a2cf7dae None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:43.877684 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827694d6-c68d-4db0-bf8c-3692c854bd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:43.878485 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827694d6-c68d-4db0-bf8c-3692c854bd18 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:43.878762 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827694d6-c68d-4db0-bf8c-3692c854bd18 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:43.878942 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b557ee2-f334-4f0d-91af-0bc71333b925 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:43.879038 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827694d6-c68d-4db0-bf8c-3692c854bd18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:43.888730 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827694d6-c68d-4db0-bf8c-3692c854bd18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:43.895714 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-827694d6-c68d-4db0-bf8c-3692c854bd18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 13:38:43.901491 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 148/304] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:43.901491 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406870a1-c172-4745-a3b7-08db732f2c2d None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:43.901491 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406870a1-c172-4745-a3b7-08db732f2c2d None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:43.901491 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406870a1-c172-4745-a3b7-08db732f2c2d None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:43.901491 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 149/305] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:43.905575 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406870a1-c172-4745-a3b7-08db732f2c2d None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:43.915650 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1c675e-0ec8-4b9f-8810-18bef1b11488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:43.916316 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c675e-0ec8-4b9f-8810-18bef1b11488 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:43.916595 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c675e-0ec8-4b9f-8810-18bef1b11488 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:43.916867 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1c675e-0ec8-4b9f-8810-18bef1b11488 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:43.917647 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c675e-0ec8-4b9f-8810-18bef1b11488 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:43.917945 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c675e-0ec8-4b9f-8810-18bef1b11488 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:43.919297 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1c675e-0ec8-4b9f-8810-18bef1b11488 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:43.930081 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 157/306] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:43.931195 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd5977-26c1-40e1-b6c0-063a67e98de2 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:43.931480 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd5977-26c1-40e1-b6c0-063a67e98de2 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:43.931747 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd5977-26c1-40e1-b6c0-063a67e98de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:43.951250 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-bccd5977-26c1-40e1-b6c0-063a67e98de2 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:43.952979 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-bccd5977-26c1-40e1-b6c0-063a67e98de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:44.010002 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406870a1-c172-4745-a3b7-08db732f2c2d None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:44.018995 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 158/307] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:44.026508 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd5977-26c1-40e1-b6c0-063a67e98de2 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:44.043046 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d0384-4ad1-418b-bcd8-64b987ac689b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:44.043717 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d0384-4ad1-418b-bcd8-64b987ac689b None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:44.043996 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d0384-4ad1-418b-bcd8-64b987ac689b None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:44.044272 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d0384-4ad1-418b-bcd8-64b987ac689b None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:44.045024 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d0384-4ad1-418b-bcd8-64b987ac689b None admin] RBAC: Adding query filter params (name=member) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:44.045332 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d0384-4ad1-418b-bcd8-64b987ac689b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:44.046748 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d0384-4ad1-418b-bcd8-64b987ac689b None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:44.055941 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 150/308] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:44.056693 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d0384-4ad1-418b-bcd8-64b987ac689b None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:44.127572 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd5977-26c1-40e1-b6c0-063a67e98de2 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:44.154276 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d0384-4ad1-418b-bcd8-64b987ac689b None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:44.159192 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb03b1-6ea6-4b02-8d6d-35548d026ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:44.160376 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb03b1-6ea6-4b02-8d6d-35548d026ed7 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:44.160656 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb03b1-6ea6-4b02-8d6d-35548d026ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:44.160928 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb03b1-6ea6-4b02-8d6d-35548d026ed7 None admin] PATH_INFO: `/v3/users/075a2c538a36484d82c2ae5a853a21a9` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:44.173711 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb03b1-6ea6-4b02-8d6d-35548d026ed7 None admin] RBAC: Authorizing `identity:get_user(user_id=075a2c538a36484d82c2ae5a853a21a9)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:44.175213 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdb03b1-6ea6-4b02-8d6d-35548d026ed7 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:44.181388 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 159/309] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:44 2022] GET /identity/v3/users/075a2c538a36484d82c2ae5a853a21a9 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:44.181388 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb03b1-6ea6-4b02-8d6d-35548d026ed7 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:44.186344 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30965aaf-ae83-4e33-86d4-07169328b168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:44.187141 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30965aaf-ae83-4e33-86d4-07169328b168 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:44.187423 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30965aaf-ae83-4e33-86d4-07169328b168 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:44.187699 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30965aaf-ae83-4e33-86d4-07169328b168 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:44.197583 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30965aaf-ae83-4e33-86d4-07169328b168 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:44.204431 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-30965aaf-ae83-4e33-86d4-07169328b168 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 13:38:44.205841 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 151/310] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:44.211270 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30965aaf-ae83-4e33-86d4-07169328b168 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:44.273301 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb03b1-6ea6-4b02-8d6d-35548d026ed7 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:44.305101 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30965aaf-ae83-4e33-86d4-07169328b168 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:44.307333 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e97622-014f-44f2-97e6-166187e1877a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:44.308207 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e97622-014f-44f2-97e6-166187e1877a None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:44.308486 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e97622-014f-44f2-97e6-166187e1877a None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:44.308758 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e97622-014f-44f2-97e6-166187e1877a None admin] PATH_INFO: `/v3/users/f056753e9a174543a1dbbe2bd1594e1f` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:44.309984 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e97622-014f-44f2-97e6-166187e1877a None admin] RBAC: Authorizing `identity:get_user(user_id=f056753e9a174543a1dbbe2bd1594e1f)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:44.311407 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e97622-014f-44f2-97e6-166187e1877a None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:44.317893 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 160/311] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:44 2022] GET /identity/v3/users/f056753e9a174543a1dbbe2bd1594e1f => generated 293 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:44.317893 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e97622-014f-44f2-97e6-166187e1877a None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:44.337698 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b830d-c328-4000-945d-aaadd7ced6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:44.338348 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b830d-c328-4000-945d-aaadd7ced6ca None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:44.338626 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b830d-c328-4000-945d-aaadd7ced6ca None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:44.338895 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b830d-c328-4000-945d-aaadd7ced6ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:44.339717 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b830d-c328-4000-945d-aaadd7ced6ca None admin] RBAC: Adding query filter params (role.id=c1a7741dcd074a12bea71d598fec4554, user.id=075a2c538a36484d82c2ae5a853a21a9, scope.system=all) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:44.340023 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b830d-c328-4000-945d-aaadd7ced6ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:44.341487 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b830d-c328-4000-945d-aaadd7ced6ca None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:44.357657 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 152/312] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Mar 8 13:38:44 2022] GET /identity/v3/role_assignments?user.id=075a2c538a36484d82c2ae5a853a21a9&scope.system=all&role.id=c1a7741dcd074a12bea71d598fec4554 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:44.357657 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b830d-c328-4000-945d-aaadd7ced6ca None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:44.429734 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e97622-014f-44f2-97e6-166187e1877a None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:44.455706 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b830d-c328-4000-945d-aaadd7ced6ca None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:44.470269 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331ca59-c78c-498f-a2bb-aac86693e148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:44.470949 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331ca59-c78c-498f-a2bb-aac86693e148 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:44.471297 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331ca59-c78c-498f-a2bb-aac86693e148 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:44.473403 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331ca59-c78c-498f-a2bb-aac86693e148 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:44.473403 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331ca59-c78c-498f-a2bb-aac86693e148 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:44.473403 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331ca59-c78c-498f-a2bb-aac86693e148 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:44.474679 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331ca59-c78c-498f-a2bb-aac86693e148 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:44.486083 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 161/313] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:44.491605 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331ca59-c78c-498f-a2bb-aac86693e148 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:44.509023 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3085df-4c0b-4230-9453-90e167080eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:44.510749 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3085df-4c0b-4230-9453-90e167080eb6 None admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:44.511563 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3085df-4c0b-4230-9453-90e167080eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:44.512359 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3085df-4c0b-4230-9453-90e167080eb6 None admin] PATH_INFO: `/v3/system/users/f056753e9a174543a1dbbe2bd1594e1f/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:44.514540 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3085df-4c0b-4230-9453-90e167080eb6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f056753e9a174543a1dbbe2bd1594e1f, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:44.517064 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3085df-4c0b-4230-9453-90e167080eb6 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:44.532728 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 153/314] 10.222.0.18 () {58 vars in 1334 bytes} [Tue Mar 8 13:38:44 2022] PUT /identity/v3/system/users/f056753e9a174543a1dbbe2bd1594e1f/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:38:44.611285 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331ca59-c78c-498f-a2bb-aac86693e148 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:44.647766 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1763959-c12b-4681-9849-40415c69d137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:44.649023 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1763959-c12b-4681-9849-40415c69d137 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:44.649561 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1763959-c12b-4681-9849-40415c69d137 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:44.650030 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1763959-c12b-4681-9849-40415c69d137 None admin] PATH_INFO: `/v3/users/28f1ebbfa1aa4cdeba5e484248de0035` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:44.651511 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1763959-c12b-4681-9849-40415c69d137 None admin] RBAC: Authorizing `identity:get_user(user_id=28f1ebbfa1aa4cdeba5e484248de0035)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:44.653165 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1763959-c12b-4681-9849-40415c69d137 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:44.655500 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 162/315] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:44 2022] GET /identity/v3/users/28f1ebbfa1aa4cdeba5e484248de0035 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:44.664079 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3085df-4c0b-4230-9453-90e167080eb6 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:44.890604 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3085df-4c0b-4230-9453-90e167080eb6 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:44.928319 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e208a-d773-406a-81b9-23727f9d082a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:44.928976 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e208a-d773-406a-81b9-23727f9d082a None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:44.929258 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e208a-d773-406a-81b9-23727f9d082a None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:44.929560 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e208a-d773-406a-81b9-23727f9d082a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:44.995865 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e208a-d773-406a-81b9-23727f9d082a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:44.997374 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e208a-d773-406a-81b9-23727f9d082a None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:45.090983 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 154/316] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:38:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:45.096535 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1763959-c12b-4681-9849-40415c69d137 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:45.193772 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1763959-c12b-4681-9849-40415c69d137 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:45.226923 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb6743-8b36-4dce-8b55-e26c895c2ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:45.227811 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb6743-8b36-4dce-8b55-e26c895c2ee2 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:45.228091 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb6743-8b36-4dce-8b55-e26c895c2ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:45.228365 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb6743-8b36-4dce-8b55-e26c895c2ee2 None admin] PATH_INFO: `/v3/projects/cd5e8c45edab4920a609685e45710f9c` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:45.229610 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb6743-8b36-4dce-8b55-e26c895c2ee2 None admin] RBAC: Authorizing `identity:get_project(project_id=cd5e8c45edab4920a609685e45710f9c)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:45.231042 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb6743-8b36-4dce-8b55-e26c895c2ee2 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:45.237459 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 163/317] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:45 2022] GET /identity/v3/projects/cd5e8c45edab4920a609685e45710f9c => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:45.239066 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e208a-d773-406a-81b9-23727f9d082a None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:45.336163 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e208a-d773-406a-81b9-23727f9d082a None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:45.370676 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a256c-38c5-4df0-9332-191fcea82587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:45.371343 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a256c-38c5-4df0-9332-191fcea82587 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:45.371626 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a256c-38c5-4df0-9332-191fcea82587 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:45.371895 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a256c-38c5-4df0-9332-191fcea82587 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:45.372741 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a256c-38c5-4df0-9332-191fcea82587 None admin] RBAC: Adding query filter params (role.id=c1a7741dcd074a12bea71d598fec4554, scope.project.id=cd5e8c45edab4920a609685e45710f9c, user.id=28f1ebbfa1aa4cdeba5e484248de0035) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:45.373054 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a256c-38c5-4df0-9332-191fcea82587 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:45.374562 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a256c-38c5-4df0-9332-191fcea82587 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:45.385477 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 155/318] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:38:45 2022] GET /identity/v3/role_assignments?user.id=28f1ebbfa1aa4cdeba5e484248de0035&scope.project.id=cd5e8c45edab4920a609685e45710f9c&role.id=c1a7741dcd074a12bea71d598fec4554 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:45.940491 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8a037-6d01-4518-a2ce-10e257237175 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:45.940880 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8a037-6d01-4518-a2ce-10e257237175 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:45.941049 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8a037-6d01-4518-a2ce-10e257237175 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:45.943143 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 164/319] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:45.948460 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b4035-2342-4793-9a7b-a5f5d781ff99 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:45.948754 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b4035-2342-4793-9a7b-a5f5d781ff99 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:45.949034 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b4035-2342-4793-9a7b-a5f5d781ff99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:45.966228 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-db5b4035-2342-4793-9a7b-a5f5d781ff99 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:45.967431 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-db5b4035-2342-4793-9a7b-a5f5d781ff99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:46.034453 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 156/320] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:46.057248 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8a037-6d01-4518-a2ce-10e257237175 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:46.155909 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c8a037-6d01-4518-a2ce-10e257237175 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:46.188149 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac7972b-35f5-4779-8d3d-f824090fa3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:46.188932 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7972b-35f5-4779-8d3d-f824090fa3e2 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:46.189203 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7972b-35f5-4779-8d3d-f824090fa3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:46.189497 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac7972b-35f5-4779-8d3d-f824090fa3e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:46.190784 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7972b-35f5-4779-8d3d-f824090fa3e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:46.192250 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac7972b-35f5-4779-8d3d-f824090fa3e2 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:46.197441 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 165/321] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:38:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:46.200140 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b4035-2342-4793-9a7b-a5f5d781ff99 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:46.293733 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b4035-2342-4793-9a7b-a5f5d781ff99 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:46.331344 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d9a01-a692-450e-906a-b101be89ee51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:46.332004 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d9a01-a692-450e-906a-b101be89ee51 None admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:46.332280 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d9a01-a692-450e-906a-b101be89ee51 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:46.332527 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d9a01-a692-450e-906a-b101be89ee51 None admin] PATH_INFO: `/v3/groups` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:46.333221 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d9a01-a692-450e-906a-b101be89ee51 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:46.334686 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5d9a01-a692-450e-906a-b101be89ee51 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:46.350520 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 157/322] 10.222.0.18 () {60 vars in 1134 bytes} [Tue Mar 8 13:38:46 2022] POST /identity/v3/groups => generated 226 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:38:46.658838 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d740edf-869b-4b4c-b241-feac2fe5cf80 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:46.659245 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d740edf-869b-4b4c-b241-feac2fe5cf80 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:46.659373 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d740edf-869b-4b4c-b241-feac2fe5cf80 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:46.661847 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 166/323] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:46.666970 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74bd5c-7cfd-4741-b399-244a58fb8ea2 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:46.667257 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74bd5c-7cfd-4741-b399-244a58fb8ea2 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:46.667524 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74bd5c-7cfd-4741-b399-244a58fb8ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:46.685750 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-bc74bd5c-7cfd-4741-b399-244a58fb8ea2 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:46.686920 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-bc74bd5c-7cfd-4741-b399-244a58fb8ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:46.753957 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 158/324] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:38:46.776218 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d740edf-869b-4b4c-b241-feac2fe5cf80 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:46.890718 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d740edf-869b-4b4c-b241-feac2fe5cf80 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:46.904244 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bca02-6aa3-4aea-8463-65fd8fb69645 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:46.904545 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bca02-6aa3-4aea-8463-65fd8fb69645 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:46.904787 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34bca02-6aa3-4aea-8463-65fd8fb69645 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:46.906744 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 159/325] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:46.914223 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef7f83-352e-4497-8698-7a46c51c6bce None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:46.915259 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef7f83-352e-4497-8698-7a46c51c6bce None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:46.915886 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef7f83-352e-4497-8698-7a46c51c6bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:46.930403 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5af847-752b-43b5-94c4-ddc05e7a7276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:46.931207 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5af847-752b-43b5-94c4-ddc05e7a7276 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:46.931479 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5af847-752b-43b5-94c4-ddc05e7a7276 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:46.931743 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5af847-752b-43b5-94c4-ddc05e7a7276 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:46.937451 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-44ef7f83-352e-4497-8698-7a46c51c6bce None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:46.939035 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-44ef7f83-352e-4497-8698-7a46c51c6bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:46.943264 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5af847-752b-43b5-94c4-ddc05e7a7276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:46.949394 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-4a5af847-752b-43b5-94c4-ddc05e7a7276 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 13:38:46.950918 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 167/326] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:46.958328 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5af847-752b-43b5-94c4-ddc05e7a7276 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:47.021714 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 160/327] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:38:47.046933 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef7f83-352e-4497-8698-7a46c51c6bce None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:47.071643 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5af847-752b-43b5-94c4-ddc05e7a7276 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:47.108891 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f07ad7-8958-4d3f-8b49-54fed7c04889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:47.110536 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f07ad7-8958-4d3f-8b49-54fed7c04889 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:47.111066 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f07ad7-8958-4d3f-8b49-54fed7c04889 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:47.111613 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f07ad7-8958-4d3f-8b49-54fed7c04889 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:47.112738 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f07ad7-8958-4d3f-8b49-54fed7c04889 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:47.113262 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f07ad7-8958-4d3f-8b49-54fed7c04889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:47.115530 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f07ad7-8958-4d3f-8b49-54fed7c04889 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:47.126541 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 168/328] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:47.131835 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f07ad7-8958-4d3f-8b49-54fed7c04889 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:47.170119 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef7f83-352e-4497-8698-7a46c51c6bce None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:47.207946 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b7493-1b93-4067-a3a3-a2b6cb118a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:47.208740 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b7493-1b93-4067-a3a3-a2b6cb118a2f None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:47.209013 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b7493-1b93-4067-a3a3-a2b6cb118a2f None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:47.209280 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b7493-1b93-4067-a3a3-a2b6cb118a2f None admin] PATH_INFO: `/v3/roles/member` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:47.221387 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b7493-1b93-4067-a3a3-a2b6cb118a2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:47.229084 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-280b7493-1b93-4067-a3a3-a2b6cb118a2f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 13:38:47.230638 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 161/329] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:38:47.236387 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b7493-1b93-4067-a3a3-a2b6cb118a2f None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:47.259378 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f07ad7-8958-4d3f-8b49-54fed7c04889 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:47.296708 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8dfde6-3672-4296-98f6-f4ce39912dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:47.297992 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dfde6-3672-4296-98f6-f4ce39912dcb None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:47.298466 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dfde6-3672-4296-98f6-f4ce39912dcb None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:47.298989 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dfde6-3672-4296-98f6-f4ce39912dcb None admin] PATH_INFO: `/v3/users/075a2c538a36484d82c2ae5a853a21a9` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:47.300458 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8dfde6-3672-4296-98f6-f4ce39912dcb None admin] RBAC: Authorizing `identity:get_user(user_id=075a2c538a36484d82c2ae5a853a21a9)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:47.302222 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8dfde6-3672-4296-98f6-f4ce39912dcb None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:47.304420 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 169/330] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:47 2022] GET /identity/v3/users/075a2c538a36484d82c2ae5a853a21a9 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:47.312053 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8dfde6-3672-4296-98f6-f4ce39912dcb None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:47.342209 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b7493-1b93-4067-a3a3-a2b6cb118a2f None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:47.374467 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438be252-5d23-436d-a531-09a6f3bebb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:47.375135 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438be252-5d23-436d-a531-09a6f3bebb42 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:47.375410 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438be252-5d23-436d-a531-09a6f3bebb42 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:47.375679 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438be252-5d23-436d-a531-09a6f3bebb42 None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:47.376420 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438be252-5d23-436d-a531-09a6f3bebb42 None admin] RBAC: Adding query filter params (name=member) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:47.376722 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438be252-5d23-436d-a531-09a6f3bebb42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:47.378165 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438be252-5d23-436d-a531-09a6f3bebb42 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:47.386945 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 162/331] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:47.392470 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438be252-5d23-436d-a531-09a6f3bebb42 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:47.427437 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8dfde6-3672-4296-98f6-f4ce39912dcb None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:47.461918 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0f1ae-60a9-4d11-83f6-28a12c202b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:47.463136 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0f1ae-60a9-4d11-83f6-28a12c202b7e None admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:47.463633 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0f1ae-60a9-4d11-83f6-28a12c202b7e None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:47.464098 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0f1ae-60a9-4d11-83f6-28a12c202b7e None admin] PATH_INFO: `/v3/system/users/075a2c538a36484d82c2ae5a853a21a9/roles/c1a7741dcd074a12bea71d598fec4554` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:47.465818 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0f1ae-60a9-4d11-83f6-28a12c202b7e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=075a2c538a36484d82c2ae5a853a21a9, role_id=c1a7741dcd074a12bea71d598fec4554)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:47.467451 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a0f1ae-60a9-4d11-83f6-28a12c202b7e None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:47.486767 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 170/332] 10.222.0.18 () {58 vars in 1334 bytes} [Tue Mar 8 13:38:47 2022] PUT /identity/v3/system/users/075a2c538a36484d82c2ae5a853a21a9/roles/c1a7741dcd074a12bea71d598fec4554 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:38:47.494593 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438be252-5d23-436d-a531-09a6f3bebb42 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:47.531237 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47a0c8-9a71-47d8-a956-5665585c6ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:47.532190 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47a0c8-9a71-47d8-a956-5665585c6ba6 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:47.532468 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47a0c8-9a71-47d8-a956-5665585c6ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:47.532741 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47a0c8-9a71-47d8-a956-5665585c6ba6 None admin] PATH_INFO: `/v3/users/f056753e9a174543a1dbbe2bd1594e1f` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:47.534228 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47a0c8-9a71-47d8-a956-5665585c6ba6 None admin] RBAC: Authorizing `identity:get_user(user_id=f056753e9a174543a1dbbe2bd1594e1f)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:47.536113 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47a0c8-9a71-47d8-a956-5665585c6ba6 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:47.538279 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 163/333] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:47 2022] GET /identity/v3/users/f056753e9a174543a1dbbe2bd1594e1f => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:47.544241 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0f1ae-60a9-4d11-83f6-28a12c202b7e None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:47.661447 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0f1ae-60a9-4d11-83f6-28a12c202b7e None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:47.697454 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fb05d-3a66-474c-ba53-fdd350c50d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:47.698184 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fb05d-3a66-474c-ba53-fdd350c50d0f None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:47.698466 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fb05d-3a66-474c-ba53-fdd350c50d0f None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:47.698743 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fb05d-3a66-474c-ba53-fdd350c50d0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:47.699646 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fb05d-3a66-474c-ba53-fdd350c50d0f None admin] RBAC: Adding query filter params (role.id=0010e8da2d4b4bb8af05894096d2fc92, user.id=f056753e9a174543a1dbbe2bd1594e1f, scope.system=all) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:47.699948 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fb05d-3a66-474c-ba53-fdd350c50d0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:47.701444 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957fb05d-3a66-474c-ba53-fdd350c50d0f None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:47.719158 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 171/334] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Mar 8 13:38:47 2022] GET /identity/v3/role_assignments?user.id=f056753e9a174543a1dbbe2bd1594e1f&scope.system=all&role.id=0010e8da2d4b4bb8af05894096d2fc92 => generated 510 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:49.718740 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ece7fd-0fae-4124-9451-5cf4a227d0ca None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:49.719687 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ece7fd-0fae-4124-9451-5cf4a227d0ca None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:49.720145 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ece7fd-0fae-4124-9451-5cf4a227d0ca None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:49.722413 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 164/335] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:49.730178 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536cdef-fe58-4dc1-b9b1-d630166edf09 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:49.731274 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536cdef-fe58-4dc1-b9b1-d630166edf09 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:49.731758 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536cdef-fe58-4dc1-b9b1-d630166edf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:49.753462 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-8536cdef-fe58-4dc1-b9b1-d630166edf09 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:49.754961 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-8536cdef-fe58-4dc1-b9b1-d630166edf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:49.835770 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 172/336] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:38:49.875274 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ece7fd-0fae-4124-9451-5cf4a227d0ca None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:49.928766 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f83c65-3287-4682-aeff-60a05e481ba9 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:49.929434 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f83c65-3287-4682-aeff-60a05e481ba9 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:49.929918 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f83c65-3287-4682-aeff-60a05e481ba9 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:49.932107 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 173/337] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:38:49.939189 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ff40c-5b1a-4ea7-8bc8-a8f1f8578062 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:49.939808 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ff40c-5b1a-4ea7-8bc8-a8f1f8578062 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:49.940283 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ff40c-5b1a-4ea7-8bc8-a8f1f8578062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:49.965748 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-de2ff40c-5b1a-4ea7-8bc8-a8f1f8578062 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:49.968279 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-de2ff40c-5b1a-4ea7-8bc8-a8f1f8578062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:50.050174 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ece7fd-0fae-4124-9451-5cf4a227d0ca None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:50.086200 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4e862-adf6-4198-be01-3287be0b655d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:50.087433 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4e862-adf6-4198-be01-3287be0b655d None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:50.087939 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4e862-adf6-4198-be01-3287be0b655d None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:50.088427 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4e862-adf6-4198-be01-3287be0b655d None admin] PATH_INFO: `/v3/roles/member` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:50.090271 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 174/338] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:38:50.100778 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4e862-adf6-4198-be01-3287be0b655d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:50.107959 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-03d4e862-adf6-4198-be01-3287be0b655d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 13:38:50.109715 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 165/339] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:50.116016 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ff40c-5b1a-4ea7-8bc8-a8f1f8578062 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:50.136625 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4e862-adf6-4198-be01-3287be0b655d None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:50.220323 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ff40c-5b1a-4ea7-8bc8-a8f1f8578062 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:50.262007 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73326f-abf8-45d9-ad87-d3c4beea114e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:50.263039 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73326f-abf8-45d9-ad87-d3c4beea114e None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:50.263460 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73326f-abf8-45d9-ad87-d3c4beea114e None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:50.263856 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73326f-abf8-45d9-ad87-d3c4beea114e None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:50.264963 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73326f-abf8-45d9-ad87-d3c4beea114e None admin] RBAC: Adding query filter params (name=member) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:50.265438 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73326f-abf8-45d9-ad87-d3c4beea114e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:50.267594 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73326f-abf8-45d9-ad87-d3c4beea114e None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:50.293850 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 175/340] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:50.295218 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951d71e-a6f9-4066-bb70-c7bfe2cfe312 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:50.295501 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951d71e-a6f9-4066-bb70-c7bfe2cfe312 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:50.295769 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3951d71e-a6f9-4066-bb70-c7bfe2cfe312 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:50.298110 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 176/341] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:50.311030 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951d71e-a6f9-4066-bb70-c7bfe2cfe312 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:50.330449 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4e862-adf6-4198-be01-3287be0b655d None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:50.375779 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0d4d4-807d-44ed-b69c-d495d048425a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:50.376579 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0d4d4-807d-44ed-b69c-d495d048425a None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:50.377000 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0d4d4-807d-44ed-b69c-d495d048425a None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:50.377460 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0d4d4-807d-44ed-b69c-d495d048425a None admin] PATH_INFO: `/v3/roles/member` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:50.391463 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff0d4d4-807d-44ed-b69c-d495d048425a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:50.400037 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-1ff0d4d4-807d-44ed-b69c-d495d048425a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 13:38:50.401263 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 166/342] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:38:50.402462 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641c8a8-508b-4472-b31a-346627c91a77 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:50.402740 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641c8a8-508b-4472-b31a-346627c91a77 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:50.403010 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641c8a8-508b-4472-b31a-346627c91a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:50.423928 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-2641c8a8-508b-4472-b31a-346627c91a77 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:50.425440 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-2641c8a8-508b-4472-b31a-346627c91a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:50.482415 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3951d71e-a6f9-4066-bb70-c7bfe2cfe312 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:50.492201 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 167/343] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:50.492744 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641c8a8-508b-4472-b31a-346627c91a77 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:50.522343 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca29524-b6ea-4dec-ac52-f60631af6df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:50.523335 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca29524-b6ea-4dec-ac52-f60631af6df1 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:50.523839 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca29524-b6ea-4dec-ac52-f60631af6df1 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:50.524313 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca29524-b6ea-4dec-ac52-f60631af6df1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:50.590927 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641c8a8-508b-4472-b31a-346627c91a77 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:50.592279 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca29524-b6ea-4dec-ac52-f60631af6df1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:50.593964 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca29524-b6ea-4dec-ac52-f60631af6df1 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:50.626169 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10642fe4-66f2-487d-8302-ead98b18f356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:50.626858 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10642fe4-66f2-487d-8302-ead98b18f356 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:50.627131 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10642fe4-66f2-487d-8302-ead98b18f356 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:50.627394 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10642fe4-66f2-487d-8302-ead98b18f356 None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:50.628133 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10642fe4-66f2-487d-8302-ead98b18f356 None admin] RBAC: Adding query filter params (name=member) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:50.628432 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10642fe4-66f2-487d-8302-ead98b18f356 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:50.631703 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10642fe4-66f2-487d-8302-ead98b18f356 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:50.640082 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 168/344] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:50.641513 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f564e6-4216-4896-8d32-44896fa74a39 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:50.641638 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f564e6-4216-4896-8d32-44896fa74a39 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:50.641911 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f564e6-4216-4896-8d32-44896fa74a39 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:50.643825 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 169/345] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:50.644525 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f564e6-4216-4896-8d32-44896fa74a39 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:50.700794 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 177/346] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:38:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:50.702104 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca29524-b6ea-4dec-ac52-f60631af6df1 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:50.752870 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f564e6-4216-4896-8d32-44896fa74a39 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:50.785581 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5069656-5ffd-45d7-a239-39e0c36556a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:50.786370 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5069656-5ffd-45d7-a239-39e0c36556a4 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:50.786643 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5069656-5ffd-45d7-a239-39e0c36556a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:50.786907 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5069656-5ffd-45d7-a239-39e0c36556a4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:50.798139 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5069656-5ffd-45d7-a239-39e0c36556a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:50.804973 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca29524-b6ea-4dec-ac52-f60631af6df1 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:50.805465 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-e5069656-5ffd-45d7-a239-39e0c36556a4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Mar 08 13:38:50.806810 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 170/347] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:50.808167 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b91a0f-5e68-4fcb-ad97-e8a25663d02e None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:50.808654 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b91a0f-5e68-4fcb-ad97-e8a25663d02e None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:50.809128 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b91a0f-5e68-4fcb-ad97-e8a25663d02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:50.825848 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-d6b91a0f-5e68-4fcb-ad97-e8a25663d02e None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:50.827349 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-d6b91a0f-5e68-4fcb-ad97-e8a25663d02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:50.840454 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6056a-f608-47bf-bb4a-7f71bc9b1cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:50.841440 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6056a-f608-47bf-bb4a-7f71bc9b1cc2 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:50.841875 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6056a-f608-47bf-bb4a-7f71bc9b1cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:50.842325 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6056a-f608-47bf-bb4a-7f71bc9b1cc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:50.894858 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 171/348] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:50.895969 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b91a0f-5e68-4fcb-ad97-e8a25663d02e None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:50.917310 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6056a-f608-47bf-bb4a-7f71bc9b1cc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:50.923163 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a6056a-f608-47bf-bb4a-7f71bc9b1cc2 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:50.995070 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b91a0f-5e68-4fcb-ad97-e8a25663d02e None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:51.029559 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc28bda-4b2b-4e81-8823-afc60a529514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:51.030655 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc28bda-4b2b-4e81-8823-afc60a529514 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:51.031095 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc28bda-4b2b-4e81-8823-afc60a529514 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:51.031505 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc28bda-4b2b-4e81-8823-afc60a529514 None admin] PATH_INFO: `/v3/projects/cd5e8c45edab4920a609685e45710f9c` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:51.032898 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc28bda-4b2b-4e81-8823-afc60a529514 None admin] RBAC: Authorizing `identity:get_project(project_id=cd5e8c45edab4920a609685e45710f9c)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:51.035018 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc28bda-4b2b-4e81-8823-afc60a529514 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:51.037165 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 172/349] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:50 2022] GET /identity/v3/projects/cd5e8c45edab4920a609685e45710f9c => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:51.038099 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc28bda-4b2b-4e81-8823-afc60a529514 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:51.040995 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 178/350] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:38:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:51.042153 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6056a-f608-47bf-bb4a-7f71bc9b1cc2 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:51.139726 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc28bda-4b2b-4e81-8823-afc60a529514 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:51.140294 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a6056a-f608-47bf-bb4a-7f71bc9b1cc2 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:51.174142 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29fe90-d2b5-416e-ac8f-fd97446ebb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:51.175185 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29fe90-d2b5-416e-ac8f-fd97446ebb75 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:51.175616 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29fe90-d2b5-416e-ac8f-fd97446ebb75 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:51.175888 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e1bd6-166a-4fc7-8c27-f042a9d673a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:51.176194 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29fe90-d2b5-416e-ac8f-fd97446ebb75 None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:51.176910 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e1bd6-166a-4fc7-8c27-f042a9d673a2 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:51.177224 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29fe90-d2b5-416e-ac8f-fd97446ebb75 None admin] RBAC: Adding query filter params (name=reader) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:51.177329 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e1bd6-166a-4fc7-8c27-f042a9d673a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:51.177723 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e1bd6-166a-4fc7-8c27-f042a9d673a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:51.177925 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29fe90-d2b5-416e-ac8f-fd97446ebb75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:51.179456 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29fe90-d2b5-416e-ac8f-fd97446ebb75 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:51.188797 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 173/351] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:51.188986 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e1bd6-166a-4fc7-8c27-f042a9d673a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:51.190093 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29fe90-d2b5-416e-ac8f-fd97446ebb75 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:51.196731 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-661e1bd6-166a-4fc7-8c27-f042a9d673a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 13:38:51.198532 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 179/352] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Mar 8 13:38:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:51.199498 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e1bd6-166a-4fc7-8c27-f042a9d673a2 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:51.289652 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29fe90-d2b5-416e-ac8f-fd97446ebb75 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:51.305224 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e1bd6-166a-4fc7-8c27-f042a9d673a2 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:51.324598 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03205d-1fdc-4d06-9077-8849fe2d9854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:51.325472 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03205d-1fdc-4d06-9077-8849fe2d9854 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:51.325905 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03205d-1fdc-4d06-9077-8849fe2d9854 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:51.326310 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03205d-1fdc-4d06-9077-8849fe2d9854 None admin] PATH_INFO: `/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:51.327635 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03205d-1fdc-4d06-9077-8849fe2d9854 None admin] RBAC: Authorizing `identity:get_project(project_id=4b15a0b04df24a618ea34b84d6e6ddd2)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:51.329313 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca03205d-1fdc-4d06-9077-8849fe2d9854 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:51.334209 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 174/353] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:51 2022] GET /identity/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:51.334209 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03205d-1fdc-4d06-9077-8849fe2d9854 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:51.356087 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f829112-ecc5-4af4-92c5-cf387662a266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:51.356858 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f829112-ecc5-4af4-92c5-cf387662a266 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:51.357137 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f829112-ecc5-4af4-92c5-cf387662a266 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:51.357438 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f829112-ecc5-4af4-92c5-cf387662a266 None admin] PATH_INFO: `/v3/groups/6f0978ecefa847bcaf229a7b200881d6` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:51.364377 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f829112-ecc5-4af4-92c5-cf387662a266 None admin] RBAC: Authorizing `identity:get_group(group_id=6f0978ecefa847bcaf229a7b200881d6)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:51.366495 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f829112-ecc5-4af4-92c5-cf387662a266 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:51.368517 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 180/354] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Mar 8 13:38:51 2022] GET /identity/v3/groups/6f0978ecefa847bcaf229a7b200881d6 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:51.369292 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f829112-ecc5-4af4-92c5-cf387662a266 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:51.445455 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03205d-1fdc-4d06-9077-8849fe2d9854 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:51.489420 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd0c53-adef-49bc-8dc8-a4b46815afb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:51.490439 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd0c53-adef-49bc-8dc8-a4b46815afb2 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:51.490809 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd0c53-adef-49bc-8dc8-a4b46815afb2 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:51.491186 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd0c53-adef-49bc-8dc8-a4b46815afb2 None admin] PATH_INFO: `/v3/users/075a2c538a36484d82c2ae5a853a21a9` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:51.491382 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f829112-ecc5-4af4-92c5-cf387662a266 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:51.492564 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd0c53-adef-49bc-8dc8-a4b46815afb2 None admin] RBAC: Authorizing `identity:get_user(user_id=075a2c538a36484d82c2ae5a853a21a9)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:51.495124 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd0c53-adef-49bc-8dc8-a4b46815afb2 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:51.497169 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 175/355] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:38:51 2022] GET /identity/v3/users/075a2c538a36484d82c2ae5a853a21a9 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:51.501808 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddff58-b755-4710-ab9d-3bdc14f058c8 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:51.502208 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddff58-b755-4710-ab9d-3bdc14f058c8 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:51.502573 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddff58-b755-4710-ab9d-3bdc14f058c8 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:51.504763 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 176/356] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:51.506002 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddff58-b755-4710-ab9d-3bdc14f058c8 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:51.537799 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b9c0b-f60a-4893-b4b5-3a3b50e0ab96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:51.538478 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b9c0b-f60a-4893-b4b5-3a3b50e0ab96 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:51.538762 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b9c0b-f60a-4893-b4b5-3a3b50e0ab96 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:51.539034 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b9c0b-f60a-4893-b4b5-3a3b50e0ab96 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:51.539787 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b9c0b-f60a-4893-b4b5-3a3b50e0ab96 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:51.540098 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b9c0b-f60a-4893-b4b5-3a3b50e0ab96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:51.541505 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b9c0b-f60a-4893-b4b5-3a3b50e0ab96 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:51.550507 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 181/357] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:38:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:51.551170 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b9c0b-f60a-4893-b4b5-3a3b50e0ab96 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:51.641284 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddff58-b755-4710-ab9d-3bdc14f058c8 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:51.673583 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b9c0b-f60a-4893-b4b5-3a3b50e0ab96 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:51.684821 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e7ea7-cea3-4dde-b5f5-ae0bffb16354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:51.686320 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e7ea7-cea3-4dde-b5f5-ae0bffb16354 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:51.686320 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e7ea7-cea3-4dde-b5f5-ae0bffb16354 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:51.686320 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e7ea7-cea3-4dde-b5f5-ae0bffb16354 None admin] PATH_INFO: `/v3/groups/6f0978ecefa847bcaf229a7b200881d6` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:51.687455 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e7ea7-cea3-4dde-b5f5-ae0bffb16354 None admin] RBAC: Authorizing `identity:get_group(group_id=6f0978ecefa847bcaf229a7b200881d6)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:51.688906 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e7ea7-cea3-4dde-b5f5-ae0bffb16354 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:51.691615 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 177/358] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Mar 8 13:38:51 2022] GET /identity/v3/groups/6f0978ecefa847bcaf229a7b200881d6 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:51.692373 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e7ea7-cea3-4dde-b5f5-ae0bffb16354 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:51.711513 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832537f7-6162-42ec-8e90-559adbe8a4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:51.712091 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832537f7-6162-42ec-8e90-559adbe8a4da None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:51.712375 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832537f7-6162-42ec-8e90-559adbe8a4da None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:51.712651 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832537f7-6162-42ec-8e90-559adbe8a4da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:51.713519 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832537f7-6162-42ec-8e90-559adbe8a4da None admin] RBAC: Adding query filter params (group.id=6f0978ecefa847bcaf229a7b200881d6, role.id=0010e8da2d4b4bb8af05894096d2fc92, scope.project.id=cd5e8c45edab4920a609685e45710f9c) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:51.713830 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832537f7-6162-42ec-8e90-559adbe8a4da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:51.715320 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832537f7-6162-42ec-8e90-559adbe8a4da None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:51.721058 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 182/359] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Mar 8 13:38:51 2022] GET /identity/v3/role_assignments?group.id=6f0978ecefa847bcaf229a7b200881d6&scope.project.id=cd5e8c45edab4920a609685e45710f9c&role.id=0010e8da2d4b4bb8af05894096d2fc92 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:51.722309 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10e24e-a9af-40f7-ac86-7d1e82435d77 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:51.722626 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10e24e-a9af-40f7-ac86-7d1e82435d77 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:51.722966 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10e24e-a9af-40f7-ac86-7d1e82435d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:51.740691 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-5c10e24e-a9af-40f7-ac86-7d1e82435d77 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:51.741945 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-5c10e24e-a9af-40f7-ac86-7d1e82435d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:51.815271 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e7ea7-cea3-4dde-b5f5-ae0bffb16354 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:51.822220 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 183/360] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:51.829399 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10e24e-a9af-40f7-ac86-7d1e82435d77 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:51.856231 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3228ab4-dc09-4c90-b40b-34ae07b32103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:51.856911 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3228ab4-dc09-4c90-b40b-34ae07b32103 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:51.857191 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3228ab4-dc09-4c90-b40b-34ae07b32103 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:51.857506 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3228ab4-dc09-4c90-b40b-34ae07b32103 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:51.858351 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3228ab4-dc09-4c90-b40b-34ae07b32103 None admin] RBAC: Adding query filter params (role.id=c1a7741dcd074a12bea71d598fec4554, user.id=075a2c538a36484d82c2ae5a853a21a9, scope.system=all) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:51.858663 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3228ab4-dc09-4c90-b40b-34ae07b32103 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:51.860528 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3228ab4-dc09-4c90-b40b-34ae07b32103 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:51.875744 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 178/361] 10.222.0.18 () {56 vars in 1308 bytes} [Tue Mar 8 13:38:51 2022] GET /identity/v3/role_assignments?user.id=075a2c538a36484d82c2ae5a853a21a9&scope.system=all&role.id=c1a7741dcd074a12bea71d598fec4554 => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:51.878133 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df839ead-b400-4b5c-b11a-9f1e93db670d None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:51.878698 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df839ead-b400-4b5c-b11a-9f1e93db670d None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:51.879640 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df839ead-b400-4b5c-b11a-9f1e93db670d None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:51.882965 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 179/362] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:51.884303 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df839ead-b400-4b5c-b11a-9f1e93db670d None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:51.958794 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10e24e-a9af-40f7-ac86-7d1e82435d77 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:52.000462 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a3b87-037f-4768-a8de-ea88a32a3a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:52.001451 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a3b87-037f-4768-a8de-ea88a32a3a95 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:52.001933 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a3b87-037f-4768-a8de-ea88a32a3a95 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:52.002432 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a3b87-037f-4768-a8de-ea88a32a3a95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:52.007967 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df839ead-b400-4b5c-b11a-9f1e93db670d None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:52.046722 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b8812-e061-489f-b9a4-fa4426f61f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:52.047614 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b8812-e061-489f-b9a4-fa4426f61f01 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:52.047724 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b8812-e061-489f-b9a4-fa4426f61f01 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:52.047922 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b8812-e061-489f-b9a4-fa4426f61f01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:52.048817 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b8812-e061-489f-b9a4-fa4426f61f01 None admin] RBAC: Adding query filter params (group.id=6f0978ecefa847bcaf229a7b200881d6, role.id=0010e8da2d4b4bb8af05894096d2fc92, scope.project.id=4b15a0b04df24a618ea34b84d6e6ddd2) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:52.049123 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b8812-e061-489f-b9a4-fa4426f61f01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:52.050666 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b8812-e061-489f-b9a4-fa4426f61f01 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:52.057376 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 180/363] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Mar 8 13:38:51 2022] GET /identity/v3/role_assignments?group.id=6f0978ecefa847bcaf229a7b200881d6&scope.project.id=4b15a0b04df24a618ea34b84d6e6ddd2&role.id=0010e8da2d4b4bb8af05894096d2fc92 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:52.058152 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b8812-e061-489f-b9a4-fa4426f61f01 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:52.079003 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a3b87-037f-4768-a8de-ea88a32a3a95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:52.080946 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a3b87-037f-4768-a8de-ea88a32a3a95 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:52.177345 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b8812-e061-489f-b9a4-fa4426f61f01 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:52.215740 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 184/364] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:38:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:52.217661 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f2150-9fd9-4eda-9ebb-23ef477344f1 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:52.217952 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f2150-9fd9-4eda-9ebb-23ef477344f1 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:52.218230 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f2150-9fd9-4eda-9ebb-23ef477344f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:52.221336 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde4836-b839-4200-9d31-3af00eaf58d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:52.222279 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde4836-b839-4200-9d31-3af00eaf58d6 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:52.222553 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde4836-b839-4200-9d31-3af00eaf58d6 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:52.222822 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adde4836-b839-4200-9d31-3af00eaf58d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:52.235753 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adde4836-b839-4200-9d31-3af00eaf58d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:52.237075 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-c85f2150-9fd9-4eda-9ebb-23ef477344f1 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:52.238333 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-c85f2150-9fd9-4eda-9ebb-23ef477344f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:52.244379 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-adde4836-b839-4200-9d31-3af00eaf58d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 13:38:52.245726 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 181/365] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Mar 8 13:38:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:52.246569 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde4836-b839-4200-9d31-3af00eaf58d6 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:52.325297 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 185/366] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:52.326200 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f2150-9fd9-4eda-9ebb-23ef477344f1 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:52.358206 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adde4836-b839-4200-9d31-3af00eaf58d6 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:52.395674 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e8cb3-20b8-4a59-af5e-77274563153b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:52.396546 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e8cb3-20b8-4a59-af5e-77274563153b None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:52.396827 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e8cb3-20b8-4a59-af5e-77274563153b None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:52.397103 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e8cb3-20b8-4a59-af5e-77274563153b None admin] PATH_INFO: `/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:52.398500 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e8cb3-20b8-4a59-af5e-77274563153b None admin] RBAC: Authorizing `identity:get_project(project_id=4b15a0b04df24a618ea34b84d6e6ddd2)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:52.400013 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e8cb3-20b8-4a59-af5e-77274563153b None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:52.401742 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 182/367] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:52 2022] GET /identity/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:52.406143 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e8cb3-20b8-4a59-af5e-77274563153b None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:52.440334 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f2150-9fd9-4eda-9ebb-23ef477344f1 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:52.488812 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de1df6-4653-40ee-b217-627a0c9e5d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:52.489517 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de1df6-4653-40ee-b217-627a0c9e5d79 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:52.489793 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de1df6-4653-40ee-b217-627a0c9e5d79 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:52.490057 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de1df6-4653-40ee-b217-627a0c9e5d79 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:52.490812 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de1df6-4653-40ee-b217-627a0c9e5d79 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:52.491107 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de1df6-4653-40ee-b217-627a0c9e5d79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:52.492451 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de1df6-4653-40ee-b217-627a0c9e5d79 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:52.509735 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 186/368] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:38:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:52.511000 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de1df6-4653-40ee-b217-627a0c9e5d79 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:52.532239 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e8cb3-20b8-4a59-af5e-77274563153b None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:52.572895 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176e3a8-62d4-4024-a1c8-f64737a0cac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:52.573739 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176e3a8-62d4-4024-a1c8-f64737a0cac0 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:52.574019 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176e3a8-62d4-4024-a1c8-f64737a0cac0 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:52.574290 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176e3a8-62d4-4024-a1c8-f64737a0cac0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:52.588163 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176e3a8-62d4-4024-a1c8-f64737a0cac0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:52.596339 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-4176e3a8-62d4-4024-a1c8-f64737a0cac0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:38:52.597942 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 183/369] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:38:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:52.598711 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176e3a8-62d4-4024-a1c8-f64737a0cac0 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:52.622460 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de1df6-4653-40ee-b217-627a0c9e5d79 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:52.665702 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbefaa-2881-4bbc-af19-c798a19e3ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:52.666831 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbefaa-2881-4bbc-af19-c798a19e3ce3 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:52.667272 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbefaa-2881-4bbc-af19-c798a19e3ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:52.667693 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbefaa-2881-4bbc-af19-c798a19e3ce3 None admin] PATH_INFO: `/v3/groups/6f0978ecefa847bcaf229a7b200881d6` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:52.669037 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbefaa-2881-4bbc-af19-c798a19e3ce3 None admin] RBAC: Authorizing `identity:get_group(group_id=6f0978ecefa847bcaf229a7b200881d6)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:52.670662 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbefaa-2881-4bbc-af19-c798a19e3ce3 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:52.673949 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 187/370] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Mar 8 13:38:52 2022] GET /identity/v3/groups/6f0978ecefa847bcaf229a7b200881d6 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:52.674919 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbefaa-2881-4bbc-af19-c798a19e3ce3 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:52.718426 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176e3a8-62d4-4024-a1c8-f64737a0cac0 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:52.754360 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d172190-4c25-4b86-8ab7-5321efeb43c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:52.755010 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d172190-4c25-4b86-8ab7-5321efeb43c0 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:52.755286 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d172190-4c25-4b86-8ab7-5321efeb43c0 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:52.755555 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d172190-4c25-4b86-8ab7-5321efeb43c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:52.802920 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbefaa-2881-4bbc-af19-c798a19e3ce3 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:52.834097 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d172190-4c25-4b86-8ab7-5321efeb43c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:52.835792 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d172190-4c25-4b86-8ab7-5321efeb43c0 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:52.837636 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ee141-c04d-468d-89ee-4a4f49c27734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:52.838865 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ee141-c04d-468d-89ee-4a4f49c27734 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:52.839295 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ee141-c04d-468d-89ee-4a4f49c27734 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:52.839710 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ee141-c04d-468d-89ee-4a4f49c27734 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:52.840669 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ee141-c04d-468d-89ee-4a4f49c27734 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:52.841176 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ee141-c04d-468d-89ee-4a4f49c27734 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:52.842756 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ee141-c04d-468d-89ee-4a4f49c27734 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:52.851915 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 188/371] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:52.852942 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ee141-c04d-468d-89ee-4a4f49c27734 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:52.960222 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 184/372] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:38:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:52.960222 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d172190-4c25-4b86-8ab7-5321efeb43c0 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:52.963778 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ee141-c04d-468d-89ee-4a4f49c27734 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:52.999996 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1c62c-a548-4a87-a8d8-d5a2ef8b6943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:53.000979 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1c62c-a548-4a87-a8d8-d5a2ef8b6943 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:53.001511 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1c62c-a548-4a87-a8d8-d5a2ef8b6943 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:53.001958 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e1c62c-a548-4a87-a8d8-d5a2ef8b6943 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:53.003047 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1c62c-a548-4a87-a8d8-d5a2ef8b6943 None admin] RBAC: Adding query filter params (group.id=6f0978ecefa847bcaf229a7b200881d6, role.id=cbd629eb0cbe4cc7b69cc790228cdfc8, scope.project.id=4b15a0b04df24a618ea34b84d6e6ddd2) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:53.003530 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1c62c-a548-4a87-a8d8-d5a2ef8b6943 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:53.005116 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e1c62c-a548-4a87-a8d8-d5a2ef8b6943 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:53.011849 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 189/373] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Mar 8 13:38:52 2022] GET /identity/v3/role_assignments?group.id=6f0978ecefa847bcaf229a7b200881d6&scope.project.id=4b15a0b04df24a618ea34b84d6e6ddd2&role.id=cbd629eb0cbe4cc7b69cc790228cdfc8 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:53.012905 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1c62c-a548-4a87-a8d8-d5a2ef8b6943 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:53.117206 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d172190-4c25-4b86-8ab7-5321efeb43c0 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:53.174587 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae3cc9-1e62-48b7-aa83-3fe4abc51a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:53.175260 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae3cc9-1e62-48b7-aa83-3fe4abc51a74 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:53.175508 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae3cc9-1e62-48b7-aa83-3fe4abc51a74 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:53.175827 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae3cc9-1e62-48b7-aa83-3fe4abc51a74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:53.185904 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e1c62c-a548-4a87-a8d8-d5a2ef8b6943 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:53.228971 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b910d55-8f85-4d6f-937e-2605534f3a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:53.230211 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b910d55-8f85-4d6f-937e-2605534f3a29 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:53.230665 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b910d55-8f85-4d6f-937e-2605534f3a29 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:53.231130 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b910d55-8f85-4d6f-937e-2605534f3a29 None admin] PATH_INFO: `/v3/projects/cd5e8c45edab4920a609685e45710f9c` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:53.238297 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b910d55-8f85-4d6f-937e-2605534f3a29 None admin] RBAC: Authorizing `identity:get_project(project_id=cd5e8c45edab4920a609685e45710f9c)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:53.240033 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b910d55-8f85-4d6f-937e-2605534f3a29 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:53.242350 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 190/374] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:53 2022] GET /identity/v3/projects/cd5e8c45edab4920a609685e45710f9c => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:53.248255 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b910d55-8f85-4d6f-937e-2605534f3a29 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:53.266304 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae3cc9-1e62-48b7-aa83-3fe4abc51a74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:53.268729 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae3cc9-1e62-48b7-aa83-3fe4abc51a74 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:53.383256 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b910d55-8f85-4d6f-937e-2605534f3a29 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:53.399872 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 185/375] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:38:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:53.405523 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae3cc9-1e62-48b7-aa83-3fe4abc51a74 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:53.419828 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc9db7-60b6-464e-86f0-9e56df20b218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:53.420681 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc9db7-60b6-464e-86f0-9e56df20b218 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:53.420952 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc9db7-60b6-464e-86f0-9e56df20b218 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:53.421215 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc9db7-60b6-464e-86f0-9e56df20b218 None admin] PATH_INFO: `/v3/groups/6f0978ecefa847bcaf229a7b200881d6` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:53.422398 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc9db7-60b6-464e-86f0-9e56df20b218 None admin] RBAC: Authorizing `identity:get_group(group_id=6f0978ecefa847bcaf229a7b200881d6)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:53.423965 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc9db7-60b6-464e-86f0-9e56df20b218 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:53.425985 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 191/376] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Mar 8 13:38:53 2022] GET /identity/v3/groups/6f0978ecefa847bcaf229a7b200881d6 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:53.431693 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc9db7-60b6-464e-86f0-9e56df20b218 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:53.545565 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc9db7-60b6-464e-86f0-9e56df20b218 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:53.581940 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28797e7e-3a5f-41f7-82fd-1e56705f5029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:53.582682 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28797e7e-3a5f-41f7-82fd-1e56705f5029 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:53.583014 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28797e7e-3a5f-41f7-82fd-1e56705f5029 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:53.583279 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28797e7e-3a5f-41f7-82fd-1e56705f5029 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:53.584392 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28797e7e-3a5f-41f7-82fd-1e56705f5029 None admin] RBAC: Adding query filter params (group.id=6f0978ecefa847bcaf229a7b200881d6, role.id=cbd629eb0cbe4cc7b69cc790228cdfc8, scope.project.id=cd5e8c45edab4920a609685e45710f9c) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:53.584852 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28797e7e-3a5f-41f7-82fd-1e56705f5029 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:53.587439 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28797e7e-3a5f-41f7-82fd-1e56705f5029 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:53.596721 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 192/377] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Mar 8 13:38:53 2022] GET /identity/v3/role_assignments?group.id=6f0978ecefa847bcaf229a7b200881d6&scope.project.id=cd5e8c45edab4920a609685e45710f9c&role.id=cbd629eb0cbe4cc7b69cc790228cdfc8 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:53.619607 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae3cc9-1e62-48b7-aa83-3fe4abc51a74 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:53.657506 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29301d5b-c28d-4cb6-aab9-cb9b91877937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:53.658511 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29301d5b-c28d-4cb6-aab9-cb9b91877937 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:53.658834 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29301d5b-c28d-4cb6-aab9-cb9b91877937 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:53.659113 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29301d5b-c28d-4cb6-aab9-cb9b91877937 None admin] PATH_INFO: `/v3/projects/bb5233956b7746bc8c923776ec1a970c` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:53.660678 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29301d5b-c28d-4cb6-aab9-cb9b91877937 None admin] RBAC: Authorizing `identity:get_project(project_id=bb5233956b7746bc8c923776ec1a970c)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:53.662193 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29301d5b-c28d-4cb6-aab9-cb9b91877937 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:53.664188 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 186/378] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:53 2022] GET /identity/v3/projects/bb5233956b7746bc8c923776ec1a970c => generated 344 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:53.669868 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28797e7e-3a5f-41f7-82fd-1e56705f5029 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:53.786108 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28797e7e-3a5f-41f7-82fd-1e56705f5029 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:53.823734 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8ccf2-da4e-46a3-b6ff-172b2e892305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:53.824651 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8ccf2-da4e-46a3-b6ff-172b2e892305 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:53.824933 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8ccf2-da4e-46a3-b6ff-172b2e892305 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:53.825204 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8ccf2-da4e-46a3-b6ff-172b2e892305 None admin] PATH_INFO: `/v3/groups/ce71ab5ba2f848aa98e464707fb22b10` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:53.833855 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8ccf2-da4e-46a3-b6ff-172b2e892305 None admin] RBAC: Authorizing `identity:get_group(group_id=ce71ab5ba2f848aa98e464707fb22b10)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:53.835384 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8ccf2-da4e-46a3-b6ff-172b2e892305 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:53.837539 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 193/379] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Mar 8 13:38:53 2022] GET /identity/v3/groups/ce71ab5ba2f848aa98e464707fb22b10 => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:53.843458 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29301d5b-c28d-4cb6-aab9-cb9b91877937 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:53.964932 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29301d5b-c28d-4cb6-aab9-cb9b91877937 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:54.002106 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019a31c1-f0b8-45a7-b505-db6876652758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:54.002841 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a31c1-f0b8-45a7-b505-db6876652758 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:54.003124 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a31c1-f0b8-45a7-b505-db6876652758 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:54.003398 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019a31c1-f0b8-45a7-b505-db6876652758 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:54.004250 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a31c1-f0b8-45a7-b505-db6876652758 None admin] RBAC: Adding query filter params (group.id=ce71ab5ba2f848aa98e464707fb22b10, role.id=fc021ed5870a44f5a0f0b8fff994d6f0, scope.project.id=bb5233956b7746bc8c923776ec1a970c) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:54.004567 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a31c1-f0b8-45a7-b505-db6876652758 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:54.006068 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019a31c1-f0b8-45a7-b505-db6876652758 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:54.012304 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 187/380] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Mar 8 13:38:53 2022] GET /identity/v3/role_assignments?group.id=ce71ab5ba2f848aa98e464707fb22b10&scope.project.id=bb5233956b7746bc8c923776ec1a970c&role.id=fc021ed5870a44f5a0f0b8fff994d6f0 => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:54.545338 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4237b5c-bc9e-408c-b283-26a1c1357a36 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:54.546309 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4237b5c-bc9e-408c-b283-26a1c1357a36 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:54.546782 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4237b5c-bc9e-408c-b283-26a1c1357a36 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:54.549136 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 194/381] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:54.555378 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fec2a-2fa4-4211-97e7-e428f0a3d903 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:54.555671 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fec2a-2fa4-4211-97e7-e428f0a3d903 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:54.555947 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fec2a-2fa4-4211-97e7-e428f0a3d903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:54.575787 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-3c7fec2a-2fa4-4211-97e7-e428f0a3d903 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:54.577301 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-3c7fec2a-2fa4-4211-97e7-e428f0a3d903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:54.655829 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 188/382] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:54.701196 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4237b5c-bc9e-408c-b283-26a1c1357a36 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:54.807826 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4237b5c-bc9e-408c-b283-26a1c1357a36 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:54.842214 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fc514-388b-4362-a2da-a2d7f4aa644c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:54.843462 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fc514-388b-4362-a2da-a2d7f4aa644c None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:54.843948 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fc514-388b-4362-a2da-a2d7f4aa644c None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:54.844452 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fc514-388b-4362-a2da-a2d7f4aa644c None admin] PATH_INFO: `/v3/roles/member` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:54.854670 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fc514-388b-4362-a2da-a2d7f4aa644c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:54.862084 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-135fc514-388b-4362-a2da-a2d7f4aa644c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 13:38:54.863524 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 195/383] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:54.869385 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fec2a-2fa4-4211-97e7-e428f0a3d903 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:54.974889 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fec2a-2fa4-4211-97e7-e428f0a3d903 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:54.976561 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8111b-929e-4c8f-a26f-effdda51e5a3 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:54.977091 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8111b-929e-4c8f-a26f-effdda51e5a3 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:54.977590 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8111b-929e-4c8f-a26f-effdda51e5a3 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:54.979819 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 196/384] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:54.984763 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c63f21-f46e-443d-b3d2-d8ad219ab97c None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:54.985286 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c63f21-f46e-443d-b3d2-d8ad219ab97c None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:54.985884 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c63f21-f46e-443d-b3d2-d8ad219ab97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:55.013438 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-67c63f21-f46e-443d-b3d2-d8ad219ab97c None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:55.015167 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-67c63f21-f46e-443d-b3d2-d8ad219ab97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:55.019645 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618f872-e6f7-4f97-b9ec-540e0cb07c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:55.020373 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618f872-e6f7-4f97-b9ec-540e0cb07c9c None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:55.020650 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618f872-e6f7-4f97-b9ec-540e0cb07c9c None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:55.020922 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618f872-e6f7-4f97-b9ec-540e0cb07c9c None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:55.021759 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618f872-e6f7-4f97-b9ec-540e0cb07c9c None admin] RBAC: Adding query filter params (name=member) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:55.022061 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618f872-e6f7-4f97-b9ec-540e0cb07c9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:55.023437 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618f872-e6f7-4f97-b9ec-540e0cb07c9c None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:55.041648 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 189/385] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:55.047990 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618f872-e6f7-4f97-b9ec-540e0cb07c9c None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:55.135880 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 197/386] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:55.159659 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618f872-e6f7-4f97-b9ec-540e0cb07c9c None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:55.177152 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c63f21-f46e-443d-b3d2-d8ad219ab97c None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:55.196022 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ca740-f0ee-461b-bd12-453483e123e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:55.198689 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ca740-f0ee-461b-bd12-453483e123e3 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:55.199187 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ca740-f0ee-461b-bd12-453483e123e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:55.200397 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ca740-f0ee-461b-bd12-453483e123e3 None admin] PATH_INFO: `/v3/groups/6f0978ecefa847bcaf229a7b200881d6` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:55.202612 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ca740-f0ee-461b-bd12-453483e123e3 None admin] RBAC: Authorizing `identity:get_group(group_id=6f0978ecefa847bcaf229a7b200881d6)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:55.205722 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ca740-f0ee-461b-bd12-453483e123e3 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:55.215683 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 190/387] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Mar 8 13:38:55 2022] GET /identity/v3/groups/6f0978ecefa847bcaf229a7b200881d6 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:55.218184 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ca740-f0ee-461b-bd12-453483e123e3 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:55.336564 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c63f21-f46e-443d-b3d2-d8ad219ab97c None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:55.375945 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00a79e-74cc-4585-991f-99ea1353c925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:55.376806 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00a79e-74cc-4585-991f-99ea1353c925 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:55.377083 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00a79e-74cc-4585-991f-99ea1353c925 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:55.377370 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00a79e-74cc-4585-991f-99ea1353c925 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:55.388885 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00a79e-74cc-4585-991f-99ea1353c925 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:55.397445 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-5e00a79e-74cc-4585-991f-99ea1353c925 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 13:38:55.399502 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 198/388] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:38:55.401460 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ca740-f0ee-461b-bd12-453483e123e3 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:55.406308 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00a79e-74cc-4585-991f-99ea1353c925 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:55.444836 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ebb58-40e7-457a-a3b7-8361e02977a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:55.446055 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ebb58-40e7-457a-a3b7-8361e02977a8 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:55.446501 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ebb58-40e7-457a-a3b7-8361e02977a8 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:55.446960 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ebb58-40e7-457a-a3b7-8361e02977a8 None admin] PATH_INFO: `/v3/projects/cd5e8c45edab4920a609685e45710f9c` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:55.448311 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ebb58-40e7-457a-a3b7-8361e02977a8 None admin] RBAC: Authorizing `identity:get_project(project_id=cd5e8c45edab4920a609685e45710f9c)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:55.449966 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ebb58-40e7-457a-a3b7-8361e02977a8 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:55.452107 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 191/389] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:55 2022] GET /identity/v3/projects/cd5e8c45edab4920a609685e45710f9c => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:55.457876 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ebb58-40e7-457a-a3b7-8361e02977a8 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:55.520961 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00a79e-74cc-4585-991f-99ea1353c925 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:55.557273 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dbf10-07eb-4a85-b889-78d525da5da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:55.558033 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dbf10-07eb-4a85-b889-78d525da5da9 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:55.558243 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dbf10-07eb-4a85-b889-78d525da5da9 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:55.558512 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6dbf10-07eb-4a85-b889-78d525da5da9 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:55.559259 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6dbf10-07eb-4a85-b889-78d525da5da9 None admin] RBAC: Adding query filter params (name=member) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:55.559556 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6dbf10-07eb-4a85-b889-78d525da5da9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:55.560970 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6dbf10-07eb-4a85-b889-78d525da5da9 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:55.563202 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ebb58-40e7-457a-a3b7-8361e02977a8 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:55.570211 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 199/390] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:55.575206 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dbf10-07eb-4a85-b889-78d525da5da9 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:55.604709 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc20be2-277b-4096-a667-78926c2cda7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:55.605878 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc20be2-277b-4096-a667-78926c2cda7d None admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:55.606292 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc20be2-277b-4096-a667-78926c2cda7d None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:55.606722 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc20be2-277b-4096-a667-78926c2cda7d None admin] PATH_INFO: `/v3/projects/cd5e8c45edab4920a609685e45710f9c/groups/6f0978ecefa847bcaf229a7b200881d6/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:55.608830 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc20be2-277b-4096-a667-78926c2cda7d None admin] RBAC: Authorizing `identity:create_grant(project_id=cd5e8c45edab4920a609685e45710f9c, group_id=6f0978ecefa847bcaf229a7b200881d6, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:55.610631 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc20be2-277b-4096-a667-78926c2cda7d None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:55.631847 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 192/391] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Mar 8 13:38:55 2022] PUT /identity/v3/projects/cd5e8c45edab4920a609685e45710f9c/groups/6f0978ecefa847bcaf229a7b200881d6/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:38:55.687770 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6dbf10-07eb-4a85-b889-78d525da5da9 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:55.723366 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fc9a0-3a78-46ee-bbd5-3e6eecdbd14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:55.724234 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fc9a0-3a78-46ee-bbd5-3e6eecdbd14c None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:55.724513 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fc9a0-3a78-46ee-bbd5-3e6eecdbd14c None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:55.724830 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fc9a0-3a78-46ee-bbd5-3e6eecdbd14c None admin] PATH_INFO: `/v3/groups/6f0978ecefa847bcaf229a7b200881d6` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:55.726149 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fc9a0-3a78-46ee-bbd5-3e6eecdbd14c None admin] RBAC: Authorizing `identity:get_group(group_id=6f0978ecefa847bcaf229a7b200881d6)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:55.727639 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860fc9a0-3a78-46ee-bbd5-3e6eecdbd14c None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:55.729645 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 200/392] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Mar 8 13:38:55 2022] GET /identity/v3/groups/6f0978ecefa847bcaf229a7b200881d6 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:55.735408 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc20be2-277b-4096-a667-78926c2cda7d None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:55.891589 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc20be2-277b-4096-a667-78926c2cda7d None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:55.931982 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad0f6a-5208-4fc4-b80e-2b703a75e67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:55.932861 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad0f6a-5208-4fc4-b80e-2b703a75e67b None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:55.933138 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad0f6a-5208-4fc4-b80e-2b703a75e67b None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:55.933455 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad0f6a-5208-4fc4-b80e-2b703a75e67b None admin] PATH_INFO: `/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:55.934666 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad0f6a-5208-4fc4-b80e-2b703a75e67b None admin] RBAC: Authorizing `identity:get_project(project_id=4b15a0b04df24a618ea34b84d6e6ddd2)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:55.936201 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad0f6a-5208-4fc4-b80e-2b703a75e67b None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:55.938409 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 193/393] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:55 2022] GET /identity/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:55.944466 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fc9a0-3a78-46ee-bbd5-3e6eecdbd14c None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:56.047892 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fc9a0-3a78-46ee-bbd5-3e6eecdbd14c None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:56.081179 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ab033-ddd9-4b60-9e5b-3dc33edbb540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:56.082100 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ab033-ddd9-4b60-9e5b-3dc33edbb540 None admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:56.082375 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ab033-ddd9-4b60-9e5b-3dc33edbb540 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:56.082635 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ab033-ddd9-4b60-9e5b-3dc33edbb540 None admin] PATH_INFO: `/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2/groups/6f0978ecefa847bcaf229a7b200881d6/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:56.084614 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ab033-ddd9-4b60-9e5b-3dc33edbb540 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b15a0b04df24a618ea34b84d6e6ddd2, group_id=6f0978ecefa847bcaf229a7b200881d6, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:56.086089 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ab033-ddd9-4b60-9e5b-3dc33edbb540 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:56.101908 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 201/394] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Mar 8 13:38:55 2022] PUT /identity/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2/groups/6f0978ecefa847bcaf229a7b200881d6/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:38:56.398572 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d587dd-1ced-43b1-934c-6681bd9d63a1 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:56.398781 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d587dd-1ced-43b1-934c-6681bd9d63a1 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:56.399122 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d587dd-1ced-43b1-934c-6681bd9d63a1 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:56.401106 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 194/395] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:56.407269 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985267a-78ea-4bc5-96f1-907303ec6e7e None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:56.407648 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985267a-78ea-4bc5-96f1-907303ec6e7e None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:56.407870 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985267a-78ea-4bc5-96f1-907303ec6e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:56.426263 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-d985267a-78ea-4bc5-96f1-907303ec6e7e None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:56.427541 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-d985267a-78ea-4bc5-96f1-907303ec6e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:56.494010 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 202/396] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:56.516509 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d587dd-1ced-43b1-934c-6681bd9d63a1 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:56.627995 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d587dd-1ced-43b1-934c-6681bd9d63a1 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:56.673465 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43ae2a-26ca-489f-ae47-d6b819369446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:56.674286 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43ae2a-26ca-489f-ae47-d6b819369446 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:56.674564 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43ae2a-26ca-489f-ae47-d6b819369446 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:56.674834 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43ae2a-26ca-489f-ae47-d6b819369446 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:56.685947 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43ae2a-26ca-489f-ae47-d6b819369446 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:56.690344 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc2396-e739-4395-9e1b-a5c3dcbbf147 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:56.691020 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc2396-e739-4395-9e1b-a5c3dcbbf147 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:56.691020 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc2396-e739-4395-9e1b-a5c3dcbbf147 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:56.692793 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 203/397] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:38:56.698044 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-4a43ae2a-26ca-489f-ae47-d6b819369446 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 13:38:56.698272 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a210a-0e6f-43a5-b87c-f4d0a542fd11 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:56.698520 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a210a-0e6f-43a5-b87c-f4d0a542fd11 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:56.698778 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a210a-0e6f-43a5-b87c-f4d0a542fd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:56.699719 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 195/398] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Mar 8 13:38:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:56.705882 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43ae2a-26ca-489f-ae47-d6b819369446 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:56.724237 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-882a210a-0e6f-43a5-b87c-f4d0a542fd11 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:56.726246 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-882a210a-0e6f-43a5-b87c-f4d0a542fd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:56.793526 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 204/399] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:56.830613 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a210a-0e6f-43a5-b87c-f4d0a542fd11 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:56.868822 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43ae2a-26ca-489f-ae47-d6b819369446 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:56.914934 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208e8ad-8721-41d8-8034-d29a34ed205e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:56.915722 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208e8ad-8721-41d8-8034-d29a34ed205e None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:56.915906 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208e8ad-8721-41d8-8034-d29a34ed205e None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:56.916144 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208e8ad-8721-41d8-8034-d29a34ed205e None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:56.916889 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208e8ad-8721-41d8-8034-d29a34ed205e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:56.917200 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208e8ad-8721-41d8-8034-d29a34ed205e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:56.918609 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208e8ad-8721-41d8-8034-d29a34ed205e None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:56.935809 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 196/400] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:38:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:56.952165 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208e8ad-8721-41d8-8034-d29a34ed205e None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:56.985236 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a210a-0e6f-43a5-b87c-f4d0a542fd11 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:57.018523 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f7a46-30bc-4f7b-8247-877fd7dd503d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:57.019338 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f7a46-30bc-4f7b-8247-877fd7dd503d None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:57.019617 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f7a46-30bc-4f7b-8247-877fd7dd503d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:57.019886 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f7a46-30bc-4f7b-8247-877fd7dd503d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:57.030225 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f7a46-30bc-4f7b-8247-877fd7dd503d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:57.038246 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-a83f7a46-30bc-4f7b-8247-877fd7dd503d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 13:38:57.039807 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 205/401] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Mar 8 13:38:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:57.044977 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f7a46-30bc-4f7b-8247-877fd7dd503d None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:57.110795 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208e8ad-8721-41d8-8034-d29a34ed205e None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:57.190168 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1b66a-41d2-4c3d-847b-babc7d5db8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:57.190968 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1b66a-41d2-4c3d-847b-babc7d5db8aa None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:57.191247 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1b66a-41d2-4c3d-847b-babc7d5db8aa None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:57.191521 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1b66a-41d2-4c3d-847b-babc7d5db8aa None admin] PATH_INFO: `/v3/groups/6f0978ecefa847bcaf229a7b200881d6` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:57.192784 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1b66a-41d2-4c3d-847b-babc7d5db8aa None admin] RBAC: Authorizing `identity:get_group(group_id=6f0978ecefa847bcaf229a7b200881d6)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:57.194266 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1b66a-41d2-4c3d-847b-babc7d5db8aa None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:57.199147 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 197/402] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Mar 8 13:38:56 2022] GET /identity/v3/groups/6f0978ecefa847bcaf229a7b200881d6 => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:57.203729 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1b66a-41d2-4c3d-847b-babc7d5db8aa None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:57.222086 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f7a46-30bc-4f7b-8247-877fd7dd503d None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:57.255710 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5c452a-c04c-43d2-8851-6b21d96a6966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:57.256374 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c452a-c04c-43d2-8851-6b21d96a6966 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:57.256652 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c452a-c04c-43d2-8851-6b21d96a6966 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:57.256922 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5c452a-c04c-43d2-8851-6b21d96a6966 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:57.257707 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c452a-c04c-43d2-8851-6b21d96a6966 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:57.258018 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c452a-c04c-43d2-8851-6b21d96a6966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:57.259361 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5c452a-c04c-43d2-8851-6b21d96a6966 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:57.267884 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 206/403] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:38:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:57.269170 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844f2fe-510b-4736-b5cf-7b930a9c9466 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:57.269495 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844f2fe-510b-4736-b5cf-7b930a9c9466 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:57.269769 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844f2fe-510b-4736-b5cf-7b930a9c9466 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:57.271687 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 207/404] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:57.273294 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844f2fe-510b-4736-b5cf-7b930a9c9466 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:57.351685 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1b66a-41d2-4c3d-847b-babc7d5db8aa None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:57.382000 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844f2fe-510b-4736-b5cf-7b930a9c9466 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:57.392110 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb29040-d33d-4f17-9222-2f8a92ffa5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:57.393474 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb29040-d33d-4f17-9222-2f8a92ffa5a9 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:57.393874 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb29040-d33d-4f17-9222-2f8a92ffa5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:57.394588 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb29040-d33d-4f17-9222-2f8a92ffa5a9 None admin] PATH_INFO: `/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:57.396209 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb29040-d33d-4f17-9222-2f8a92ffa5a9 None admin] RBAC: Authorizing `identity:get_project(project_id=4b15a0b04df24a618ea34b84d6e6ddd2)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:57.398294 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb29040-d33d-4f17-9222-2f8a92ffa5a9 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:57.401431 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 198/405] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:57 2022] GET /identity/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:57.402809 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb4f7d-ebb9-41df-a726-bb87d3ecbb58 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:57.403220 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb4f7d-ebb9-41df-a726-bb87d3ecbb58 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:57.403640 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb4f7d-ebb9-41df-a726-bb87d3ecbb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:57.422287 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcb308-6be2-42c5-af57-15844f8b23c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:57.423438 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcb308-6be2-42c5-af57-15844f8b23c6 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:57.423902 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcb308-6be2-42c5-af57-15844f8b23c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:57.424341 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edcb308-6be2-42c5-af57-15844f8b23c6 None admin] PATH_INFO: `/v3/groups/6f0978ecefa847bcaf229a7b200881d6` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:57.425760 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edcb308-6be2-42c5-af57-15844f8b23c6 None admin] RBAC: Authorizing `identity:get_group(group_id=6f0978ecefa847bcaf229a7b200881d6)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:57.426889 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-c6bb4f7d-ebb9-41df-a726-bb87d3ecbb58 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:57.427595 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edcb308-6be2-42c5-af57-15844f8b23c6 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:57.428251 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-c6bb4f7d-ebb9-41df-a726-bb87d3ecbb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:57.429980 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 208/406] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Mar 8 13:38:57 2022] GET /identity/v3/groups/6f0978ecefa847bcaf229a7b200881d6 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:57.430910 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcb308-6be2-42c5-af57-15844f8b23c6 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:57.506906 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 199/407] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:57.508422 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb4f7d-ebb9-41df-a726-bb87d3ecbb58 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:57.541855 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edcb308-6be2-42c5-af57-15844f8b23c6 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:57.576095 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c32df-cd62-4588-a7aa-1efc99b99586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:57.577537 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c32df-cd62-4588-a7aa-1efc99b99586 None admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:57.578114 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c32df-cd62-4588-a7aa-1efc99b99586 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:57.578854 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c32df-cd62-4588-a7aa-1efc99b99586 None admin] PATH_INFO: `/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2/groups/6f0978ecefa847bcaf229a7b200881d6/roles/cbd629eb0cbe4cc7b69cc790228cdfc8` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:57.582013 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c32df-cd62-4588-a7aa-1efc99b99586 None admin] RBAC: Authorizing `identity:create_grant(project_id=4b15a0b04df24a618ea34b84d6e6ddd2, group_id=6f0978ecefa847bcaf229a7b200881d6, role_id=cbd629eb0cbe4cc7b69cc790228cdfc8)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:57.583478 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c32df-cd62-4588-a7aa-1efc99b99586 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:57.607247 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 209/408] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Mar 8 13:38:57 2022] PUT /identity/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2/groups/6f0978ecefa847bcaf229a7b200881d6/roles/cbd629eb0cbe4cc7b69cc790228cdfc8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:38:57.608717 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c32df-cd62-4588-a7aa-1efc99b99586 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:57.668645 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb4f7d-ebb9-41df-a726-bb87d3ecbb58 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:57.730100 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c32df-cd62-4588-a7aa-1efc99b99586 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:57.769386 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9fae8-2be8-4682-8b22-d13155e8c4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:57.770082 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e9bb9-13dc-4008-9bff-5d52f757d6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:57.770797 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9fae8-2be8-4682-8b22-d13155e8c4ee None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:57.770970 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e9bb9-13dc-4008-9bff-5d52f757d6c1 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:57.771246 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e9bb9-13dc-4008-9bff-5d52f757d6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:57.771519 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e9bb9-13dc-4008-9bff-5d52f757d6c1 None admin] PATH_INFO: `/v3/projects/cd5e8c45edab4920a609685e45710f9c` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:57.771848 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9fae8-2be8-4682-8b22-d13155e8c4ee None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:57.772462 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9fae8-2be8-4682-8b22-d13155e8c4ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:57.772763 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e9bb9-13dc-4008-9bff-5d52f757d6c1 None admin] RBAC: Authorizing `identity:get_project(project_id=cd5e8c45edab4920a609685e45710f9c)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:57.774236 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e9bb9-13dc-4008-9bff-5d52f757d6c1 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:57.776250 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 200/409] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:57 2022] GET /identity/v3/projects/cd5e8c45edab4920a609685e45710f9c => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:57.781784 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e9bb9-13dc-4008-9bff-5d52f757d6c1 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:57.786260 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9fae8-2be8-4682-8b22-d13155e8c4ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:57.795265 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-88f9fae8-2be8-4682-8b22-d13155e8c4ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:38:57.796806 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 210/410] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:38:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:57.802904 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9fae8-2be8-4682-8b22-d13155e8c4ee None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:57.942019 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e9bb9-13dc-4008-9bff-5d52f757d6c1 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:57.952266 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9fae8-2be8-4682-8b22-d13155e8c4ee None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:57.976839 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d22a8-c05c-4c16-8a81-0812bdc57ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:57.977839 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d22a8-c05c-4c16-8a81-0812bdc57ec9 None admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:57.978208 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d22a8-c05c-4c16-8a81-0812bdc57ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:57.978632 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d22a8-c05c-4c16-8a81-0812bdc57ec9 None admin] PATH_INFO: `/v3/projects/cd5e8c45edab4920a609685e45710f9c/groups/6f0978ecefa847bcaf229a7b200881d6/roles/cbd629eb0cbe4cc7b69cc790228cdfc8` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:57.981070 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d22a8-c05c-4c16-8a81-0812bdc57ec9 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd5e8c45edab4920a609685e45710f9c, group_id=6f0978ecefa847bcaf229a7b200881d6, role_id=cbd629eb0cbe4cc7b69cc790228cdfc8)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:57.982622 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d22a8-c05c-4c16-8a81-0812bdc57ec9 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:57.988823 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4665b-390a-4c3e-9b70-2ca952fadbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:57.991870 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4665b-390a-4c3e-9b70-2ca952fadbdc None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:57.991870 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4665b-390a-4c3e-9b70-2ca952fadbdc None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:57.991870 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4665b-390a-4c3e-9b70-2ca952fadbdc None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:57.991870 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4665b-390a-4c3e-9b70-2ca952fadbdc None admin] RBAC: Adding query filter params (name=admin) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:57.991870 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4665b-390a-4c3e-9b70-2ca952fadbdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:57.992627 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4665b-390a-4c3e-9b70-2ca952fadbdc None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:58.000077 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 201/411] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Mar 8 13:38:57 2022] PUT /identity/v3/projects/cd5e8c45edab4920a609685e45710f9c/groups/6f0978ecefa847bcaf229a7b200881d6/roles/cbd629eb0cbe4cc7b69cc790228cdfc8 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:38:58.005405 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 211/412] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:58.007173 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d22a8-c05c-4c16-8a81-0812bdc57ec9 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:58.127905 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d22a8-c05c-4c16-8a81-0812bdc57ec9 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:58.169955 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976d92c-db80-43b1-b69c-f76f8f9014bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:58.171194 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976d92c-db80-43b1-b69c-f76f8f9014bf None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:58.171654 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976d92c-db80-43b1-b69c-f76f8f9014bf None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:58.172172 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976d92c-db80-43b1-b69c-f76f8f9014bf None admin] PATH_INFO: `/v3/groups/ce71ab5ba2f848aa98e464707fb22b10` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:58.173815 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6976d92c-db80-43b1-b69c-f76f8f9014bf None admin] RBAC: Authorizing `identity:get_group(group_id=ce71ab5ba2f848aa98e464707fb22b10)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:58.175504 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6976d92c-db80-43b1-b69c-f76f8f9014bf None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:58.181476 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 202/413] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Mar 8 13:38:58 2022] GET /identity/v3/groups/ce71ab5ba2f848aa98e464707fb22b10 => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:58.183204 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4665b-390a-4c3e-9b70-2ca952fadbdc None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:58.292935 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4665b-390a-4c3e-9b70-2ca952fadbdc None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:58.327126 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fb79e0-f47a-4484-8668-e3a256328e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:58.328355 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb79e0-f47a-4484-8668-e3a256328e30 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:58.328853 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb79e0-f47a-4484-8668-e3a256328e30 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:58.329326 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fb79e0-f47a-4484-8668-e3a256328e30 None admin] PATH_INFO: `/v3/projects/bb5233956b7746bc8c923776ec1a970c` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:58.330789 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb79e0-f47a-4484-8668-e3a256328e30 None admin] RBAC: Authorizing `identity:get_project(project_id=bb5233956b7746bc8c923776ec1a970c)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:58.332388 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fb79e0-f47a-4484-8668-e3a256328e30 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:58.334671 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 212/414] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:58 2022] GET /identity/v3/projects/bb5233956b7746bc8c923776ec1a970c => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:58.340792 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976d92c-db80-43b1-b69c-f76f8f9014bf None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:58.440260 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976d92c-db80-43b1-b69c-f76f8f9014bf None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:58.489843 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088e387-48cc-4638-88ac-3fc219eba506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:58.491094 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088e387-48cc-4638-88ac-3fc219eba506 None admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:58.491705 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088e387-48cc-4638-88ac-3fc219eba506 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:58.492149 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088e387-48cc-4638-88ac-3fc219eba506 None admin] PATH_INFO: `/v3/projects/bb5233956b7746bc8c923776ec1a970c/groups/ce71ab5ba2f848aa98e464707fb22b10/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:58.494358 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088e387-48cc-4638-88ac-3fc219eba506 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb5233956b7746bc8c923776ec1a970c, group_id=ce71ab5ba2f848aa98e464707fb22b10, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:58.496023 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088e387-48cc-4638-88ac-3fc219eba506 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:58.507098 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb6b94-6fe7-4089-8140-bd745e9e90e2 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:58.509032 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb6b94-6fe7-4089-8140-bd745e9e90e2 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:58.509692 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb6b94-6fe7-4089-8140-bd745e9e90e2 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:58.511464 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 213/415] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:58.517820 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8a1ed-ee1d-4a4d-ad96-59820fe66be3 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:58.518113 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8a1ed-ee1d-4a4d-ad96-59820fe66be3 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:58.518493 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8a1ed-ee1d-4a4d-ad96-59820fe66be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:58.528414 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 203/416] 10.222.0.18 () {58 vars in 1442 bytes} [Tue Mar 8 13:38:58 2022] PUT /identity/v3/projects/bb5233956b7746bc8c923776ec1a970c/groups/ce71ab5ba2f848aa98e464707fb22b10/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:38:58.543384 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-2db8a1ed-ee1d-4a4d-ad96-59820fe66be3 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:58.544658 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-2db8a1ed-ee1d-4a4d-ad96-59820fe66be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:58.628512 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 214/417] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:38:58.673214 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088e387-48cc-4638-88ac-3fc219eba506 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:58.785441 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088e387-48cc-4638-88ac-3fc219eba506 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:58.825196 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13d6a8-662b-4554-be17-458b34d93f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:58.826026 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13d6a8-662b-4554-be17-458b34d93f51 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:58.826301 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13d6a8-662b-4554-be17-458b34d93f51 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:58.826565 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13d6a8-662b-4554-be17-458b34d93f51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:58.837240 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13d6a8-662b-4554-be17-458b34d93f51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:58.849233 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-ba13d6a8-662b-4554-be17-458b34d93f51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 13:38:58.851494 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 204/418] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:58.857033 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8a1ed-ee1d-4a4d-ad96-59820fe66be3 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:58.979619 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8a1ed-ee1d-4a4d-ad96-59820fe66be3 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:59.027148 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6c432-3c2a-4a30-93b0-a8c859fb36a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:59.027828 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6c432-3c2a-4a30-93b0-a8c859fb36a6 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:59.028106 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6c432-3c2a-4a30-93b0-a8c859fb36a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:59.028372 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6c432-3c2a-4a30-93b0-a8c859fb36a6 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:59.029126 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6c432-3c2a-4a30-93b0-a8c859fb36a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:59.029446 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6c432-3c2a-4a30-93b0-a8c859fb36a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:59.030796 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b6c432-3c2a-4a30-93b0-a8c859fb36a6 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:59.041286 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 215/419] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:59.046787 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13d6a8-662b-4554-be17-458b34d93f51 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:59.169683 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13d6a8-662b-4554-be17-458b34d93f51 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:59.208187 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853b3e6-12fd-4f1e-b8a8-44962e43d23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:59.208831 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853b3e6-12fd-4f1e-b8a8-44962e43d23b None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:59.209103 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853b3e6-12fd-4f1e-b8a8-44962e43d23b None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:59.209400 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853b3e6-12fd-4f1e-b8a8-44962e43d23b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:59.230102 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f057ce1-a3f6-4263-bcde-c6906cf40813 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:59.230697 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f057ce1-a3f6-4263-bcde-c6906cf40813 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:59.231182 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f057ce1-a3f6-4263-bcde-c6906cf40813 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:59.233463 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 216/420] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:38:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:38:59.238760 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f86852-b8ef-4739-b6ba-9422fd79f572 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:59.239047 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f86852-b8ef-4739-b6ba-9422fd79f572 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:59.239324 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f86852-b8ef-4739-b6ba-9422fd79f572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:59.274351 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-73f86852-b8ef-4739-b6ba-9422fd79f572 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:38:59.275555 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-73f86852-b8ef-4739-b6ba-9422fd79f572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:38:59.279574 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853b3e6-12fd-4f1e-b8a8-44962e43d23b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:59.281031 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853b3e6-12fd-4f1e-b8a8-44962e43d23b None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:59.347292 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 217/421] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:38:59.374641 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 205/422] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:38:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:38:59.378856 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f86852-b8ef-4739-b6ba-9422fd79f572 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:59.381908 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853b3e6-12fd-4f1e-b8a8-44962e43d23b None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:59.528368 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f86852-b8ef-4739-b6ba-9422fd79f572 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:59.569384 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a063f-f88f-4e69-8cbd-01c08feda2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:59.570192 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a063f-f88f-4e69-8cbd-01c08feda2eb None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:59.570469 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a063f-f88f-4e69-8cbd-01c08feda2eb None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:59.570738 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a063f-f88f-4e69-8cbd-01c08feda2eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:59.584895 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853b3e6-12fd-4f1e-b8a8-44962e43d23b None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:59.595556 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a063f-f88f-4e69-8cbd-01c08feda2eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:38:59.603456 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-230a063f-f88f-4e69-8cbd-01c08feda2eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Mar 08 13:38:59.604961 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 218/423] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:38:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:38:59.610756 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a063f-f88f-4e69-8cbd-01c08feda2eb None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:59.633177 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776c6c4-d44a-4d19-b4b0-7e5e340ae840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:59.634888 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776c6c4-d44a-4d19-b4b0-7e5e340ae840 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:59.635169 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776c6c4-d44a-4d19-b4b0-7e5e340ae840 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:59.635459 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776c6c4-d44a-4d19-b4b0-7e5e340ae840 None admin] PATH_INFO: `/v3/projects/cd5e8c45edab4920a609685e45710f9c` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:59.638439 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776c6c4-d44a-4d19-b4b0-7e5e340ae840 None admin] RBAC: Authorizing `identity:get_project(project_id=cd5e8c45edab4920a609685e45710f9c)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:59.642006 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776c6c4-d44a-4d19-b4b0-7e5e340ae840 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:59.647898 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 206/424] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:38:59 2022] GET /identity/v3/projects/cd5e8c45edab4920a609685e45710f9c => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:59.659231 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776c6c4-d44a-4d19-b4b0-7e5e340ae840 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:59.753378 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a063f-f88f-4e69-8cbd-01c08feda2eb None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:59.787836 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2fc8f-5189-4222-a050-96d9bb51c50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:59.788513 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2fc8f-5189-4222-a050-96d9bb51c50d None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:59.788792 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2fc8f-5189-4222-a050-96d9bb51c50d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:59.789072 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2fc8f-5189-4222-a050-96d9bb51c50d None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:59.789893 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2fc8f-5189-4222-a050-96d9bb51c50d None admin] RBAC: Adding query filter params (name=member) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:38:59.790199 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2fc8f-5189-4222-a050-96d9bb51c50d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:59.796021 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2fc8f-5189-4222-a050-96d9bb51c50d None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:59.812847 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 219/425] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:38:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:38:59.818067 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2fc8f-5189-4222-a050-96d9bb51c50d None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:38:59.839003 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776c6c4-d44a-4d19-b4b0-7e5e340ae840 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:38:59.878883 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7e7c7-8b1a-495e-ba9b-8b3c7dbffe6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:38:59.879667 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7e7c7-8b1a-495e-ba9b-8b3c7dbffe6e None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:38:59.879948 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7e7c7-8b1a-495e-ba9b-8b3c7dbffe6e None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:38:59.880224 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7e7c7-8b1a-495e-ba9b-8b3c7dbffe6e None admin] PATH_INFO: `/v3/groups/6f0978ecefa847bcaf229a7b200881d6` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:38:59.884553 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7e7c7-8b1a-495e-ba9b-8b3c7dbffe6e None admin] RBAC: Authorizing `identity:get_group(group_id=6f0978ecefa847bcaf229a7b200881d6)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:38:59.888848 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7e7c7-8b1a-495e-ba9b-8b3c7dbffe6e None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:38:59.890519 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 207/426] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Mar 8 13:38:59 2022] GET /identity/v3/groups/6f0978ecefa847bcaf229a7b200881d6 => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:38:59.910845 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7e7c7-8b1a-495e-ba9b-8b3c7dbffe6e None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:00.023546 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2fc8f-5189-4222-a050-96d9bb51c50d None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:00.025782 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7e7c7-8b1a-495e-ba9b-8b3c7dbffe6e None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:00.064117 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dccbc70-3906-4527-9cb8-e33d1ca2b2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:00.064881 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccbc70-3906-4527-9cb8-e33d1ca2b2e4 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:00.065066 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccbc70-3906-4527-9cb8-e33d1ca2b2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:00.065322 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dccbc70-3906-4527-9cb8-e33d1ca2b2e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:00.066188 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dccbc70-3906-4527-9cb8-e33d1ca2b2e4 None admin] RBAC: Adding query filter params (group.id=6f0978ecefa847bcaf229a7b200881d6, role.id=0010e8da2d4b4bb8af05894096d2fc92, scope.project.id=cd5e8c45edab4920a609685e45710f9c) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:00.066504 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dccbc70-3906-4527-9cb8-e33d1ca2b2e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:00.073339 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dccbc70-3906-4527-9cb8-e33d1ca2b2e4 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:00.085157 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 208/427] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Mar 8 13:38:59 2022] GET /identity/v3/role_assignments?group.id=6f0978ecefa847bcaf229a7b200881d6&scope.project.id=cd5e8c45edab4920a609685e45710f9c&role.id=0010e8da2d4b4bb8af05894096d2fc92 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:00.099715 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecc0d4-274e-4023-aed6-d371fc511e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:00.100401 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecc0d4-274e-4023-aed6-d371fc511e49 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:00.100685 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecc0d4-274e-4023-aed6-d371fc511e49 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:00.100960 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecc0d4-274e-4023-aed6-d371fc511e49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:00.178609 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecc0d4-274e-4023-aed6-d371fc511e49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:00.180147 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecc0d4-274e-4023-aed6-d371fc511e49 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:00.285408 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 220/428] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:38:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:00.290617 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dccbc70-3906-4527-9cb8-e33d1ca2b2e4 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:00.403088 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dccbc70-3906-4527-9cb8-e33d1ca2b2e4 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:00.417153 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0d400-a8bb-4872-80c2-713212796652 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:00.417528 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0d400-a8bb-4872-80c2-713212796652 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:00.417732 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0d400-a8bb-4872-80c2-713212796652 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:00.419709 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 221/429] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:00.425860 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626761d2-85d5-48f8-a274-5baee7531a4f None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:00.426137 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626761d2-85d5-48f8-a274-5baee7531a4f None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:00.426407 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626761d2-85d5-48f8-a274-5baee7531a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:00.446988 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ec150-ebcb-4af7-a959-369527d61a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:00.447779 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ec150-ebcb-4af7-a959-369527d61a6b None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:00.448056 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ec150-ebcb-4af7-a959-369527d61a6b None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:00.448327 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ec150-ebcb-4af7-a959-369527d61a6b None admin] PATH_INFO: `/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:00.449605 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-626761d2-85d5-48f8-a274-5baee7531a4f None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:00.450501 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ec150-ebcb-4af7-a959-369527d61a6b None admin] RBAC: Authorizing `identity:get_project(project_id=4b15a0b04df24a618ea34b84d6e6ddd2)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:00.451181 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-626761d2-85d5-48f8-a274-5baee7531a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:00.451957 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ec150-ebcb-4af7-a959-369527d61a6b None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:00.454232 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 209/430] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:39:00 2022] GET /identity/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:00.459193 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ec150-ebcb-4af7-a959-369527d61a6b None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:00.526796 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 222/431] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:00.551961 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626761d2-85d5-48f8-a274-5baee7531a4f None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:00.577963 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ec150-ebcb-4af7-a959-369527d61a6b None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:00.620744 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee27036-a66f-4a7a-851a-d0bf91010d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:00.621631 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee27036-a66f-4a7a-851a-d0bf91010d8d None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:00.621911 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee27036-a66f-4a7a-851a-d0bf91010d8d None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:00.622195 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee27036-a66f-4a7a-851a-d0bf91010d8d None admin] PATH_INFO: `/v3/groups/6f0978ecefa847bcaf229a7b200881d6` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:00.623383 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee27036-a66f-4a7a-851a-d0bf91010d8d None admin] RBAC: Authorizing `identity:get_group(group_id=6f0978ecefa847bcaf229a7b200881d6)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:00.624825 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee27036-a66f-4a7a-851a-d0bf91010d8d None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:00.627291 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 210/432] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Mar 8 13:39:00 2022] GET /identity/v3/groups/6f0978ecefa847bcaf229a7b200881d6 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:00.632948 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee27036-a66f-4a7a-851a-d0bf91010d8d None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:00.652547 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626761d2-85d5-48f8-a274-5baee7531a4f None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:00.694583 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf366df-e52d-4c47-a93a-09bed295572b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:00.695506 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf366df-e52d-4c47-a93a-09bed295572b None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:00.695685 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf366df-e52d-4c47-a93a-09bed295572b None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:00.695954 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf366df-e52d-4c47-a93a-09bed295572b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:00.707146 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf366df-e52d-4c47-a93a-09bed295572b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:00.714509 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-5bf366df-e52d-4c47-a93a-09bed295572b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 13:39:00.716012 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 223/433] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Mar 8 13:39:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:39:00.721959 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf366df-e52d-4c47-a93a-09bed295572b None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:00.747395 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee27036-a66f-4a7a-851a-d0bf91010d8d None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:00.781005 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798edee-5635-49b1-8b34-6710cd3c1ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:00.781682 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798edee-5635-49b1-8b34-6710cd3c1ea0 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:00.782048 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798edee-5635-49b1-8b34-6710cd3c1ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:00.782365 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798edee-5635-49b1-8b34-6710cd3c1ea0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:00.784056 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798edee-5635-49b1-8b34-6710cd3c1ea0 None admin] RBAC: Adding query filter params (group.id=6f0978ecefa847bcaf229a7b200881d6, role.id=0010e8da2d4b4bb8af05894096d2fc92, scope.project.id=4b15a0b04df24a618ea34b84d6e6ddd2) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:00.784555 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798edee-5635-49b1-8b34-6710cd3c1ea0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:00.786357 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798edee-5635-49b1-8b34-6710cd3c1ea0 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:00.797711 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 211/434] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Mar 8 13:39:00 2022] GET /identity/v3/role_assignments?group.id=6f0978ecefa847bcaf229a7b200881d6&scope.project.id=4b15a0b04df24a618ea34b84d6e6ddd2&role.id=0010e8da2d4b4bb8af05894096d2fc92 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:00.842257 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf366df-e52d-4c47-a93a-09bed295572b None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:00.879171 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c6847-4cea-42b8-91da-20367ae7571e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:00.880248 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c6847-4cea-42b8-91da-20367ae7571e None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:00.880719 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c6847-4cea-42b8-91da-20367ae7571e None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:00.881189 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c6847-4cea-42b8-91da-20367ae7571e None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:00.882282 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c6847-4cea-42b8-91da-20367ae7571e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:00.882817 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c6847-4cea-42b8-91da-20367ae7571e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:00.884423 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c6847-4cea-42b8-91da-20367ae7571e None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:00.892947 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7085c-8668-4be2-9f30-ec3e92a1a829 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:00.893263 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7085c-8668-4be2-9f30-ec3e92a1a829 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:00.893560 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7085c-8668-4be2-9f30-ec3e92a1a829 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:00.895089 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 224/435] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:00.899643 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 212/436] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:39:00.901006 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7085c-8668-4be2-9f30-ec3e92a1a829 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:00.901843 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ebb51-6043-49af-9185-2dc2866e57df None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:00.902333 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ebb51-6043-49af-9185-2dc2866e57df None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:00.902821 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ebb51-6043-49af-9185-2dc2866e57df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:00.925383 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-db9ebb51-6043-49af-9185-2dc2866e57df None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:00.927126 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-db9ebb51-6043-49af-9185-2dc2866e57df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:01.009888 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 225/437] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:01.013594 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7085c-8668-4be2-9f30-ec3e92a1a829 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:01.037512 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ebb51-6043-49af-9185-2dc2866e57df None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:01.060398 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe9a13-3ca8-47ac-91f4-82b40c1c7b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:01.061051 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe9a13-3ca8-47ac-91f4-82b40c1c7b6c None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:01.061326 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe9a13-3ca8-47ac-91f4-82b40c1c7b6c None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:01.061740 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe9a13-3ca8-47ac-91f4-82b40c1c7b6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:01.143640 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe9a13-3ca8-47ac-91f4-82b40c1c7b6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:01.144991 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe9a13-3ca8-47ac-91f4-82b40c1c7b6c None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:01.161954 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ebb51-6043-49af-9185-2dc2866e57df None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:01.198484 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77698024-750b-45a6-bc6a-95568f71d54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:01.199396 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77698024-750b-45a6-bc6a-95568f71d54e None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:01.199741 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77698024-750b-45a6-bc6a-95568f71d54e None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:01.200078 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77698024-750b-45a6-bc6a-95568f71d54e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:01.211540 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77698024-750b-45a6-bc6a-95568f71d54e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:01.218998 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-77698024-750b-45a6-bc6a-95568f71d54e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 13:39:01.224290 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 226/438] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Mar 8 13:39:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:39:01.227830 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77698024-750b-45a6-bc6a-95568f71d54e None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:01.265097 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 213/439] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:39:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:01.270760 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe9a13-3ca8-47ac-91f4-82b40c1c7b6c None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:01.343757 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77698024-750b-45a6-bc6a-95568f71d54e None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:01.370133 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe9a13-3ca8-47ac-91f4-82b40c1c7b6c None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:01.378280 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5be3e-0336-45c7-97c3-52af5db78fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:01.378942 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5be3e-0336-45c7-97c3-52af5db78fd2 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:01.379220 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5be3e-0336-45c7-97c3-52af5db78fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:01.379484 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5be3e-0336-45c7-97c3-52af5db78fd2 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:01.380255 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5be3e-0336-45c7-97c3-52af5db78fd2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:01.380549 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5be3e-0336-45c7-97c3-52af5db78fd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:01.381932 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d5be3e-0336-45c7-97c3-52af5db78fd2 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:01.389871 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 227/440] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:01.391031 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daed1e1-81a3-409e-a193-e608bbda921b None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:01.391410 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daed1e1-81a3-409e-a193-e608bbda921b None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:01.391756 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daed1e1-81a3-409e-a193-e608bbda921b None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:01.393386 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 228/441] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:01.395360 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daed1e1-81a3-409e-a193-e608bbda921b None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:01.405179 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41aefa-6190-4fde-91dc-6631fd2fdf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:01.406076 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41aefa-6190-4fde-91dc-6631fd2fdf01 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:01.406352 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41aefa-6190-4fde-91dc-6631fd2fdf01 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:01.406624 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41aefa-6190-4fde-91dc-6631fd2fdf01 None admin] PATH_INFO: `/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:01.407895 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41aefa-6190-4fde-91dc-6631fd2fdf01 None admin] RBAC: Authorizing `identity:get_project(project_id=4b15a0b04df24a618ea34b84d6e6ddd2)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:01.409691 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41aefa-6190-4fde-91dc-6631fd2fdf01 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:01.411376 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 214/442] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:39:01 2022] GET /identity/v3/projects/4b15a0b04df24a618ea34b84d6e6ddd2 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:01.412483 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9fc49-fede-4c1c-afa6-36e7310f2865 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:01.412764 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9fc49-fede-4c1c-afa6-36e7310f2865 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:01.413056 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9fc49-fede-4c1c-afa6-36e7310f2865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:01.429144 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-7ad9fc49-fede-4c1c-afa6-36e7310f2865 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:01.430353 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-7ad9fc49-fede-4c1c-afa6-36e7310f2865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:01.491285 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daed1e1-81a3-409e-a193-e608bbda921b None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:01.494050 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 215/443] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:01.494883 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9fc49-fede-4c1c-afa6-36e7310f2865 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:01.524275 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b188dd6-fc46-4a5b-9edc-5383a07c26f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:01.524838 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b188dd6-fc46-4a5b-9edc-5383a07c26f5 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:01.525111 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b188dd6-fc46-4a5b-9edc-5383a07c26f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:01.525451 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b188dd6-fc46-4a5b-9edc-5383a07c26f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:01.596748 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b188dd6-fc46-4a5b-9edc-5383a07c26f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:01.598214 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b188dd6-fc46-4a5b-9edc-5383a07c26f5 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:01.601604 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9fc49-fede-4c1c-afa6-36e7310f2865 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:01.634512 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21825f02-38c0-4c37-bdde-f554900512ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:01.635337 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21825f02-38c0-4c37-bdde-f554900512ed None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:01.635614 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21825f02-38c0-4c37-bdde-f554900512ed None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:01.635884 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21825f02-38c0-4c37-bdde-f554900512ed None admin] PATH_INFO: `/v3/groups/6f0978ecefa847bcaf229a7b200881d6` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:01.637060 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21825f02-38c0-4c37-bdde-f554900512ed None admin] RBAC: Authorizing `identity:get_group(group_id=6f0978ecefa847bcaf229a7b200881d6)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:01.638561 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21825f02-38c0-4c37-bdde-f554900512ed None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:01.645021 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 216/444] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Mar 8 13:39:01 2022] GET /identity/v3/groups/6f0978ecefa847bcaf229a7b200881d6 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:01.645021 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21825f02-38c0-4c37-bdde-f554900512ed None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:01.697035 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 229/445] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:39:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:01.698261 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b188dd6-fc46-4a5b-9edc-5383a07c26f5 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:01.736025 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21825f02-38c0-4c37-bdde-f554900512ed None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:01.769884 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535e393-b62f-422a-8baf-55fdf473aa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:01.770635 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535e393-b62f-422a-8baf-55fdf473aa29 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:01.770917 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535e393-b62f-422a-8baf-55fdf473aa29 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:01.771187 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535e393-b62f-422a-8baf-55fdf473aa29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:01.781104 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535e393-b62f-422a-8baf-55fdf473aa29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:01.788705 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-d535e393-b62f-422a-8baf-55fdf473aa29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:39:01.789937 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 217/446] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:39:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:01.790684 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535e393-b62f-422a-8baf-55fdf473aa29 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:01.792358 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b188dd6-fc46-4a5b-9edc-5383a07c26f5 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:01.826560 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cface-85b1-411b-824d-f45ff550995c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:01.827209 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cface-85b1-411b-824d-f45ff550995c None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:01.827486 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cface-85b1-411b-824d-f45ff550995c None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:01.827757 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cface-85b1-411b-824d-f45ff550995c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:01.828602 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cface-85b1-411b-824d-f45ff550995c None admin] RBAC: Adding query filter params (group.id=6f0978ecefa847bcaf229a7b200881d6, role.id=cbd629eb0cbe4cc7b69cc790228cdfc8, scope.project.id=4b15a0b04df24a618ea34b84d6e6ddd2) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:01.828957 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cface-85b1-411b-824d-f45ff550995c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:01.830395 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cface-85b1-411b-824d-f45ff550995c None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:01.836166 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 230/447] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Mar 8 13:39:01 2022] GET /identity/v3/role_assignments?group.id=6f0978ecefa847bcaf229a7b200881d6&scope.project.id=4b15a0b04df24a618ea34b84d6e6ddd2&role.id=cbd629eb0cbe4cc7b69cc790228cdfc8 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:01.836924 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cface-85b1-411b-824d-f45ff550995c None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:01.896904 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535e393-b62f-422a-8baf-55fdf473aa29 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:01.932224 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93780a-471d-44c3-a074-4ac2d1bc0b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:01.933459 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93780a-471d-44c3-a074-4ac2d1bc0b8f None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:01.933743 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93780a-471d-44c3-a074-4ac2d1bc0b8f None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:01.934018 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93780a-471d-44c3-a074-4ac2d1bc0b8f None admin] PATH_INFO: `/v3/projects/cd5e8c45edab4920a609685e45710f9c` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:01.935368 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93780a-471d-44c3-a074-4ac2d1bc0b8f None admin] RBAC: Authorizing `identity:get_project(project_id=cd5e8c45edab4920a609685e45710f9c)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:01.936877 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93780a-471d-44c3-a074-4ac2d1bc0b8f None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:01.938946 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 218/448] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:39:01 2022] GET /identity/v3/projects/cd5e8c45edab4920a609685e45710f9c => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:01.944510 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93780a-471d-44c3-a074-4ac2d1bc0b8f None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:01.948402 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cface-85b1-411b-824d-f45ff550995c None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:01.982191 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00064f49-2d31-4433-895c-9d8ba6b14727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:01.982952 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00064f49-2d31-4433-895c-9d8ba6b14727 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:01.983229 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00064f49-2d31-4433-895c-9d8ba6b14727 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:01.983494 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00064f49-2d31-4433-895c-9d8ba6b14727 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:01.984240 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00064f49-2d31-4433-895c-9d8ba6b14727 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:01.984566 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00064f49-2d31-4433-895c-9d8ba6b14727 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:01.985977 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00064f49-2d31-4433-895c-9d8ba6b14727 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:01.994742 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 231/449] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:39:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:02.000327 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00064f49-2d31-4433-895c-9d8ba6b14727 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:02.047367 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93780a-471d-44c3-a074-4ac2d1bc0b8f None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:02.083431 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96427532-64c1-47af-9bd6-84637499cb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:02.084295 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96427532-64c1-47af-9bd6-84637499cb4c None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:02.084566 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96427532-64c1-47af-9bd6-84637499cb4c None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:02.084840 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96427532-64c1-47af-9bd6-84637499cb4c None admin] PATH_INFO: `/v3/groups/6f0978ecefa847bcaf229a7b200881d6` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:02.086298 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96427532-64c1-47af-9bd6-84637499cb4c None admin] RBAC: Authorizing `identity:get_group(group_id=6f0978ecefa847bcaf229a7b200881d6)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:02.087734 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96427532-64c1-47af-9bd6-84637499cb4c None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:02.089486 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 219/450] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Mar 8 13:39:01 2022] GET /identity/v3/groups/6f0978ecefa847bcaf229a7b200881d6 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:02.095476 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96427532-64c1-47af-9bd6-84637499cb4c None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:02.107400 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00064f49-2d31-4433-895c-9d8ba6b14727 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:02.141690 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38704801-8dc8-46ab-b7e3-e21c5b551fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:02.142502 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38704801-8dc8-46ab-b7e3-e21c5b551fa2 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:02.143687 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38704801-8dc8-46ab-b7e3-e21c5b551fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:02.143687 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38704801-8dc8-46ab-b7e3-e21c5b551fa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:02.208134 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96427532-64c1-47af-9bd6-84637499cb4c None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:02.219041 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38704801-8dc8-46ab-b7e3-e21c5b551fa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:02.220558 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38704801-8dc8-46ab-b7e3-e21c5b551fa2 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:02.245700 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc373b5b-ed7f-45ec-8d82-6ee454600c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:02.246391 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc373b5b-ed7f-45ec-8d82-6ee454600c48 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:02.246673 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc373b5b-ed7f-45ec-8d82-6ee454600c48 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:02.246950 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc373b5b-ed7f-45ec-8d82-6ee454600c48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:02.247783 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc373b5b-ed7f-45ec-8d82-6ee454600c48 None admin] RBAC: Adding query filter params (group.id=6f0978ecefa847bcaf229a7b200881d6, role.id=cbd629eb0cbe4cc7b69cc790228cdfc8, scope.project.id=cd5e8c45edab4920a609685e45710f9c) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:02.248101 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc373b5b-ed7f-45ec-8d82-6ee454600c48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:02.249581 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc373b5b-ed7f-45ec-8d82-6ee454600c48 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:02.255738 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 220/451] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Mar 8 13:39:02 2022] GET /identity/v3/role_assignments?group.id=6f0978ecefa847bcaf229a7b200881d6&scope.project.id=cd5e8c45edab4920a609685e45710f9c&role.id=cbd629eb0cbe4cc7b69cc790228cdfc8 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:02.331133 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 232/452] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:39:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 13:39:02.337027 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc373b5b-ed7f-45ec-8d82-6ee454600c48 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:02.439375 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc373b5b-ed7f-45ec-8d82-6ee454600c48 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:02.475260 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e8add-7bd5-46e9-8d0d-44cb1e4cbe08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:02.476159 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e8add-7bd5-46e9-8d0d-44cb1e4cbe08 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:02.476437 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e8add-7bd5-46e9-8d0d-44cb1e4cbe08 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:02.476712 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e8add-7bd5-46e9-8d0d-44cb1e4cbe08 None admin] PATH_INFO: `/v3/projects/bb5233956b7746bc8c923776ec1a970c` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:02.477929 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e8add-7bd5-46e9-8d0d-44cb1e4cbe08 None admin] RBAC: Authorizing `identity:get_project(project_id=bb5233956b7746bc8c923776ec1a970c)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:02.479392 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e8add-7bd5-46e9-8d0d-44cb1e4cbe08 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:02.481051 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 221/453] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:39:02 2022] GET /identity/v3/projects/bb5233956b7746bc8c923776ec1a970c => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:02.486676 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38704801-8dc8-46ab-b7e3-e21c5b551fa2 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:02.584884 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38704801-8dc8-46ab-b7e3-e21c5b551fa2 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:02.617401 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92df7a1-40d4-4dbe-b1d2-5664ab60112e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:02.618230 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92df7a1-40d4-4dbe-b1d2-5664ab60112e None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:02.618506 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92df7a1-40d4-4dbe-b1d2-5664ab60112e None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:02.618773 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92df7a1-40d4-4dbe-b1d2-5664ab60112e None admin] PATH_INFO: `/v3/groups/ce71ab5ba2f848aa98e464707fb22b10` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:02.619935 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92df7a1-40d4-4dbe-b1d2-5664ab60112e None admin] RBAC: Authorizing `identity:get_group(group_id=ce71ab5ba2f848aa98e464707fb22b10)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:02.621375 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92df7a1-40d4-4dbe-b1d2-5664ab60112e None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:02.622978 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 233/454] 10.222.0.18 () {56 vars in 1180 bytes} [Tue Mar 8 13:39:02 2022] GET /identity/v3/groups/ce71ab5ba2f848aa98e464707fb22b10 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:02.629176 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e8add-7bd5-46e9-8d0d-44cb1e4cbe08 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:02.723753 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e8add-7bd5-46e9-8d0d-44cb1e4cbe08 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:02.759952 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dc288-d767-4a28-b07f-c7de5f36169a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:02.760589 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dc288-d767-4a28-b07f-c7de5f36169a None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:02.760866 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dc288-d767-4a28-b07f-c7de5f36169a None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:02.761133 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dc288-d767-4a28-b07f-c7de5f36169a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:02.761997 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dc288-d767-4a28-b07f-c7de5f36169a None admin] RBAC: Adding query filter params (group.id=ce71ab5ba2f848aa98e464707fb22b10, role.id=fc021ed5870a44f5a0f0b8fff994d6f0, scope.project.id=bb5233956b7746bc8c923776ec1a970c) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:02.762311 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dc288-d767-4a28-b07f-c7de5f36169a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:02.763746 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dc288-d767-4a28-b07f-c7de5f36169a None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:02.769555 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 222/455] 10.222.0.18 () {56 vars in 1376 bytes} [Tue Mar 8 13:39:02 2022] GET /identity/v3/role_assignments?group.id=ce71ab5ba2f848aa98e464707fb22b10&scope.project.id=bb5233956b7746bc8c923776ec1a970c&role.id=fc021ed5870a44f5a0f0b8fff994d6f0 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:05.472201 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5630e4-9dfb-43c9-9d0c-04d780bc6bf3 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:05.472710 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5630e4-9dfb-43c9-9d0c-04d780bc6bf3 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:05.472710 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5630e4-9dfb-43c9-9d0c-04d780bc6bf3 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:05.474766 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 234/456] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:05.480189 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994a521-f56b-4824-9a2b-72bf459e0d33 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:05.480578 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994a521-f56b-4824-9a2b-72bf459e0d33 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:05.480753 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994a521-f56b-4824-9a2b-72bf459e0d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:05.502217 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-d994a521-f56b-4824-9a2b-72bf459e0d33 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:05.502217 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-d994a521-f56b-4824-9a2b-72bf459e0d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:05.610931 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 223/457] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:05.640732 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5630e4-9dfb-43c9-9d0c-04d780bc6bf3 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:05.748712 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5630e4-9dfb-43c9-9d0c-04d780bc6bf3 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:05.789791 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d8649-4539-4df5-91a2-8b1c55e9d11f None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:05.790458 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d8649-4539-4df5-91a2-8b1c55e9d11f None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:05.790917 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d8649-4539-4df5-91a2-8b1c55e9d11f None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:05.792888 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 224/458] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:39:05.798050 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55630be-7d47-478b-864c-6ec8819dcb63 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:05.798552 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55630be-7d47-478b-864c-6ec8819dcb63 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:05.799026 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55630be-7d47-478b-864c-6ec8819dcb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:05.810751 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e840318-9e09-4959-9266-e85c8a97725f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:05.811839 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e840318-9e09-4959-9266-e85c8a97725f None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:05.812301 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e840318-9e09-4959-9266-e85c8a97725f None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:05.812830 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e840318-9e09-4959-9266-e85c8a97725f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:05.824903 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-b55630be-7d47-478b-864c-6ec8819dcb63 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:05.826372 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-b55630be-7d47-478b-864c-6ec8819dcb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:05.836737 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e840318-9e09-4959-9266-e85c8a97725f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:05.838433 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e840318-9e09-4959-9266-e85c8a97725f None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:05.861300 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-6e840318-9e09-4959-9266-e85c8a97725f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:05.866659 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 235/459] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:05.872888 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e840318-9e09-4959-9266-e85c8a97725f None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:05.948076 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 225/460] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:05.949971 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85937a22-2864-40d9-a12c-6ec9755b4fe8 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:05.950466 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85937a22-2864-40d9-a12c-6ec9755b4fe8 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:05.950925 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85937a22-2864-40d9-a12c-6ec9755b4fe8 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:05.953093 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 226/461] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:05.961639 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fa168-3105-4c6b-856f-795ae6e33d7a None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:05.962244 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fa168-3105-4c6b-856f-795ae6e33d7a None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:05.962701 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fa168-3105-4c6b-856f-795ae6e33d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:05.986451 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-304fa168-3105-4c6b-856f-795ae6e33d7a None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:05.987957 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-304fa168-3105-4c6b-856f-795ae6e33d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:06.019893 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e840318-9e09-4959-9266-e85c8a97725f None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:06.061445 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 227/462] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:39:06.062574 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fa168-3105-4c6b-856f-795ae6e33d7a None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:06.067757 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096aee3-f9b8-443e-a08b-47ac8c0e1bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:06.068650 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096aee3-f9b8-443e-a08b-47ac8c0e1bd8 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:06.069092 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096aee3-f9b8-443e-a08b-47ac8c0e1bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:06.069561 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096aee3-f9b8-443e-a08b-47ac8c0e1bd8 None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:06.070447 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096aee3-f9b8-443e-a08b-47ac8c0e1bd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:06.070911 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096aee3-f9b8-443e-a08b-47ac8c0e1bd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:06.075459 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096aee3-f9b8-443e-a08b-47ac8c0e1bd8 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:06.090895 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 236/463] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:06.096275 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096aee3-f9b8-443e-a08b-47ac8c0e1bd8 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:06.170740 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fa168-3105-4c6b-856f-795ae6e33d7a None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:06.192425 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096aee3-f9b8-443e-a08b-47ac8c0e1bd8 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:06.202765 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1eea5-28ac-46d5-afa5-f54f531100fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:06.203608 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1eea5-28ac-46d5-afa5-f54f531100fb None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:06.203892 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1eea5-28ac-46d5-afa5-f54f531100fb None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:06.204166 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1eea5-28ac-46d5-afa5-f54f531100fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:06.213832 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1eea5-28ac-46d5-afa5-f54f531100fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:06.215271 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1eea5-28ac-46d5-afa5-f54f531100fb None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:06.228858 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db27fd0-345b-475b-962d-c0eba703585e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:06.229879 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db27fd0-345b-475b-962d-c0eba703585e None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:06.230346 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db27fd0-345b-475b-962d-c0eba703585e None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:06.230802 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db27fd0-345b-475b-962d-c0eba703585e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:06.231307 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-baa1eea5-28ac-46d5-afa5-f54f531100fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:06.232472 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 228/464] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:06.233220 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1eea5-28ac-46d5-afa5-f54f531100fb None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:06.246842 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db27fd0-345b-475b-962d-c0eba703585e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:06.248286 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db27fd0-345b-475b-962d-c0eba703585e None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:06.265101 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-0db27fd0-345b-475b-962d-c0eba703585e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:06.271302 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 237/465] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:06.271302 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63164ae0-f780-46a8-9b1a-2108623c7ee9 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:06.271302 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63164ae0-f780-46a8-9b1a-2108623c7ee9 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:06.271302 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63164ae0-f780-46a8-9b1a-2108623c7ee9 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:06.271302 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 238/466] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:06.271302 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63164ae0-f780-46a8-9b1a-2108623c7ee9 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:06.342414 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1eea5-28ac-46d5-afa5-f54f531100fb None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:06.366388 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63164ae0-f780-46a8-9b1a-2108623c7ee9 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:06.374583 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05138b1-4d56-4bb3-b091-75594ebef31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:06.375281 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05138b1-4d56-4bb3-b091-75594ebef31b None admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:06.375907 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05138b1-4d56-4bb3-b091-75594ebef31b None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:06.376184 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05138b1-4d56-4bb3-b091-75594ebef31b None admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:06.377181 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05138b1-4d56-4bb3-b091-75594ebef31b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:06.378912 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05138b1-4d56-4bb3-b091-75594ebef31b None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:06.400726 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecc09b9-2ce6-41ee-b26d-e5479ed638ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:06.401759 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc09b9-2ce6-41ee-b26d-e5479ed638ef None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:06.401866 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 229/467] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Mar 8 13:39:06 2022] POST /identity/v3/users => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:39:06.402358 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc09b9-2ce6-41ee-b26d-e5479ed638ef None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:06.402643 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05138b1-4d56-4bb3-b091-75594ebef31b None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:06.403058 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecc09b9-2ce6-41ee-b26d-e5479ed638ef None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:06.403861 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc09b9-2ce6-41ee-b26d-e5479ed638ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:06.404236 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc09b9-2ce6-41ee-b26d-e5479ed638ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:06.405719 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecc09b9-2ce6-41ee-b26d-e5479ed638ef None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:06.424675 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 239/468] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:06.426182 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e1c79-4bda-4379-8b6c-dd7bc0420799 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:06.426544 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e1c79-4bda-4379-8b6c-dd7bc0420799 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:06.426905 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e1c79-4bda-4379-8b6c-dd7bc0420799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:06.444973 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-ba3e1c79-4bda-4379-8b6c-dd7bc0420799 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:06.446325 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-ba3e1c79-4bda-4379-8b6c-dd7bc0420799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:06.519033 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 240/469] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:06.519686 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e1c79-4bda-4379-8b6c-dd7bc0420799 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:06.574336 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05138b1-4d56-4bb3-b091-75594ebef31b None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:06.611278 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382aa93-6d66-462a-b762-19d7b9ecfe1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:06.611939 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382aa93-6d66-462a-b762-19d7b9ecfe1b None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:06.612210 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382aa93-6d66-462a-b762-19d7b9ecfe1b None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:06.612504 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382aa93-6d66-462a-b762-19d7b9ecfe1b None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:06.614136 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382aa93-6d66-462a-b762-19d7b9ecfe1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:06.614662 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382aa93-6d66-462a-b762-19d7b9ecfe1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:06.616284 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7382aa93-6d66-462a-b762-19d7b9ecfe1b None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:06.622386 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e1c79-4bda-4379-8b6c-dd7bc0420799 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:06.637605 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 230/470] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:06.638763 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382aa93-6d66-462a-b762-19d7b9ecfe1b None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:06.662752 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b4cb6-9641-43e0-9ca4-5b069308f1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:06.663728 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b4cb6-9641-43e0-9ca4-5b069308f1f4 None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:06.663728 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b4cb6-9641-43e0-9ca4-5b069308f1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:06.663900 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b4cb6-9641-43e0-9ca4-5b069308f1f4 None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:06.664499 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b4cb6-9641-43e0-9ca4-5b069308f1f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:06.665963 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b4cb6-9641-43e0-9ca4-5b069308f1f4 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:06.688593 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 241/471] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Mar 8 13:39:06 2022] POST /identity/v3/users => generated 248 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:39:06.689412 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b4cb6-9641-43e0-9ca4-5b069308f1f4 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:06.757149 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382aa93-6d66-462a-b762-19d7b9ecfe1b None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:06.799451 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aea7be-5d20-46b6-b3d8-6e16c1188f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:06.800554 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aea7be-5d20-46b6-b3d8-6e16c1188f2c None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:06.800833 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aea7be-5d20-46b6-b3d8-6e16c1188f2c None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:06.801104 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aea7be-5d20-46b6-b3d8-6e16c1188f2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:06.816174 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aea7be-5d20-46b6-b3d8-6e16c1188f2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:06.818066 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aea7be-5d20-46b6-b3d8-6e16c1188f2c None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:06.824917 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b4cb6-9641-43e0-9ca4-5b069308f1f4 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:06.839725 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-a8aea7be-5d20-46b6-b3d8-6e16c1188f2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:06.841558 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 231/472] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:06.852020 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aea7be-5d20-46b6-b3d8-6e16c1188f2c None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:06.903049 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011edffe-3746-4073-acb1-2b9970e1abeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:06.903744 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011edffe-3746-4073-acb1-2b9970e1abeb None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:06.904027 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011edffe-3746-4073-acb1-2b9970e1abeb None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:06.904301 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011edffe-3746-4073-acb1-2b9970e1abeb None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:06.905017 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011edffe-3746-4073-acb1-2b9970e1abeb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:06.906543 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011edffe-3746-4073-acb1-2b9970e1abeb None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:06.946747 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 242/473] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Mar 8 13:39:06 2022] POST /identity/v3/users => generated 248 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:39:06.970156 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aea7be-5d20-46b6-b3d8-6e16c1188f2c None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:07.009237 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a2001-d734-4ecd-a533-b0676b34314d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:07.010323 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a2001-d734-4ecd-a533-b0676b34314d None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:07.010766 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a2001-d734-4ecd-a533-b0676b34314d None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:07.011197 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a2001-d734-4ecd-a533-b0676b34314d None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:07.012126 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a2001-d734-4ecd-a533-b0676b34314d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:07.012650 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a2001-d734-4ecd-a533-b0676b34314d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:07.014379 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a2001-d734-4ecd-a533-b0676b34314d None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:07.028486 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 232/474] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:07.034336 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011edffe-3746-4073-acb1-2b9970e1abeb None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:07.141601 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011edffe-3746-4073-acb1-2b9970e1abeb None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:07.175061 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7de1bd-da63-4577-8397-5c49040e3f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:07.176017 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7de1bd-da63-4577-8397-5c49040e3f25 None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:07.176458 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7de1bd-da63-4577-8397-5c49040e3f25 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:07.176890 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7de1bd-da63-4577-8397-5c49040e3f25 None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:07.177804 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7de1bd-da63-4577-8397-5c49040e3f25 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:07.179437 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7de1bd-da63-4577-8397-5c49040e3f25 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:07.204441 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 243/475] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Mar 8 13:39:07 2022] POST /identity/v3/users => generated 249 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:39:07.248547 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623b9d9-317d-4a1c-867a-e353581ccfbc None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:07.248907 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623b9d9-317d-4a1c-867a-e353581ccfbc None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:07.249282 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623b9d9-317d-4a1c-867a-e353581ccfbc None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:07.251634 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 233/476] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:07.257388 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fa8e9-0fca-47ef-9f7e-dacf3a737335 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:07.257944 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fa8e9-0fca-47ef-9f7e-dacf3a737335 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:07.258402 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fa8e9-0fca-47ef-9f7e-dacf3a737335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:07.279376 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-602fa8e9-0fca-47ef-9f7e-dacf3a737335 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:07.280925 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-602fa8e9-0fca-47ef-9f7e-dacf3a737335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:07.362170 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 244/477] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:07.397259 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623b9d9-317d-4a1c-867a-e353581ccfbc None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:07.527173 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623b9d9-317d-4a1c-867a-e353581ccfbc None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:07.567807 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944b01c-b937-466b-af8d-d26a2c6e14aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:07.568492 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944b01c-b937-466b-af8d-d26a2c6e14aa None admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:07.568772 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944b01c-b937-466b-af8d-d26a2c6e14aa None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:07.569044 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4944b01c-b937-466b-af8d-d26a2c6e14aa None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:07.569858 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944b01c-b937-466b-af8d-d26a2c6e14aa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:07.571287 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4944b01c-b937-466b-af8d-d26a2c6e14aa None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:07.582600 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.sql.core [None req-4944b01c-b937-466b-af8d-d26a2c6e14aa None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Mar 08 13:39:07.582600 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Mar 08 13:39:07.582600 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [parameters: {'id': '562293266f904cf791e8f1107c37c6a9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Mar 08 13:39:07.582600 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91153) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 08 13:39:07.598132 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-4944b01c-b937-466b-af8d-d26a2c6e14aa None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Mar 08 13:39:07.599809 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 234/478] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Mar 8 13:39:07 2022] POST /identity/v3/roles => generated 144 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:07.605731 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fa8e9-0fca-47ef-9f7e-dacf3a737335 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:07.704909 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fa8e9-0fca-47ef-9f7e-dacf3a737335 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:07.739185 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933b4f3-07e0-4bce-8fe0-df2a0041fded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:07.740093 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933b4f3-07e0-4bce-8fe0-df2a0041fded None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:07.740371 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933b4f3-07e0-4bce-8fe0-df2a0041fded None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:07.740639 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933b4f3-07e0-4bce-8fe0-df2a0041fded None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:07.750843 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933b4f3-07e0-4bce-8fe0-df2a0041fded None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:07.758244 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-e933b4f3-07e0-4bce-8fe0-df2a0041fded None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Mar 08 13:39:07.759729 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 245/479] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Mar 8 13:39:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:39:07.765306 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944b01c-b937-466b-af8d-d26a2c6e14aa None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:07.866462 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4944b01c-b937-466b-af8d-d26a2c6e14aa None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:07.902981 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372c058-6c5e-404e-9eb9-5fc6bafbaacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:07.903701 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372c058-6c5e-404e-9eb9-5fc6bafbaacf None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:07.903988 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372c058-6c5e-404e-9eb9-5fc6bafbaacf None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:07.904268 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372c058-6c5e-404e-9eb9-5fc6bafbaacf None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:07.905023 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372c058-6c5e-404e-9eb9-5fc6bafbaacf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:07.905329 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372c058-6c5e-404e-9eb9-5fc6bafbaacf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:07.906803 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372c058-6c5e-404e-9eb9-5fc6bafbaacf None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:07.915746 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 235/480] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:09.394911 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc18c01-70cf-4316-bb21-85620fde67fa None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:09.395442 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc18c01-70cf-4316-bb21-85620fde67fa None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:09.395442 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc18c01-70cf-4316-bb21-85620fde67fa None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:09.397501 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 246/481] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:09.411364 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcf6ca-2c38-4914-9d12-99fe028df3a4 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:09.412265 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcf6ca-2c38-4914-9d12-99fe028df3a4 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:09.412751 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcf6ca-2c38-4914-9d12-99fe028df3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:09.433317 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-81dcf6ca-2c38-4914-9d12-99fe028df3a4 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:09.434858 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-81dcf6ca-2c38-4914-9d12-99fe028df3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:09.529389 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 236/482] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:09.566651 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc18c01-70cf-4316-bb21-85620fde67fa None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:09.693321 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5f3b4-f4a5-49f4-a402-cc0eadceb209 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:09.693695 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5f3b4-f4a5-49f4-a402-cc0eadceb209 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:09.693896 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5f3b4-f4a5-49f4-a402-cc0eadceb209 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:09.696029 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 237/483] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:09.703130 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc18c01-70cf-4316-bb21-85620fde67fa None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:09.706120 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48670aea-109f-4eba-ad27-8c2c748e4f1d None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:09.708000 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48670aea-109f-4eba-ad27-8c2c748e4f1d None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:09.708000 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48670aea-109f-4eba-ad27-8c2c748e4f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:09.735319 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-48670aea-109f-4eba-ad27-8c2c748e4f1d None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:09.736629 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-48670aea-109f-4eba-ad27-8c2c748e4f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:09.761490 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9cc09-9639-4408-9eac-74e9108125cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:09.762293 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9cc09-9639-4408-9eac-74e9108125cf None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:09.762571 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9cc09-9639-4408-9eac-74e9108125cf None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:09.762841 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9cc09-9639-4408-9eac-74e9108125cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:09.773876 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe9cc09-9639-4408-9eac-74e9108125cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:09.780704 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-cbe9cc09-9639-4408-9eac-74e9108125cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:39:09.782297 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 247/484] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Mar 8 13:39:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:09.788192 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9cc09-9639-4408-9eac-74e9108125cf None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:09.880385 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 238/485] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:39:09.881813 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cc353-fe8b-4cb1-9b0b-e4fec1e3b4db None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:09.882099 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cc353-fe8b-4cb1-9b0b-e4fec1e3b4db None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:09.882547 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cc353-fe8b-4cb1-9b0b-e4fec1e3b4db None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:09.884477 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 239/486] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:09.889395 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e903fc9-b0eb-420c-b46c-b45722467211 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:09.889803 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e903fc9-b0eb-420c-b46c-b45722467211 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:09.890176 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e903fc9-b0eb-420c-b46c-b45722467211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:09.893958 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9cc09-9639-4408-9eac-74e9108125cf None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:09.908518 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-6e903fc9-b0eb-420c-b46c-b45722467211 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:09.909904 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-6e903fc9-b0eb-420c-b46c-b45722467211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:09.927441 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce49c1-8481-42cf-a784-76ac3f1a8ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:09.928114 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce49c1-8481-42cf-a784-76ac3f1a8ed6 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:09.928396 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce49c1-8481-42cf-a784-76ac3f1a8ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:09.928660 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce49c1-8481-42cf-a784-76ac3f1a8ed6 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:09.929429 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce49c1-8481-42cf-a784-76ac3f1a8ed6 None admin] RBAC: Adding query filter params (name=service) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:09.929734 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce49c1-8481-42cf-a784-76ac3f1a8ed6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:09.931090 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce49c1-8481-42cf-a784-76ac3f1a8ed6 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:09.939425 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 248/487] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Mar 8 13:39:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:09.940235 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce49c1-8481-42cf-a784-76ac3f1a8ed6 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:09.983467 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 240/488] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:09.992257 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e903fc9-b0eb-420c-b46c-b45722467211 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:10.059302 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce49c1-8481-42cf-a784-76ac3f1a8ed6 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:10.092826 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c19a0e-17ec-4826-ad95-9b1a0a4457d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:10.094163 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c19a0e-17ec-4826-ad95-9b1a0a4457d0 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:10.094628 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c19a0e-17ec-4826-ad95-9b1a0a4457d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:10.095077 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c19a0e-17ec-4826-ad95-9b1a0a4457d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:10.095175 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e903fc9-b0eb-420c-b46c-b45722467211 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:10.105625 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c19a0e-17ec-4826-ad95-9b1a0a4457d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:10.112985 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-03c19a0e-17ec-4826-ad95-9b1a0a4457d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:39:10.114695 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 249/489] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Mar 8 13:39:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:10.115703 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c19a0e-17ec-4826-ad95-9b1a0a4457d0 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:10.128976 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4674f-eeaf-42cd-961b-7e01bd347ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:10.129816 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4674f-eeaf-42cd-961b-7e01bd347ec2 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:10.130096 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4674f-eeaf-42cd-961b-7e01bd347ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:10.130444 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4674f-eeaf-42cd-961b-7e01bd347ec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:10.140472 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4674f-eeaf-42cd-961b-7e01bd347ec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:10.141970 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4674f-eeaf-42cd-961b-7e01bd347ec2 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:10.159087 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-41f4674f-eeaf-42cd-961b-7e01bd347ec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:10.164932 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 241/490] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:10.164932 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4674f-eeaf-42cd-961b-7e01bd347ec2 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:10.237267 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c19a0e-17ec-4826-ad95-9b1a0a4457d0 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:10.262509 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4674f-eeaf-42cd-961b-7e01bd347ec2 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:10.269260 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b48d4b-2181-44f1-8a99-66f04418824a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:10.270109 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b48d4b-2181-44f1-8a99-66f04418824a None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:10.270385 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b48d4b-2181-44f1-8a99-66f04418824a None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:10.270656 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b48d4b-2181-44f1-8a99-66f04418824a None admin] PATH_INFO: `/v3/roles/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:10.280377 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b48d4b-2181-44f1-8a99-66f04418824a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:10.287789 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-62b48d4b-2181-44f1-8a99-66f04418824a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:39:10.289002 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 250/491] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Mar 8 13:39:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:10.289793 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b48d4b-2181-44f1-8a99-66f04418824a None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:10.299474 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b32479-2c4e-4a98-b79d-cdecbe13ad78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:10.300140 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b32479-2c4e-4a98-b79d-cdecbe13ad78 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:10.300414 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b32479-2c4e-4a98-b79d-cdecbe13ad78 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:10.300681 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b32479-2c4e-4a98-b79d-cdecbe13ad78 None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:10.301457 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b32479-2c4e-4a98-b79d-cdecbe13ad78 None admin] RBAC: Adding query filter params (name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:10.301758 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b32479-2c4e-4a98-b79d-cdecbe13ad78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:10.303120 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b32479-2c4e-4a98-b79d-cdecbe13ad78 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:10.315352 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 242/492] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Mar 8 13:39:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:10.315352 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184766d-c8b3-476c-b1e5-dc94b84844e7 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:10.315352 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184766d-c8b3-476c-b1e5-dc94b84844e7 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:10.315352 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184766d-c8b3-476c-b1e5-dc94b84844e7 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:10.315352 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 243/493] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:10.315745 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184766d-c8b3-476c-b1e5-dc94b84844e7 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:10.404943 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b48d4b-2181-44f1-8a99-66f04418824a None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:10.419313 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184766d-c8b3-476c-b1e5-dc94b84844e7 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:10.439300 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a4c02-b58c-4dec-b1ae-9cfa074e2f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:10.439963 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a4c02-b58c-4dec-b1ae-9cfa074e2f5e None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:10.440242 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a4c02-b58c-4dec-b1ae-9cfa074e2f5e None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:10.440511 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a4c02-b58c-4dec-b1ae-9cfa074e2f5e None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:10.441233 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a4c02-b58c-4dec-b1ae-9cfa074e2f5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:10.441570 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a4c02-b58c-4dec-b1ae-9cfa074e2f5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:10.442928 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a4c02-b58c-4dec-b1ae-9cfa074e2f5e None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:10.451530 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b96e6c-a6a1-4b34-bb95-882dbe69e5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:10.452185 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b96e6c-a6a1-4b34-bb95-882dbe69e5ff None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:10.452456 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b96e6c-a6a1-4b34-bb95-882dbe69e5ff None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:10.452715 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b96e6c-a6a1-4b34-bb95-882dbe69e5ff None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:10.453551 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b96e6c-a6a1-4b34-bb95-882dbe69e5ff None admin] RBAC: Adding query filter params (name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:10.453852 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b96e6c-a6a1-4b34-bb95-882dbe69e5ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:10.459631 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 251/494] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:10.459763 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b96e6c-a6a1-4b34-bb95-882dbe69e5ff None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:10.459852 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a4c02-b58c-4dec-b1ae-9cfa074e2f5e None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:10.471370 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 244/495] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Mar 8 13:39:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:10.471370 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59502f-0b1b-4d5f-a28d-39ccfa89ce44 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:10.471370 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59502f-0b1b-4d5f-a28d-39ccfa89ce44 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:10.471370 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a59502f-0b1b-4d5f-a28d-39ccfa89ce44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:10.488986 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-2a59502f-0b1b-4d5f-a28d-39ccfa89ce44 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:10.490151 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-2a59502f-0b1b-4d5f-a28d-39ccfa89ce44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:10.565384 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 245/496] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:10.565580 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a4c02-b58c-4dec-b1ae-9cfa074e2f5e None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:10.565674 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59502f-0b1b-4d5f-a28d-39ccfa89ce44 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:10.589075 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6544e-4b17-4f9d-a3e6-42d8425f078c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:10.589965 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6544e-4b17-4f9d-a3e6-42d8425f078c None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:10.590253 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6544e-4b17-4f9d-a3e6-42d8425f078c None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:10.590513 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6544e-4b17-4f9d-a3e6-42d8425f078c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:10.601134 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b6544e-4b17-4f9d-a3e6-42d8425f078c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:10.602630 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b6544e-4b17-4f9d-a3e6-42d8425f078c None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:10.619048 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-d6b6544e-4b17-4f9d-a3e6-42d8425f078c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:10.624482 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 252/497] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:10.624482 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6544e-4b17-4f9d-a3e6-42d8425f078c None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:10.667183 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a59502f-0b1b-4d5f-a28d-39ccfa89ce44 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:10.701839 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697237cd-1461-41ad-8a14-2469abd6ebbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:10.702662 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697237cd-1461-41ad-8a14-2469abd6ebbc None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:10.703000 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697237cd-1461-41ad-8a14-2469abd6ebbc None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:10.703268 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697237cd-1461-41ad-8a14-2469abd6ebbc None admin] PATH_INFO: `/v3/users/nova` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:10.710574 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697237cd-1461-41ad-8a14-2469abd6ebbc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:10.712034 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697237cd-1461-41ad-8a14-2469abd6ebbc None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:10.718384 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6544e-4b17-4f9d-a3e6-42d8425f078c None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:10.725553 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-697237cd-1461-41ad-8a14-2469abd6ebbc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 13:39:10.726915 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 246/498] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Mar 8 13:39:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:10.727805 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697237cd-1461-41ad-8a14-2469abd6ebbc None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:10.759096 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498167b-0904-4a82-8cfd-c6a894fd449e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:10.759906 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498167b-0904-4a82-8cfd-c6a894fd449e None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:10.760244 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498167b-0904-4a82-8cfd-c6a894fd449e None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:10.760570 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498167b-0904-4a82-8cfd-c6a894fd449e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:10.770415 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498167b-0904-4a82-8cfd-c6a894fd449e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:10.772135 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498167b-0904-4a82-8cfd-c6a894fd449e None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:10.788483 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-2498167b-0904-4a82-8cfd-c6a894fd449e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:10.789669 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 253/499] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:10.790420 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498167b-0904-4a82-8cfd-c6a894fd449e None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:10.821450 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697237cd-1461-41ad-8a14-2469abd6ebbc None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:10.854486 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c90efe-8fcf-46fd-9bab-9f4b0f6f99ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:10.855274 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c90efe-8fcf-46fd-9bab-9f4b0f6f99ed None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:10.855547 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c90efe-8fcf-46fd-9bab-9f4b0f6f99ed None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:10.855820 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c90efe-8fcf-46fd-9bab-9f4b0f6f99ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:10.865597 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c90efe-8fcf-46fd-9bab-9f4b0f6f99ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:10.872453 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-f4c90efe-8fcf-46fd-9bab-9f4b0f6f99ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:39:10.873676 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 247/500] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Mar 8 13:39:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:10.874429 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c90efe-8fcf-46fd-9bab-9f4b0f6f99ed None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:10.886209 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498167b-0904-4a82-8cfd-c6a894fd449e None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:10.919900 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1db081-6ed2-4465-90d5-39ce82797d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:10.920550 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1db081-6ed2-4465-90d5-39ce82797d48 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:10.920821 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1db081-6ed2-4465-90d5-39ce82797d48 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:10.921092 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1db081-6ed2-4465-90d5-39ce82797d48 None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:10.921880 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1db081-6ed2-4465-90d5-39ce82797d48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:10.922182 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1db081-6ed2-4465-90d5-39ce82797d48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:10.923554 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1db081-6ed2-4465-90d5-39ce82797d48 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:10.934272 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 254/501] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:10.935511 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7676716-032b-4fcd-adcf-de00908bb6fa None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:10.935795 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7676716-032b-4fcd-adcf-de00908bb6fa None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:10.936067 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7676716-032b-4fcd-adcf-de00908bb6fa None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:10.937908 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 255/502] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:10.938640 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7676716-032b-4fcd-adcf-de00908bb6fa None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:10.967663 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c90efe-8fcf-46fd-9bab-9f4b0f6f99ed None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:10.998334 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30bc60-de40-4042-994e-e2214f209dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:10.998999 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30bc60-de40-4042-994e-e2214f209dea None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:10.999264 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30bc60-de40-4042-994e-e2214f209dea None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:10.999535 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30bc60-de40-4042-994e-e2214f209dea None admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:11.000421 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30bc60-de40-4042-994e-e2214f209dea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:11.000733 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30bc60-de40-4042-994e-e2214f209dea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:11.002213 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30bc60-de40-4042-994e-e2214f209dea None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:11.034324 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7676716-032b-4fcd-adcf-de00908bb6fa None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:11.036912 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 248/503] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Mar 8 13:39:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:11.037532 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30bc60-de40-4042-994e-e2214f209dea None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:11.067024 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813dd25-6229-41f5-a257-9df914da356d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:11.067826 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813dd25-6229-41f5-a257-9df914da356d None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:11.068091 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813dd25-6229-41f5-a257-9df914da356d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:11.068357 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813dd25-6229-41f5-a257-9df914da356d None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:11.069060 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813dd25-6229-41f5-a257-9df914da356d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:11.069381 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813dd25-6229-41f5-a257-9df914da356d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:11.070732 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813dd25-6229-41f5-a257-9df914da356d None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:11.082139 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 256/504] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:11.082900 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813dd25-6229-41f5-a257-9df914da356d None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:11.131396 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30bc60-de40-4042-994e-e2214f209dea None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:11.164502 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfffbfd4-29c8-40a1-9c27-3af773bff2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:11.165180 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffbfd4-29c8-40a1-9c27-3af773bff2e4 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:11.165472 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffbfd4-29c8-40a1-9c27-3af773bff2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:11.165744 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfffbfd4-29c8-40a1-9c27-3af773bff2e4 None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:11.166494 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffbfd4-29c8-40a1-9c27-3af773bff2e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:11.166799 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffbfd4-29c8-40a1-9c27-3af773bff2e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:11.168256 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfffbfd4-29c8-40a1-9c27-3af773bff2e4 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:11.175880 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 249/505] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Mar 8 13:39:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:11.177160 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da8302-d2fd-4f53-893d-3e1ba461b335 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:11.177483 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da8302-d2fd-4f53-893d-3e1ba461b335 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:11.177760 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da8302-d2fd-4f53-893d-3e1ba461b335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:11.178157 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813dd25-6229-41f5-a257-9df914da356d None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:11.193685 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-c8da8302-d2fd-4f53-893d-3e1ba461b335 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:11.194892 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-c8da8302-d2fd-4f53-893d-3e1ba461b335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:11.212234 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952d1b0-4f73-4254-8f38-01c026367aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:11.213113 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952d1b0-4f73-4254-8f38-01c026367aaa None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:11.213476 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952d1b0-4f73-4254-8f38-01c026367aaa None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:11.213772 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952d1b0-4f73-4254-8f38-01c026367aaa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:11.220642 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952d1b0-4f73-4254-8f38-01c026367aaa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:11.222084 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952d1b0-4f73-4254-8f38-01c026367aaa None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:11.235130 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-4952d1b0-4f73-4254-8f38-01c026367aaa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 08 13:39:11.236314 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 257/506] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:39:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:11.237050 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952d1b0-4f73-4254-8f38-01c026367aaa None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:11.258082 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 250/507] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:11.258888 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da8302-d2fd-4f53-893d-3e1ba461b335 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:11.330967 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952d1b0-4f73-4254-8f38-01c026367aaa None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:11.349857 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da8302-d2fd-4f53-893d-3e1ba461b335 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:11.363664 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379403b-cb3f-4835-97aa-cb0b727e1a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:11.364297 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379403b-cb3f-4835-97aa-cb0b727e1a3a None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:11.364577 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379403b-cb3f-4835-97aa-cb0b727e1a3a None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:11.364842 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379403b-cb3f-4835-97aa-cb0b727e1a3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:11.383519 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa8e37-90c0-4462-9d06-c568c6e6b0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:11.384315 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa8e37-90c0-4462-9d06-c568c6e6b0f3 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:11.384591 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa8e37-90c0-4462-9d06-c568c6e6b0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:11.384852 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa8e37-90c0-4462-9d06-c568c6e6b0f3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:11.391785 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa8e37-90c0-4462-9d06-c568c6e6b0f3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:11.393219 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa8e37-90c0-4462-9d06-c568c6e6b0f3 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:11.406349 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-9aaa8e37-90c0-4462-9d06-c568c6e6b0f3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 08 13:39:11.407517 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 251/508] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:39:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:11.408580 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa8e37-90c0-4462-9d06-c568c6e6b0f3 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:11.427481 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379403b-cb3f-4835-97aa-cb0b727e1a3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:11.428903 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d379403b-cb3f-4835-97aa-cb0b727e1a3a None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:11.505715 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa8e37-90c0-4462-9d06-c568c6e6b0f3 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:11.523957 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 258/509] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:39:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:11.524790 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379403b-cb3f-4835-97aa-cb0b727e1a3a None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:11.538229 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40a26f-89d2-47c0-a05f-2e0c0a5e0f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:11.539018 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40a26f-89d2-47c0-a05f-2e0c0a5e0f30 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:11.539289 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40a26f-89d2-47c0-a05f-2e0c0a5e0f30 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:11.539547 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40a26f-89d2-47c0-a05f-2e0c0a5e0f30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:11.549162 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40a26f-89d2-47c0-a05f-2e0c0a5e0f30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:11.550662 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40a26f-89d2-47c0-a05f-2e0c0a5e0f30 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:11.566476 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-de40a26f-89d2-47c0-a05f-2e0c0a5e0f30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:11.567633 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 252/510] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:11.568397 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40a26f-89d2-47c0-a05f-2e0c0a5e0f30 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:11.619880 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379403b-cb3f-4835-97aa-cb0b727e1a3a None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:11.652667 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde8ec0-8769-4503-bc59-218d82a2c088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:11.653332 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde8ec0-8769-4503-bc59-218d82a2c088 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:11.653630 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde8ec0-8769-4503-bc59-218d82a2c088 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:11.653895 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde8ec0-8769-4503-bc59-218d82a2c088 None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:11.654721 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde8ec0-8769-4503-bc59-218d82a2c088 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:11.655019 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde8ec0-8769-4503-bc59-218d82a2c088 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:11.656490 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde8ec0-8769-4503-bc59-218d82a2c088 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:11.661804 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40a26f-89d2-47c0-a05f-2e0c0a5e0f30 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:11.693406 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 259/511] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Mar 8 13:39:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:11.694289 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde8ec0-8769-4503-bc59-218d82a2c088 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:11.694590 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54857af-6cb2-45bb-88be-eba7f28f2e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:11.695381 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54857af-6cb2-45bb-88be-eba7f28f2e14 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:11.695657 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54857af-6cb2-45bb-88be-eba7f28f2e14 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:11.695930 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54857af-6cb2-45bb-88be-eba7f28f2e14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:11.706845 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54857af-6cb2-45bb-88be-eba7f28f2e14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:11.708349 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54857af-6cb2-45bb-88be-eba7f28f2e14 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:11.724471 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-b54857af-6cb2-45bb-88be-eba7f28f2e14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:11.725672 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 253/512] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:11.726425 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54857af-6cb2-45bb-88be-eba7f28f2e14 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:11.789273 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde8ec0-8769-4503-bc59-218d82a2c088 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:11.822125 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54857af-6cb2-45bb-88be-eba7f28f2e14 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:11.823910 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f595d82-e02e-40a2-9e53-938c85607242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:11.824585 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f595d82-e02e-40a2-9e53-938c85607242 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:11.824871 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f595d82-e02e-40a2-9e53-938c85607242 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:11.825142 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f595d82-e02e-40a2-9e53-938c85607242 None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:11.826027 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f595d82-e02e-40a2-9e53-938c85607242 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:11.826333 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f595d82-e02e-40a2-9e53-938c85607242 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:11.827772 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f595d82-e02e-40a2-9e53-938c85607242 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:11.844921 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 260/513] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Mar 8 13:39:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:11.845754 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f595d82-e02e-40a2-9e53-938c85607242 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:11.855128 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e3aa8-7d49-44a7-84df-5451f40d8a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:11.855894 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e3aa8-7d49-44a7-84df-5451f40d8a1d None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:11.856170 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e3aa8-7d49-44a7-84df-5451f40d8a1d None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:11.856441 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e3aa8-7d49-44a7-84df-5451f40d8a1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:11.866141 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e3aa8-7d49-44a7-84df-5451f40d8a1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:11.867595 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e3aa8-7d49-44a7-84df-5451f40d8a1d None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:11.883738 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-a82e3aa8-7d49-44a7-84df-5451f40d8a1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:11.884841 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 254/514] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:11.885686 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e3aa8-7d49-44a7-84df-5451f40d8a1d None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:11.942910 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f595d82-e02e-40a2-9e53-938c85607242 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:11.978974 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f02e7-17ee-4bfe-ac13-7df0e483444f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:11.979801 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f02e7-17ee-4bfe-ac13-7df0e483444f None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:11.980079 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f02e7-17ee-4bfe-ac13-7df0e483444f None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:11.980419 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f02e7-17ee-4bfe-ac13-7df0e483444f None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:11.981225 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f02e7-17ee-4bfe-ac13-7df0e483444f None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:11.981555 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f02e7-17ee-4bfe-ac13-7df0e483444f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:11.982577 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e3aa8-7d49-44a7-84df-5451f40d8a1d None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:11.982924 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f02e7-17ee-4bfe-ac13-7df0e483444f None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:11.994781 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 261/515] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:11.995587 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f02e7-17ee-4bfe-ac13-7df0e483444f None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:12.017286 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce5bd3-72d0-4d88-b935-3fa18fbfc636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:12.017958 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce5bd3-72d0-4d88-b935-3fa18fbfc636 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:12.018243 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce5bd3-72d0-4d88-b935-3fa18fbfc636 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:12.018519 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce5bd3-72d0-4d88-b935-3fa18fbfc636 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:12.086325 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce5bd3-72d0-4d88-b935-3fa18fbfc636 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:12.087771 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce5bd3-72d0-4d88-b935-3fa18fbfc636 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:12.099872 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f02e7-17ee-4bfe-ac13-7df0e483444f None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:12.131749 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214ceb4-19e8-4368-83b3-160af0651f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:12.132396 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214ceb4-19e8-4368-83b3-160af0651f28 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:12.132675 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214ceb4-19e8-4368-83b3-160af0651f28 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:12.132945 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214ceb4-19e8-4368-83b3-160af0651f28 None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:12.133688 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214ceb4-19e8-4368-83b3-160af0651f28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:12.134038 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214ceb4-19e8-4368-83b3-160af0651f28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:12.135348 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214ceb4-19e8-4368-83b3-160af0651f28 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:12.147051 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 262/516] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:12.147688 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214ceb4-19e8-4368-83b3-160af0651f28 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:12.183738 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 255/517] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:39:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:12.184566 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce5bd3-72d0-4d88-b935-3fa18fbfc636 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:12.240328 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214ceb4-19e8-4368-83b3-160af0651f28 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:12.275078 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7296f-6082-4561-89be-77d76e55c1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:12.275705 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7296f-6082-4561-89be-77d76e55c1aa None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:12.275977 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7296f-6082-4561-89be-77d76e55c1aa None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:12.276217 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7296f-6082-4561-89be-77d76e55c1aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:12.278472 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce5bd3-72d0-4d88-b935-3fa18fbfc636 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:12.311334 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97b763-cfee-42d8-b279-272ddcfb75c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:12.312009 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97b763-cfee-42d8-b279-272ddcfb75c9 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:12.312312 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97b763-cfee-42d8-b279-272ddcfb75c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:12.312583 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97b763-cfee-42d8-b279-272ddcfb75c9 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:12.313307 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97b763-cfee-42d8-b279-272ddcfb75c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:12.313641 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97b763-cfee-42d8-b279-272ddcfb75c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:12.315021 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97b763-cfee-42d8-b279-272ddcfb75c9 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:12.326051 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 256/518] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:12.326667 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97b763-cfee-42d8-b279-272ddcfb75c9 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:12.343126 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7296f-6082-4561-89be-77d76e55c1aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:12.344600 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7296f-6082-4561-89be-77d76e55c1aa None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:12.419852 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97b763-cfee-42d8-b279-272ddcfb75c9 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:12.435481 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 263/519] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:39:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:12.436288 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7296f-6082-4561-89be-77d76e55c1aa None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:12.452685 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94067e-f01a-4912-8793-ca92ea114af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:12.453504 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94067e-f01a-4912-8793-ca92ea114af6 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:12.453793 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94067e-f01a-4912-8793-ca92ea114af6 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:12.454061 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94067e-f01a-4912-8793-ca92ea114af6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:12.461691 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94067e-f01a-4912-8793-ca92ea114af6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:12.463130 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94067e-f01a-4912-8793-ca92ea114af6 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:12.476516 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-3e94067e-f01a-4912-8793-ca92ea114af6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 08 13:39:12.477752 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 257/520] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Mar 8 13:39:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:12.478506 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94067e-f01a-4912-8793-ca92ea114af6 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:12.530448 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7296f-6082-4561-89be-77d76e55c1aa None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:12.562722 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90a5f7-60c1-4b3c-8277-2b497cd4526a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:12.563395 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90a5f7-60c1-4b3c-8277-2b497cd4526a None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:12.563674 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90a5f7-60c1-4b3c-8277-2b497cd4526a None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:12.563930 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90a5f7-60c1-4b3c-8277-2b497cd4526a None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:12.564659 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90a5f7-60c1-4b3c-8277-2b497cd4526a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:12.566128 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90a5f7-60c1-4b3c-8277-2b497cd4526a None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:12.575998 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94067e-f01a-4912-8793-ca92ea114af6 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:12.591734 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 264/521] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Mar 8 13:39:12 2022] POST /identity/v3/users => generated 247 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:39:12.591734 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90a5f7-60c1-4b3c-8277-2b497cd4526a None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:12.610899 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9aa7d-e340-4c05-9b39-71f328c05510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:12.611738 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9aa7d-e340-4c05-9b39-71f328c05510 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:12.612012 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9aa7d-e340-4c05-9b39-71f328c05510 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:12.612277 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e9aa7d-e340-4c05-9b39-71f328c05510 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:12.624486 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9aa7d-e340-4c05-9b39-71f328c05510 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:12.626004 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e9aa7d-e340-4c05-9b39-71f328c05510 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:12.642808 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-07e9aa7d-e340-4c05-9b39-71f328c05510 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:12.644451 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 258/522] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:12.644923 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9aa7d-e340-4c05-9b39-71f328c05510 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:12.700356 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90a5f7-60c1-4b3c-8277-2b497cd4526a None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:12.734196 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207fded-11df-4d80-9a0c-991a2cf1189a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:12.735009 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207fded-11df-4d80-9a0c-991a2cf1189a None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:12.735287 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207fded-11df-4d80-9a0c-991a2cf1189a None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:12.735561 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207fded-11df-4d80-9a0c-991a2cf1189a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:12.742731 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207fded-11df-4d80-9a0c-991a2cf1189a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:12.744201 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207fded-11df-4d80-9a0c-991a2cf1189a None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:12.746713 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e9aa7d-e340-4c05-9b39-71f328c05510 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:12.758684 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-1207fded-11df-4d80-9a0c-991a2cf1189a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:12.764752 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 265/523] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:12.764752 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207fded-11df-4d80-9a0c-991a2cf1189a None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:12.782647 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df4037-ddf3-4bce-b807-dda0b9eb333b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:12.783850 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df4037-ddf3-4bce-b807-dda0b9eb333b None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:12.784628 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df4037-ddf3-4bce-b807-dda0b9eb333b None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:12.784628 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df4037-ddf3-4bce-b807-dda0b9eb333b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:12.796703 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df4037-ddf3-4bce-b807-dda0b9eb333b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:12.798255 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df4037-ddf3-4bce-b807-dda0b9eb333b None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:12.815994 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-22df4037-ddf3-4bce-b807-dda0b9eb333b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:12.817223 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 259/524] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:12.818083 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df4037-ddf3-4bce-b807-dda0b9eb333b None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:12.863421 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207fded-11df-4d80-9a0c-991a2cf1189a None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:12.895852 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf218cf-0d00-4541-8eb7-70d4247df6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:12.896791 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf218cf-0d00-4541-8eb7-70d4247df6b3 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:12.897240 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf218cf-0d00-4541-8eb7-70d4247df6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:12.897707 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf218cf-0d00-4541-8eb7-70d4247df6b3 None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:12.898734 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf218cf-0d00-4541-8eb7-70d4247df6b3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:12.899202 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf218cf-0d00-4541-8eb7-70d4247df6b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:12.900812 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf218cf-0d00-4541-8eb7-70d4247df6b3 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:12.914427 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df4037-ddf3-4bce-b807-dda0b9eb333b None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:12.922724 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 266/525] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Mar 8 13:39:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:12.922724 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf218cf-0d00-4541-8eb7-70d4247df6b3 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:12.947115 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1abb3-dccf-43e8-bf27-ab3677342b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:12.947787 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1abb3-dccf-43e8-bf27-ab3677342b7e None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:12.948067 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1abb3-dccf-43e8-bf27-ab3677342b7e None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:12.948337 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1abb3-dccf-43e8-bf27-ab3677342b7e None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:12.949056 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1abb3-dccf-43e8-bf27-ab3677342b7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:12.949371 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1abb3-dccf-43e8-bf27-ab3677342b7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:12.950915 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1abb3-dccf-43e8-bf27-ab3677342b7e None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:12.966810 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 260/526] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:12.966810 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1abb3-dccf-43e8-bf27-ab3677342b7e None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:13.013066 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf218cf-0d00-4541-8eb7-70d4247df6b3 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:13.048053 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901d846-a18c-4b3d-8717-2b70b8bd23d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:13.048718 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901d846-a18c-4b3d-8717-2b70b8bd23d1 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:13.048996 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901d846-a18c-4b3d-8717-2b70b8bd23d1 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:13.049265 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901d846-a18c-4b3d-8717-2b70b8bd23d1 None admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:13.050086 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901d846-a18c-4b3d-8717-2b70b8bd23d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:13.050393 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901d846-a18c-4b3d-8717-2b70b8bd23d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:13.051823 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901d846-a18c-4b3d-8717-2b70b8bd23d1 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:13.062386 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1abb3-dccf-43e8-bf27-ab3677342b7e None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:13.069058 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 267/527] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:39:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:13.070074 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901d846-a18c-4b3d-8717-2b70b8bd23d1 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:13.104710 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902eee65-8999-42dd-9b7e-1ed7d3b3a496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:13.105399 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902eee65-8999-42dd-9b7e-1ed7d3b3a496 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:13.105683 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902eee65-8999-42dd-9b7e-1ed7d3b3a496 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:13.105955 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902eee65-8999-42dd-9b7e-1ed7d3b3a496 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:13.106680 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902eee65-8999-42dd-9b7e-1ed7d3b3a496 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:13.106986 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902eee65-8999-42dd-9b7e-1ed7d3b3a496 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:13.108356 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902eee65-8999-42dd-9b7e-1ed7d3b3a496 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:13.123844 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 261/528] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:13.123844 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902eee65-8999-42dd-9b7e-1ed7d3b3a496 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:13.171946 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901d846-a18c-4b3d-8717-2b70b8bd23d1 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:13.207148 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961af359-64bc-4257-ad20-f5dc7ff56057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:13.207724 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961af359-64bc-4257-ad20-f5dc7ff56057 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:13.208027 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961af359-64bc-4257-ad20-f5dc7ff56057 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:13.208300 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961af359-64bc-4257-ad20-f5dc7ff56057 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:13.216704 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902eee65-8999-42dd-9b7e-1ed7d3b3a496 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:13.252150 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564d392-ccbd-4333-a568-abd70255236d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:13.252935 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564d392-ccbd-4333-a568-abd70255236d None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:13.253208 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564d392-ccbd-4333-a568-abd70255236d None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:13.253507 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564d392-ccbd-4333-a568-abd70255236d None admin] PATH_INFO: `/v3/projects/service` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:13.259781 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564d392-ccbd-4333-a568-abd70255236d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:13.261217 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564d392-ccbd-4333-a568-abd70255236d None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:13.271507 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961af359-64bc-4257-ad20-f5dc7ff56057 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:13.272963 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961af359-64bc-4257-ad20-f5dc7ff56057 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:13.274054 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-9564d392-ccbd-4333-a568-abd70255236d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:13.279923 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 262/529] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:13.279923 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564d392-ccbd-4333-a568-abd70255236d None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:13.374282 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 268/530] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:39:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:13.375517 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961af359-64bc-4257-ad20-f5dc7ff56057 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:13.376192 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564d392-ccbd-4333-a568-abd70255236d None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:13.410953 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bfa18-c9f3-40b7-b120-4a4c6f326ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:13.411868 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bfa18-c9f3-40b7-b120-4a4c6f326ae6 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:13.412152 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bfa18-c9f3-40b7-b120-4a4c6f326ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:13.412428 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38bfa18-c9f3-40b7-b120-4a4c6f326ae6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:13.413257 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38bfa18-c9f3-40b7-b120-4a4c6f326ae6 None admin] RBAC: Adding query filter params (role.id=5189c0e028ff42908ca943fdb5ce1873, scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e, user.id=21ec894123044d4382995791c74c587b) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:13.413602 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38bfa18-c9f3-40b7-b120-4a4c6f326ae6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:13.415033 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38bfa18-c9f3-40b7-b120-4a4c6f326ae6 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:13.422943 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 263/531] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:39:13 2022] GET /identity/v3/role_assignments?user.id=21ec894123044d4382995791c74c587b&scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e&role.id=5189c0e028ff42908ca943fdb5ce1873 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:13.422943 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bfa18-c9f3-40b7-b120-4a4c6f326ae6 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:13.477867 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961af359-64bc-4257-ad20-f5dc7ff56057 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:13.514214 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5d1eb-fed2-4f0a-9b34-3871472f8b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:13.514751 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5d1eb-fed2-4f0a-9b34-3871472f8b3a None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:13.515055 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5d1eb-fed2-4f0a-9b34-3871472f8b3a None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:13.515339 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b5d1eb-fed2-4f0a-9b34-3871472f8b3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:13.523025 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5d1eb-fed2-4f0a-9b34-3871472f8b3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:13.524499 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b5d1eb-fed2-4f0a-9b34-3871472f8b3a None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:13.535582 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38bfa18-c9f3-40b7-b120-4a4c6f326ae6 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:13.539479 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-08b5d1eb-fed2-4f0a-9b34-3871472f8b3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:13.545025 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 269/532] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:13.546041 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5d1eb-fed2-4f0a-9b34-3871472f8b3a None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:13.572404 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab88a6-5799-4eb1-beee-0cb5ea16ce7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:13.573480 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab88a6-5799-4eb1-beee-0cb5ea16ce7e None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:13.573986 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab88a6-5799-4eb1-beee-0cb5ea16ce7e None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:13.574471 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab88a6-5799-4eb1-beee-0cb5ea16ce7e None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:13.575483 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab88a6-5799-4eb1-beee-0cb5ea16ce7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:13.575999 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab88a6-5799-4eb1-beee-0cb5ea16ce7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:13.577737 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab88a6-5799-4eb1-beee-0cb5ea16ce7e None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:13.597618 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 264/533] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:39:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:13.598829 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab88a6-5799-4eb1-beee-0cb5ea16ce7e None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:13.651646 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b5d1eb-fed2-4f0a-9b34-3871472f8b3a None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:13.686977 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c0021-5ca3-409b-911d-567aaaa72b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:13.687728 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c0021-5ca3-409b-911d-567aaaa72b6e None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:13.688049 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c0021-5ca3-409b-911d-567aaaa72b6e None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:13.688320 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7c0021-5ca3-409b-911d-567aaaa72b6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:13.699279 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c0021-5ca3-409b-911d-567aaaa72b6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:13.700111 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab88a6-5799-4eb1-beee-0cb5ea16ce7e None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:13.700728 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7c0021-5ca3-409b-911d-567aaaa72b6e None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:13.717943 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-dc7c0021-5ca3-409b-911d-567aaaa72b6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:13.719582 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 270/534] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:13.720600 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c0021-5ca3-409b-911d-567aaaa72b6e None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:13.737575 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e0cf3-26f7-4012-b8fd-2a0d753fd71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:13.738565 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e0cf3-26f7-4012-b8fd-2a0d753fd71c None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:13.739034 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e0cf3-26f7-4012-b8fd-2a0d753fd71c None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:13.739512 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e0cf3-26f7-4012-b8fd-2a0d753fd71c None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:13.740490 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e0cf3-26f7-4012-b8fd-2a0d753fd71c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:13.740989 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e0cf3-26f7-4012-b8fd-2a0d753fd71c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:13.742648 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e0cf3-26f7-4012-b8fd-2a0d753fd71c None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:13.754932 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 265/535] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:39:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:13.756160 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e0cf3-26f7-4012-b8fd-2a0d753fd71c None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:13.829534 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7c0021-5ca3-409b-911d-567aaaa72b6e None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:13.855522 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e0cf3-26f7-4012-b8fd-2a0d753fd71c None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:13.862267 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5159e-2fc0-4010-82f0-ffc3c8cbed8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:13.862920 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5159e-2fc0-4010-82f0-ffc3c8cbed8d None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:13.863255 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5159e-2fc0-4010-82f0-ffc3c8cbed8d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:13.863525 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5159e-2fc0-4010-82f0-ffc3c8cbed8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:13.864487 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5159e-2fc0-4010-82f0-ffc3c8cbed8d None admin] RBAC: Adding query filter params (role.id=5189c0e028ff42908ca943fdb5ce1873, scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e, user.id=56ddb15832b048f5a19d7d3887e088b3) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:13.864702 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5159e-2fc0-4010-82f0-ffc3c8cbed8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:13.866156 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5159e-2fc0-4010-82f0-ffc3c8cbed8d None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:13.871901 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 271/536] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:39:13 2022] GET /identity/v3/role_assignments?user.id=56ddb15832b048f5a19d7d3887e088b3&scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e&role.id=5189c0e028ff42908ca943fdb5ce1873 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:13.872814 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5159e-2fc0-4010-82f0-ffc3c8cbed8d None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:13.892395 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a957ec6-8c3a-485f-b0fc-32170414f821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:13.893473 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a957ec6-8c3a-485f-b0fc-32170414f821 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:13.893978 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a957ec6-8c3a-485f-b0fc-32170414f821 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:13.894445 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a957ec6-8c3a-485f-b0fc-32170414f821 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:13.895395 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a957ec6-8c3a-485f-b0fc-32170414f821 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:13.895906 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a957ec6-8c3a-485f-b0fc-32170414f821 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:13.897590 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a957ec6-8c3a-485f-b0fc-32170414f821 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:13.911008 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 266/537] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:13.918655 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a957ec6-8c3a-485f-b0fc-32170414f821 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:14.024820 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5159e-2fc0-4010-82f0-ffc3c8cbed8d None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:14.084818 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3cb47-418c-4384-b1da-a702139c39c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:14.086326 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3cb47-418c-4384-b1da-a702139c39c2 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:14.086809 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3cb47-418c-4384-b1da-a702139c39c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:14.087534 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3cb47-418c-4384-b1da-a702139c39c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:14.089084 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3cb47-418c-4384-b1da-a702139c39c2 None admin] RBAC: Adding query filter params (role.id=5189c0e028ff42908ca943fdb5ce1873, scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e, user.id=731b8e066deb49e6b48804cbbe5cd6e9) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:14.089596 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3cb47-418c-4384-b1da-a702139c39c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:14.097654 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a957ec6-8c3a-485f-b0fc-32170414f821 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:14.097865 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3cb47-418c-4384-b1da-a702139c39c2 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:14.117695 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 272/538] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:39:13 2022] GET /identity/v3/role_assignments?user.id=731b8e066deb49e6b48804cbbe5cd6e9&scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e&role.id=5189c0e028ff42908ca943fdb5ce1873 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:14.143780 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e3aec-66be-4ba9-bb78-6a8a404ea795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:14.144590 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e3aec-66be-4ba9-bb78-6a8a404ea795 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:14.144867 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e3aec-66be-4ba9-bb78-6a8a404ea795 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:14.145188 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e3aec-66be-4ba9-bb78-6a8a404ea795 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:14.155245 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e3aec-66be-4ba9-bb78-6a8a404ea795 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:14.156839 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e3aec-66be-4ba9-bb78-6a8a404ea795 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:14.171151 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-792e3aec-66be-4ba9-bb78-6a8a404ea795 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:14.172827 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 267/539] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:14.178200 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3cb47-418c-4384-b1da-a702139c39c2 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:14.328011 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3cb47-418c-4384-b1da-a702139c39c2 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:14.365719 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb47c0-f997-481b-8351-dee3483ae486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:14.366382 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb47c0-f997-481b-8351-dee3483ae486 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:14.366654 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb47c0-f997-481b-8351-dee3483ae486 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:14.366919 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb47c0-f997-481b-8351-dee3483ae486 None admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:14.367704 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb47c0-f997-481b-8351-dee3483ae486 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:14.368001 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb47c0-f997-481b-8351-dee3483ae486 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:14.369421 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb47c0-f997-481b-8351-dee3483ae486 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:14.387219 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 273/540] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:39:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:14.393204 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e3aec-66be-4ba9-bb78-6a8a404ea795 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:14.570422 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e3aec-66be-4ba9-bb78-6a8a404ea795 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:14.618150 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640625ea-718e-4cde-9133-1a37a142a89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:14.618759 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640625ea-718e-4cde-9133-1a37a142a89d None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:14.619003 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640625ea-718e-4cde-9133-1a37a142a89d None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:14.619259 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640625ea-718e-4cde-9133-1a37a142a89d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:14.620107 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640625ea-718e-4cde-9133-1a37a142a89d None admin] RBAC: Adding query filter params (role.id=5189c0e028ff42908ca943fdb5ce1873, scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e, user.id=4c610d719b3049f98b95cc8e9bd56834) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:14.620414 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640625ea-718e-4cde-9133-1a37a142a89d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:14.621872 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640625ea-718e-4cde-9133-1a37a142a89d None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:14.633839 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 268/541] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:39:14 2022] GET /identity/v3/role_assignments?user.id=4c610d719b3049f98b95cc8e9bd56834&scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e&role.id=5189c0e028ff42908ca943fdb5ce1873 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:15.076268 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebbd24-5838-41e7-826b-babc8772929c None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:15.076790 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebbd24-5838-41e7-826b-babc8772929c None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:15.076790 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbebbd24-5838-41e7-826b-babc8772929c None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:15.078926 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 274/542] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:15.084567 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a798d96-b8ed-4e48-83c8-d46d719216cb None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:15.084861 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a798d96-b8ed-4e48-83c8-d46d719216cb None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:15.085139 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a798d96-b8ed-4e48-83c8-d46d719216cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:15.102135 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-5a798d96-b8ed-4e48-83c8-d46d719216cb None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:15.103331 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-5a798d96-b8ed-4e48-83c8-d46d719216cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:15.192331 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 269/543] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:15.215063 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebbd24-5838-41e7-826b-babc8772929c None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:15.334453 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbebbd24-5838-41e7-826b-babc8772929c None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:15.367537 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e03f98-a277-4735-908c-29b6046ca62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:15.368372 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e03f98-a277-4735-908c-29b6046ca62c None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:15.368657 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e03f98-a277-4735-908c-29b6046ca62c None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:15.368928 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e03f98-a277-4735-908c-29b6046ca62c None admin] PATH_INFO: `/v3/roles/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:15.384778 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e03f98-a277-4735-908c-29b6046ca62c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:15.391966 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-78e03f98-a277-4735-908c-29b6046ca62c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:39:15.393503 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 275/544] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Mar 8 13:39:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:15.399473 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a798d96-b8ed-4e48-83c8-d46d719216cb None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:15.525775 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a798d96-b8ed-4e48-83c8-d46d719216cb None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:15.558572 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f972d28-6041-4520-aa47-02793a1b592a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:15.559239 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f972d28-6041-4520-aa47-02793a1b592a None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:15.559513 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f972d28-6041-4520-aa47-02793a1b592a None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:15.559782 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f972d28-6041-4520-aa47-02793a1b592a None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:15.560525 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f972d28-6041-4520-aa47-02793a1b592a None admin] RBAC: Adding query filter params (name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:15.560832 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f972d28-6041-4520-aa47-02793a1b592a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:15.562343 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f972d28-6041-4520-aa47-02793a1b592a None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:15.570842 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 270/545] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Mar 8 13:39:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:15.575987 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e03f98-a277-4735-908c-29b6046ca62c None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:15.730572 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e03f98-a277-4735-908c-29b6046ca62c None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:15.764543 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bebbb5-3cf8-4e38-8b96-8354ee8ba60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:15.765463 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bebbb5-3cf8-4e38-8b96-8354ee8ba60c None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:15.765676 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bebbb5-3cf8-4e38-8b96-8354ee8ba60c None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:15.765933 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bebbb5-3cf8-4e38-8b96-8354ee8ba60c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:15.776842 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bebbb5-3cf8-4e38-8b96-8354ee8ba60c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:15.778340 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bebbb5-3cf8-4e38-8b96-8354ee8ba60c None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:15.795458 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-a9bebbb5-3cf8-4e38-8b96-8354ee8ba60c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:15.797027 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 276/546] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:15.802508 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f972d28-6041-4520-aa47-02793a1b592a None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:15.958599 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f972d28-6041-4520-aa47-02793a1b592a None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:16.001739 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087d1a4-f0ff-47e2-9b50-99dcc3e9cf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:16.002325 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087d1a4-f0ff-47e2-9b50-99dcc3e9cf42 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:16.002603 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087d1a4-f0ff-47e2-9b50-99dcc3e9cf42 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:16.002874 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087d1a4-f0ff-47e2-9b50-99dcc3e9cf42 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:16.003654 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087d1a4-f0ff-47e2-9b50-99dcc3e9cf42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:16.003962 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087d1a4-f0ff-47e2-9b50-99dcc3e9cf42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:16.005327 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087d1a4-f0ff-47e2-9b50-99dcc3e9cf42 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:16.020310 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 271/547] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:16.025339 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bebbb5-3cf8-4e38-8b96-8354ee8ba60c None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:16.146759 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bebbb5-3cf8-4e38-8b96-8354ee8ba60c None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:16.154649 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed82d8-c95d-447b-94bf-c80906786a0a None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:16.154936 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed82d8-c95d-447b-94bf-c80906786a0a None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:16.155211 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed82d8-c95d-447b-94bf-c80906786a0a None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:16.158686 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 272/548] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:39:16.162848 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd8dc6-ef50-42a7-9f87-5b11de8d2e93 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:16.163130 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd8dc6-ef50-42a7-9f87-5b11de8d2e93 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:16.163405 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd8dc6-ef50-42a7-9f87-5b11de8d2e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:16.180105 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-10bd8dc6-ef50-42a7-9f87-5b11de8d2e93 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:16.181297 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-10bd8dc6-ef50-42a7-9f87-5b11de8d2e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:16.199056 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e0ee2-d0ee-4d2d-9b53-4fc8c6f339b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:16.199877 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e0ee2-d0ee-4d2d-9b53-4fc8c6f339b3 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:16.200150 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e0ee2-d0ee-4d2d-9b53-4fc8c6f339b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:16.200428 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e0ee2-d0ee-4d2d-9b53-4fc8c6f339b3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:16.208698 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e0ee2-d0ee-4d2d-9b53-4fc8c6f339b3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:16.210169 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29e0ee2-d0ee-4d2d-9b53-4fc8c6f339b3 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:16.225772 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-d29e0ee2-d0ee-4d2d-9b53-4fc8c6f339b3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 13:39:16.227982 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 277/549] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:39:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:16.232463 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e0ee2-d0ee-4d2d-9b53-4fc8c6f339b3 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:16.335735 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e0ee2-d0ee-4d2d-9b53-4fc8c6f339b3 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:16.360772 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 273/550] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:39:16.368927 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615478b5-1d9e-4a7d-a643-660d38acdb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:16.369736 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615478b5-1d9e-4a7d-a643-660d38acdb24 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:16.370129 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615478b5-1d9e-4a7d-a643-660d38acdb24 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:16.370492 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615478b5-1d9e-4a7d-a643-660d38acdb24 None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:16.371431 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615478b5-1d9e-4a7d-a643-660d38acdb24 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:16.371838 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615478b5-1d9e-4a7d-a643-660d38acdb24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:16.373331 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615478b5-1d9e-4a7d-a643-660d38acdb24 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:16.391121 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 278/551] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Mar 8 13:39:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:16.398340 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615478b5-1d9e-4a7d-a643-660d38acdb24 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:16.398623 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd8dc6-ef50-42a7-9f87-5b11de8d2e93 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:16.494359 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615478b5-1d9e-4a7d-a643-660d38acdb24 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:16.536292 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbbf10-4627-449f-8cdd-285f3ae32ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:16.537104 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbbf10-4627-449f-8cdd-285f3ae32ca2 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:16.537403 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbbf10-4627-449f-8cdd-285f3ae32ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:16.537677 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbbf10-4627-449f-8cdd-285f3ae32ca2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:16.557947 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbbf10-4627-449f-8cdd-285f3ae32ca2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:16.567602 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-ebcbbf10-4627-449f-8cdd-285f3ae32ca2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:39:16.579195 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 279/552] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Mar 8 13:39:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:16.580085 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbbf10-4627-449f-8cdd-285f3ae32ca2 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:16.625807 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd8dc6-ef50-42a7-9f87-5b11de8d2e93 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:16.693485 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a3312-9d3e-4114-aea3-66b5d9caa22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:16.694621 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a3312-9d3e-4114-aea3-66b5d9caa22c None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:16.695092 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a3312-9d3e-4114-aea3-66b5d9caa22c None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:16.695191 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbbf10-4627-449f-8cdd-285f3ae32ca2 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:16.695646 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a3312-9d3e-4114-aea3-66b5d9caa22c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:16.732141 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c06d7ab-f337-4816-9acb-d7d70a3c3dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:16.732814 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06d7ab-f337-4816-9acb-d7d70a3c3dd7 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:16.733096 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06d7ab-f337-4816-9acb-d7d70a3c3dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:16.733448 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c06d7ab-f337-4816-9acb-d7d70a3c3dd7 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:16.734264 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06d7ab-f337-4816-9acb-d7d70a3c3dd7 None admin] RBAC: Adding query filter params (name=service) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:16.734612 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06d7ab-f337-4816-9acb-d7d70a3c3dd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:16.736102 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c06d7ab-f337-4816-9acb-d7d70a3c3dd7 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:16.747040 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 280/553] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Mar 8 13:39:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:16.748978 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b8572-f0be-4935-8c80-45b13b155ed4 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:16.749488 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b8572-f0be-4935-8c80-45b13b155ed4 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:16.749925 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b8572-f0be-4935-8c80-45b13b155ed4 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:16.752285 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 281/554] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:16.753275 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b8572-f0be-4935-8c80-45b13b155ed4 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:16.776398 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a3312-9d3e-4114-aea3-66b5d9caa22c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:16.778958 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a3312-9d3e-4114-aea3-66b5d9caa22c None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:16.871343 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b8572-f0be-4935-8c80-45b13b155ed4 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:16.880390 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 274/555] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:39:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:16.882532 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da664b56-55f6-42b8-ad73-511f9104265c None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:16.883155 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da664b56-55f6-42b8-ad73-511f9104265c None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:16.883780 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da664b56-55f6-42b8-ad73-511f9104265c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:16.900956 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-da664b56-55f6-42b8-ad73-511f9104265c None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:16.902392 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-da664b56-55f6-42b8-ad73-511f9104265c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:16.909449 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac6ce5-694d-46df-a14d-9c72029026ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:16.910384 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac6ce5-694d-46df-a14d-9c72029026ac None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:16.910754 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac6ce5-694d-46df-a14d-9c72029026ac None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:16.911530 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac6ce5-694d-46df-a14d-9c72029026ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:16.926013 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac6ce5-694d-46df-a14d-9c72029026ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:16.928302 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac6ce5-694d-46df-a14d-9c72029026ac None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:16.949434 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-f4ac6ce5-694d-46df-a14d-9c72029026ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:16.956060 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 282/556] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:16.957504 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac6ce5-694d-46df-a14d-9c72029026ac None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:16.977493 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 275/557] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:16.978597 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da664b56-55f6-42b8-ad73-511f9104265c None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:17.063686 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac6ce5-694d-46df-a14d-9c72029026ac None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:17.078900 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da664b56-55f6-42b8-ad73-511f9104265c None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:17.094548 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e29625-4cff-4015-a60e-b821c3097586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:17.095333 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e29625-4cff-4015-a60e-b821c3097586 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:17.095669 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e29625-4cff-4015-a60e-b821c3097586 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:17.095869 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e29625-4cff-4015-a60e-b821c3097586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:17.105980 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e29625-4cff-4015-a60e-b821c3097586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:17.107398 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e29625-4cff-4015-a60e-b821c3097586 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:17.113737 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce59c7-7e6e-4dfc-a835-235f0c5ad0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:17.114497 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce59c7-7e6e-4dfc-a835-235f0c5ad0c2 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:17.114762 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce59c7-7e6e-4dfc-a835-235f0c5ad0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:17.115030 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce59c7-7e6e-4dfc-a835-235f0c5ad0c2 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:17.115751 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce59c7-7e6e-4dfc-a835-235f0c5ad0c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:17.116052 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce59c7-7e6e-4dfc-a835-235f0c5ad0c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:17.117435 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce59c7-7e6e-4dfc-a835-235f0c5ad0c2 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:17.123599 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-58e29625-4cff-4015-a60e-b821c3097586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:17.129813 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 283/558] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:17.129813 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e29625-4cff-4015-a60e-b821c3097586 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:17.130004 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 276/559] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:17.130004 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3bcf1-b923-4f17-a5e6-5181932a3fdc None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:17.130289 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3bcf1-b923-4f17-a5e6-5181932a3fdc None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:17.130694 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3bcf1-b923-4f17-a5e6-5181932a3fdc None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:17.133630 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 277/560] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:17.133630 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3bcf1-b923-4f17-a5e6-5181932a3fdc None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:17.233368 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e29625-4cff-4015-a60e-b821c3097586 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:17.238614 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3bcf1-b923-4f17-a5e6-5181932a3fdc None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:17.265761 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f9183-68e6-4deb-934b-9c9be6ba3567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:17.266558 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f9183-68e6-4deb-934b-9c9be6ba3567 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:17.266837 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f9183-68e6-4deb-934b-9c9be6ba3567 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:17.267111 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f9183-68e6-4deb-934b-9c9be6ba3567 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:17.271065 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60589ed5-9844-4b9a-923c-12edf591ec27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:17.271917 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60589ed5-9844-4b9a-923c-12edf591ec27 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:17.272358 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60589ed5-9844-4b9a-923c-12edf591ec27 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:17.272811 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60589ed5-9844-4b9a-923c-12edf591ec27 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:17.273719 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60589ed5-9844-4b9a-923c-12edf591ec27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:17.274186 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60589ed5-9844-4b9a-923c-12edf591ec27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:17.275706 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60589ed5-9844-4b9a-923c-12edf591ec27 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:17.276663 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f9183-68e6-4deb-934b-9c9be6ba3567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:17.284038 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-a08f9183-68e6-4deb-934b-9c9be6ba3567 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:39:17.285451 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 284/561] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Mar 8 13:39:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:17.286119 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f9183-68e6-4deb-934b-9c9be6ba3567 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:17.288999 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 278/562] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:17.290451 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466944e1-2d42-4d8e-9720-170edf203019 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:17.290734 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466944e1-2d42-4d8e-9720-170edf203019 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:17.291005 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466944e1-2d42-4d8e-9720-170edf203019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:17.307364 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-466944e1-2d42-4d8e-9720-170edf203019 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:17.308775 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-466944e1-2d42-4d8e-9720-170edf203019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:17.373082 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 279/563] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:17.373768 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466944e1-2d42-4d8e-9720-170edf203019 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:17.389463 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f9183-68e6-4deb-934b-9c9be6ba3567 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:17.421053 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe8dde-2be3-4e10-83fa-b239337cd511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:17.421991 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8dde-2be3-4e10-83fa-b239337cd511 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:17.422268 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8dde-2be3-4e10-83fa-b239337cd511 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:17.422534 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8dde-2be3-4e10-83fa-b239337cd511 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:17.429866 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe8dde-2be3-4e10-83fa-b239337cd511 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:17.431288 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe8dde-2be3-4e10-83fa-b239337cd511 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:17.444571 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-eabe8dde-2be3-4e10-83fa-b239337cd511 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 13:39:17.445789 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 285/564] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Mar 8 13:39:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:17.446539 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe8dde-2be3-4e10-83fa-b239337cd511 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:17.477554 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466944e1-2d42-4d8e-9720-170edf203019 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:17.510448 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad7a17-080c-4ee1-b028-86172fbaad9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:17.511253 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad7a17-080c-4ee1-b028-86172fbaad9a None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:17.511525 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad7a17-080c-4ee1-b028-86172fbaad9a None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:17.511789 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad7a17-080c-4ee1-b028-86172fbaad9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:17.518280 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad7a17-080c-4ee1-b028-86172fbaad9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:17.519722 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad7a17-080c-4ee1-b028-86172fbaad9a None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:17.532862 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-1dad7a17-080c-4ee1-b028-86172fbaad9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:17.538690 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 280/565] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:17.538690 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad7a17-080c-4ee1-b028-86172fbaad9a None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:17.555758 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe8dde-2be3-4e10-83fa-b239337cd511 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:17.586387 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640b88a-34be-4adc-b8d0-45a19f7f40c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:17.587037 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640b88a-34be-4adc-b8d0-45a19f7f40c4 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:17.587311 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640b88a-34be-4adc-b8d0-45a19f7f40c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:17.587573 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640b88a-34be-4adc-b8d0-45a19f7f40c4 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:17.588304 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640b88a-34be-4adc-b8d0-45a19f7f40c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:17.588602 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640b88a-34be-4adc-b8d0-45a19f7f40c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:17.589991 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640b88a-34be-4adc-b8d0-45a19f7f40c4 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:17.597701 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 286/566] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Mar 8 13:39:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:17.598465 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640b88a-34be-4adc-b8d0-45a19f7f40c4 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:17.630869 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad7a17-080c-4ee1-b028-86172fbaad9a None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:17.663932 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db6ed0-ebdf-4956-973e-ebfe3fa06c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:17.664753 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db6ed0-ebdf-4956-973e-ebfe3fa06c84 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:17.665019 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db6ed0-ebdf-4956-973e-ebfe3fa06c84 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:17.665289 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db6ed0-ebdf-4956-973e-ebfe3fa06c84 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:17.675127 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db6ed0-ebdf-4956-973e-ebfe3fa06c84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:17.681853 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-a2db6ed0-ebdf-4956-973e-ebfe3fa06c84 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:39:17.683176 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 281/567] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Mar 8 13:39:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:17.684166 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b75c43-ace4-4b40-926a-8b30c9240334 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:17.684448 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b75c43-ace4-4b40-926a-8b30c9240334 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:17.684753 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b75c43-ace4-4b40-926a-8b30c9240334 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:17.686400 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 282/568] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:17.687150 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b75c43-ace4-4b40-926a-8b30c9240334 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:17.696394 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640b88a-34be-4adc-b8d0-45a19f7f40c4 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:17.728646 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512699f-0e8e-41c3-bed9-7684144f6feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:17.729306 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512699f-0e8e-41c3-bed9-7684144f6feb None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:17.729621 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512699f-0e8e-41c3-bed9-7684144f6feb None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:17.729892 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512699f-0e8e-41c3-bed9-7684144f6feb None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:17.730722 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512699f-0e8e-41c3-bed9-7684144f6feb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:17.731023 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512699f-0e8e-41c3-bed9-7684144f6feb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:17.732445 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512699f-0e8e-41c3-bed9-7684144f6feb None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:17.749334 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 287/569] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Mar 8 13:39:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:17.750105 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512699f-0e8e-41c3-bed9-7684144f6feb None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:17.783214 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b75c43-ace4-4b40-926a-8b30c9240334 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:17.814856 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da74a0-286f-4163-9467-f83a98c0091c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:17.815503 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da74a0-286f-4163-9467-f83a98c0091c None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:17.815780 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da74a0-286f-4163-9467-f83a98c0091c None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:17.816050 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da74a0-286f-4163-9467-f83a98c0091c None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:17.816812 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da74a0-286f-4163-9467-f83a98c0091c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:17.817129 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da74a0-286f-4163-9467-f83a98c0091c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:17.818599 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da74a0-286f-4163-9467-f83a98c0091c None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:17.830035 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 283/570] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:39:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:17.830798 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da74a0-286f-4163-9467-f83a98c0091c None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:17.852230 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512699f-0e8e-41c3-bed9-7684144f6feb None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:17.883917 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db73598-d32e-412b-a048-649b99d40d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:17.884698 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db73598-d32e-412b-a048-649b99d40d7a None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:17.884972 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db73598-d32e-412b-a048-649b99d40d7a None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:17.885234 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db73598-d32e-412b-a048-649b99d40d7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:17.894639 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db73598-d32e-412b-a048-649b99d40d7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:17.896037 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db73598-d32e-412b-a048-649b99d40d7a None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:17.912082 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-6db73598-d32e-412b-a048-649b99d40d7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:17.913207 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 288/571] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:17.914439 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675f006-c16d-4eda-8569-92f4685af811 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:17.914666 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675f006-c16d-4eda-8569-92f4685af811 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:17.914931 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675f006-c16d-4eda-8569-92f4685af811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:17.921055 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da74a0-286f-4163-9467-f83a98c0091c None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:17.930461 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-4675f006-c16d-4eda-8569-92f4685af811 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:17.931582 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-4675f006-c16d-4eda-8569-92f4685af811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:17.954638 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6c3a9-9f2c-46ea-85ec-621a095d393a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:17.955296 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6c3a9-9f2c-46ea-85ec-621a095d393a None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:17.955575 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6c3a9-9f2c-46ea-85ec-621a095d393a None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:17.955843 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6c3a9-9f2c-46ea-85ec-621a095d393a None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:17.956576 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6c3a9-9f2c-46ea-85ec-621a095d393a None admin] RBAC: Adding query filter params (name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:17.956876 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6c3a9-9f2c-46ea-85ec-621a095d393a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:17.958259 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6c3a9-9f2c-46ea-85ec-621a095d393a None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:17.965967 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 284/572] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Mar 8 13:39:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:17.966650 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6c3a9-9f2c-46ea-85ec-621a095d393a None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:17.995889 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 289/573] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:17.996793 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675f006-c16d-4eda-8569-92f4685af811 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:18.061944 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6c3a9-9f2c-46ea-85ec-621a095d393a None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:18.089751 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4675f006-c16d-4eda-8569-92f4685af811 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:18.093017 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86581b6a-abdc-4bdd-8e99-5b0e227715bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:18.093832 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86581b6a-abdc-4bdd-8e99-5b0e227715bf None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:18.094109 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86581b6a-abdc-4bdd-8e99-5b0e227715bf None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:18.094377 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86581b6a-abdc-4bdd-8e99-5b0e227715bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:18.104272 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86581b6a-abdc-4bdd-8e99-5b0e227715bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:18.105766 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86581b6a-abdc-4bdd-8e99-5b0e227715bf None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:18.121383 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-86581b6a-abdc-4bdd-8e99-5b0e227715bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:18.122308 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830e41b-be0c-4264-8f58-438b9cd8e391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:18.122827 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 285/574] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:18.122950 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830e41b-be0c-4264-8f58-438b9cd8e391 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:18.123195 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830e41b-be0c-4264-8f58-438b9cd8e391 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:18.123456 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830e41b-be0c-4264-8f58-438b9cd8e391 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:18.123596 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86581b6a-abdc-4bdd-8e99-5b0e227715bf None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:18.124311 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830e41b-be0c-4264-8f58-438b9cd8e391 None admin] RBAC: Adding query filter params (role.id=5189c0e028ff42908ca943fdb5ce1873, scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e, user.id=5a0f442666d0459aa9a34fc2f91228e9) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:18.124611 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830e41b-be0c-4264-8f58-438b9cd8e391 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:18.126044 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830e41b-be0c-4264-8f58-438b9cd8e391 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:18.145387 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 290/575] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:39:17 2022] GET /identity/v3/role_assignments?user.id=5a0f442666d0459aa9a34fc2f91228e9&scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e&role.id=5189c0e028ff42908ca943fdb5ce1873 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:18.145387 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830e41b-be0c-4264-8f58-438b9cd8e391 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:18.224986 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86581b6a-abdc-4bdd-8e99-5b0e227715bf None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:18.245990 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830e41b-be0c-4264-8f58-438b9cd8e391 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:18.259154 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184182ec-792b-477f-90e6-ab606ec547d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:18.259824 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184182ec-792b-477f-90e6-ab606ec547d8 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:18.260107 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184182ec-792b-477f-90e6-ab606ec547d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:18.260387 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184182ec-792b-477f-90e6-ab606ec547d8 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:18.261122 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184182ec-792b-477f-90e6-ab606ec547d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:18.261537 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184182ec-792b-477f-90e6-ab606ec547d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:18.262942 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184182ec-792b-477f-90e6-ab606ec547d8 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:18.275428 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 286/576] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:18.276243 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184182ec-792b-477f-90e6-ab606ec547d8 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:18.285635 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf4c23-d448-4ea8-9210-67e5dda1d1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:18.286437 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf4c23-d448-4ea8-9210-67e5dda1d1c6 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:18.286707 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf4c23-d448-4ea8-9210-67e5dda1d1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:18.286974 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf4c23-d448-4ea8-9210-67e5dda1d1c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:18.297647 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf4c23-d448-4ea8-9210-67e5dda1d1c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:18.299118 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf4c23-d448-4ea8-9210-67e5dda1d1c6 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:18.316972 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-20bf4c23-d448-4ea8-9210-67e5dda1d1c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:18.318237 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 291/577] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:18.319006 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf4c23-d448-4ea8-9210-67e5dda1d1c6 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:18.379906 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184182ec-792b-477f-90e6-ab606ec547d8 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:18.412876 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021c6b2-df7a-4bd7-85e0-b1523c17b03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:18.413933 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021c6b2-df7a-4bd7-85e0-b1523c17b03b None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:18.414214 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021c6b2-df7a-4bd7-85e0-b1523c17b03b None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:18.414487 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021c6b2-df7a-4bd7-85e0-b1523c17b03b None admin] PATH_INFO: `/v3/roles/service` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:18.418559 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf4c23-d448-4ea8-9210-67e5dda1d1c6 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:18.424381 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021c6b2-df7a-4bd7-85e0-b1523c17b03b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:18.431241 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-a021c6b2-df7a-4bd7-85e0-b1523c17b03b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:39:18.432434 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 287/578] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Mar 8 13:39:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:18.433183 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021c6b2-df7a-4bd7-85e0-b1523c17b03b None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:18.459071 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b630448-f870-49db-9f3f-ef1ab99382eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:18.459961 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b630448-f870-49db-9f3f-ef1ab99382eb None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:18.460386 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b630448-f870-49db-9f3f-ef1ab99382eb None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:18.460670 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b630448-f870-49db-9f3f-ef1ab99382eb None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:18.461440 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b630448-f870-49db-9f3f-ef1ab99382eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:18.461742 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b630448-f870-49db-9f3f-ef1ab99382eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:18.463096 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b630448-f870-49db-9f3f-ef1ab99382eb None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:18.479066 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 292/579] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:18.479826 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b630448-f870-49db-9f3f-ef1ab99382eb None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:18.530695 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021c6b2-df7a-4bd7-85e0-b1523c17b03b None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:18.562096 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c34a1e-b3a5-4efa-b92e-dcab9399ad33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:18.562892 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c34a1e-b3a5-4efa-b92e-dcab9399ad33 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:18.563172 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c34a1e-b3a5-4efa-b92e-dcab9399ad33 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:18.563440 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c34a1e-b3a5-4efa-b92e-dcab9399ad33 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:18.570613 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c34a1e-b3a5-4efa-b92e-dcab9399ad33 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:18.572059 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c34a1e-b3a5-4efa-b92e-dcab9399ad33 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:18.577964 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b630448-f870-49db-9f3f-ef1ab99382eb None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:18.584914 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-d5c34a1e-b3a5-4efa-b92e-dcab9399ad33 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 08 13:39:18.590592 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 288/580] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:39:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:18.590592 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c34a1e-b3a5-4efa-b92e-dcab9399ad33 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:18.614465 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1863043-ee2a-41f4-8901-686855e70f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:18.615121 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1863043-ee2a-41f4-8901-686855e70f7c None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:18.615398 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1863043-ee2a-41f4-8901-686855e70f7c None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:18.615667 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1863043-ee2a-41f4-8901-686855e70f7c None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:18.616371 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1863043-ee2a-41f4-8901-686855e70f7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:18.616663 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1863043-ee2a-41f4-8901-686855e70f7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:18.618051 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1863043-ee2a-41f4-8901-686855e70f7c None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:18.633282 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 293/581] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:18.633282 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1863043-ee2a-41f4-8901-686855e70f7c None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:18.680518 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c34a1e-b3a5-4efa-b92e-dcab9399ad33 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:18.712549 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc341880-fc8c-4e27-98ca-c108294cdbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:18.713206 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc341880-fc8c-4e27-98ca-c108294cdbdd None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:18.713518 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc341880-fc8c-4e27-98ca-c108294cdbdd None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:18.713789 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc341880-fc8c-4e27-98ca-c108294cdbdd None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:18.714527 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc341880-fc8c-4e27-98ca-c108294cdbdd None admin] RBAC: Adding query filter params (name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:18.714828 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc341880-fc8c-4e27-98ca-c108294cdbdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:18.716185 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc341880-fc8c-4e27-98ca-c108294cdbdd None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:18.723825 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 289/582] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Mar 8 13:39:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:18.724551 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc341880-fc8c-4e27-98ca-c108294cdbdd None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:18.728891 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1863043-ee2a-41f4-8901-686855e70f7c None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:18.761183 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95b6a6-35af-4f50-82c9-767c36e27959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:18.762195 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95b6a6-35af-4f50-82c9-767c36e27959 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:18.762615 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95b6a6-35af-4f50-82c9-767c36e27959 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:18.763051 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c95b6a6-35af-4f50-82c9-767c36e27959 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:18.769845 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95b6a6-35af-4f50-82c9-767c36e27959 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:18.771407 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c95b6a6-35af-4f50-82c9-767c36e27959 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:18.784562 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-0c95b6a6-35af-4f50-82c9-767c36e27959 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:18.791532 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 294/583] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:18.791532 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95b6a6-35af-4f50-82c9-767c36e27959 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:18.817085 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc341880-fc8c-4e27-98ca-c108294cdbdd None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:18.848616 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe05ab9-4f50-41be-b4b0-b346f2f562ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:18.849416 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe05ab9-4f50-41be-b4b0-b346f2f562ef None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:18.849698 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe05ab9-4f50-41be-b4b0-b346f2f562ef None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:18.849972 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe05ab9-4f50-41be-b4b0-b346f2f562ef None admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:18.850913 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe05ab9-4f50-41be-b4b0-b346f2f562ef None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:18.851265 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe05ab9-4f50-41be-b4b0-b346f2f562ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:18.852661 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe05ab9-4f50-41be-b4b0-b346f2f562ef None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:18.870275 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 290/584] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Mar 8 13:39:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:18.871090 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe05ab9-4f50-41be-b4b0-b346f2f562ef None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:18.883635 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c95b6a6-35af-4f50-82c9-767c36e27959 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:18.916401 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de73dd9-ffc2-419f-a1d1-13990887d05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:18.917201 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de73dd9-ffc2-419f-a1d1-13990887d05c None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:18.917511 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de73dd9-ffc2-419f-a1d1-13990887d05c None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:18.917783 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de73dd9-ffc2-419f-a1d1-13990887d05c None admin] PATH_INFO: `/v3/users/glance` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:18.925960 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de73dd9-ffc2-419f-a1d1-13990887d05c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:18.927412 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de73dd9-ffc2-419f-a1d1-13990887d05c None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:18.940949 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-4de73dd9-ffc2-419f-a1d1-13990887d05c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 08 13:39:18.945735 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 295/585] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:39:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:18.946867 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de73dd9-ffc2-419f-a1d1-13990887d05c None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:18.972511 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe05ab9-4f50-41be-b4b0-b346f2f562ef None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:19.005009 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2388b-9bb0-4474-8b13-8cc3192d0815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:19.005832 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2388b-9bb0-4474-8b13-8cc3192d0815 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:19.006112 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2388b-9bb0-4474-8b13-8cc3192d0815 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:19.006386 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a2388b-9bb0-4474-8b13-8cc3192d0815 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:19.017444 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2388b-9bb0-4474-8b13-8cc3192d0815 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:19.018885 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a2388b-9bb0-4474-8b13-8cc3192d0815 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:19.037854 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-c6a2388b-9bb0-4474-8b13-8cc3192d0815 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:19.041961 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de73dd9-ffc2-419f-a1d1-13990887d05c None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:19.043744 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 291/586] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:19.044555 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2388b-9bb0-4474-8b13-8cc3192d0815 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:19.074960 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc83496-93ee-438b-bbc1-a86271efab3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:19.075619 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc83496-93ee-438b-bbc1-a86271efab3a None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:19.075895 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc83496-93ee-438b-bbc1-a86271efab3a None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:19.076175 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc83496-93ee-438b-bbc1-a86271efab3a None admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:19.076951 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc83496-93ee-438b-bbc1-a86271efab3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:19.077325 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc83496-93ee-438b-bbc1-a86271efab3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:19.078771 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc83496-93ee-438b-bbc1-a86271efab3a None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:19.091995 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 296/587] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:39:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:19.092863 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc83496-93ee-438b-bbc1-a86271efab3a None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:19.146245 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a2388b-9bb0-4474-8b13-8cc3192d0815 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:19.179670 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36039b-2f76-4838-a43d-966bc119a7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:19.180771 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36039b-2f76-4838-a43d-966bc119a7b0 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:19.181235 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36039b-2f76-4838-a43d-966bc119a7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:19.181736 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e36039b-2f76-4838-a43d-966bc119a7b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:19.185971 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc83496-93ee-438b-bbc1-a86271efab3a None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:19.192703 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36039b-2f76-4838-a43d-966bc119a7b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:19.194190 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e36039b-2f76-4838-a43d-966bc119a7b0 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:19.210514 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-1e36039b-2f76-4838-a43d-966bc119a7b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:19.212045 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 292/588] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:19.212944 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36039b-2f76-4838-a43d-966bc119a7b0 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:19.220133 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80016529-69d0-4e8d-903e-35c199a01866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:19.220798 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80016529-69d0-4e8d-903e-35c199a01866 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:19.221050 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80016529-69d0-4e8d-903e-35c199a01866 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:19.221345 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80016529-69d0-4e8d-903e-35c199a01866 None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:19.224055 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80016529-69d0-4e8d-903e-35c199a01866 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:19.224362 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80016529-69d0-4e8d-903e-35c199a01866 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:19.225806 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80016529-69d0-4e8d-903e-35c199a01866 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:19.245076 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 297/589] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Mar 8 13:39:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:19.246160 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80016529-69d0-4e8d-903e-35c199a01866 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:19.324772 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e36039b-2f76-4838-a43d-966bc119a7b0 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:19.350161 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80016529-69d0-4e8d-903e-35c199a01866 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:19.356751 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fe4a2-9a37-4dac-9660-31166b1993a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:19.357431 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fe4a2-9a37-4dac-9660-31166b1993a2 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:19.357713 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fe4a2-9a37-4dac-9660-31166b1993a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:19.357981 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967fe4a2-9a37-4dac-9660-31166b1993a2 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:19.358724 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fe4a2-9a37-4dac-9660-31166b1993a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:19.359031 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fe4a2-9a37-4dac-9660-31166b1993a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:19.360394 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967fe4a2-9a37-4dac-9660-31166b1993a2 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:19.371116 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 293/590] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:19.371896 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fe4a2-9a37-4dac-9660-31166b1993a2 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:19.386608 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fc8ee-bc6e-449d-8c08-e05cf444c7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:19.387498 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fc8ee-bc6e-449d-8c08-e05cf444c7f6 None admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:19.387779 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fc8ee-bc6e-449d-8c08-e05cf444c7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:19.388052 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fc8ee-bc6e-449d-8c08-e05cf444c7f6 None admin] PATH_INFO: `/v3/projects/7d693fb3e9fc4d82a0ed054f31f1e56e/users/21ec894123044d4382995791c74c587b/roles/5189c0e028ff42908ca943fdb5ce1873` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:19.402119 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fc8ee-bc6e-449d-8c08-e05cf444c7f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d693fb3e9fc4d82a0ed054f31f1e56e, user_id=21ec894123044d4382995791c74c587b, role_id=5189c0e028ff42908ca943fdb5ce1873)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:19.403545 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fc8ee-bc6e-449d-8c08-e05cf444c7f6 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:19.417859 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 298/591] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Mar 8 13:39:19 2022] PUT /identity/v3/projects/7d693fb3e9fc4d82a0ed054f31f1e56e/users/21ec894123044d4382995791c74c587b/roles/5189c0e028ff42908ca943fdb5ce1873 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:39:19.418870 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fc8ee-bc6e-449d-8c08-e05cf444c7f6 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:19.495245 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967fe4a2-9a37-4dac-9660-31166b1993a2 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:19.531062 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d3208-5e5a-4930-a7b6-4adb0c304824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:19.531901 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d3208-5e5a-4930-a7b6-4adb0c304824 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:19.532230 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d3208-5e5a-4930-a7b6-4adb0c304824 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:19.532903 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d3208-5e5a-4930-a7b6-4adb0c304824 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:19.533784 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d3208-5e5a-4930-a7b6-4adb0c304824 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:19.534159 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d3208-5e5a-4930-a7b6-4adb0c304824 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:19.535683 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d3208-5e5a-4930-a7b6-4adb0c304824 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:19.536324 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fc8ee-bc6e-449d-8c08-e05cf444c7f6 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:19.549476 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 294/592] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:19.550581 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d3208-5e5a-4930-a7b6-4adb0c304824 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:19.573566 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ab13e-8e1f-4313-97cb-0e596386c7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:19.574899 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ab13e-8e1f-4313-97cb-0e596386c7f1 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:19.575391 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ab13e-8e1f-4313-97cb-0e596386c7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:19.575889 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ab13e-8e1f-4313-97cb-0e596386c7f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:19.588490 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ab13e-8e1f-4313-97cb-0e596386c7f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:19.590396 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ab13e-8e1f-4313-97cb-0e596386c7f1 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:19.609076 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-3d1ab13e-8e1f-4313-97cb-0e596386c7f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:19.611031 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 299/593] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:19.612253 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ab13e-8e1f-4313-97cb-0e596386c7f1 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:19.654795 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d3208-5e5a-4930-a7b6-4adb0c304824 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:19.694780 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d99846-1ae6-4f2e-a100-546ed6ab22eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:19.696324 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d99846-1ae6-4f2e-a100-546ed6ab22eb None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:19.696780 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d99846-1ae6-4f2e-a100-546ed6ab22eb None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:19.697451 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d99846-1ae6-4f2e-a100-546ed6ab22eb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:19.707752 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d99846-1ae6-4f2e-a100-546ed6ab22eb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:19.710168 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d99846-1ae6-4f2e-a100-546ed6ab22eb None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:19.714619 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ab13e-8e1f-4313-97cb-0e596386c7f1 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:19.727513 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-b4d99846-1ae6-4f2e-a100-546ed6ab22eb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 08 13:39:19.729388 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 295/594] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Mar 8 13:39:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:19.730888 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d99846-1ae6-4f2e-a100-546ed6ab22eb None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:19.753320 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b570bf-246e-4e09-895b-1a9a73f8f879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:19.754321 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b570bf-246e-4e09-895b-1a9a73f8f879 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:19.754730 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b570bf-246e-4e09-895b-1a9a73f8f879 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:19.755098 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b570bf-246e-4e09-895b-1a9a73f8f879 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:19.762100 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b570bf-246e-4e09-895b-1a9a73f8f879 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:19.763668 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b570bf-246e-4e09-895b-1a9a73f8f879 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:19.776786 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-30b570bf-246e-4e09-895b-1a9a73f8f879 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:19.778521 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 300/595] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:19.784201 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b570bf-246e-4e09-895b-1a9a73f8f879 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:19.848357 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d99846-1ae6-4f2e-a100-546ed6ab22eb None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:19.881729 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b570bf-246e-4e09-895b-1a9a73f8f879 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:19.890403 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d572717-9145-4cfc-b0c0-9cc161070f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:19.891651 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d572717-9145-4cfc-b0c0-9cc161070f58 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:19.892090 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d572717-9145-4cfc-b0c0-9cc161070f58 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:19.892793 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d572717-9145-4cfc-b0c0-9cc161070f58 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:19.893971 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d572717-9145-4cfc-b0c0-9cc161070f58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:19.894437 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d572717-9145-4cfc-b0c0-9cc161070f58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:19.896555 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d572717-9145-4cfc-b0c0-9cc161070f58 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:19.912212 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 296/596] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:19.913230 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d572717-9145-4cfc-b0c0-9cc161070f58 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:19.920444 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51545f6a-2c1e-4bf7-97c5-889a3ecec483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:19.921315 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51545f6a-2c1e-4bf7-97c5-889a3ecec483 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:19.921713 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51545f6a-2c1e-4bf7-97c5-889a3ecec483 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:19.922073 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51545f6a-2c1e-4bf7-97c5-889a3ecec483 None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:19.923118 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51545f6a-2c1e-4bf7-97c5-889a3ecec483 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:19.923390 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51545f6a-2c1e-4bf7-97c5-889a3ecec483 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:19.924919 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51545f6a-2c1e-4bf7-97c5-889a3ecec483 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:19.942222 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 301/597] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Mar 8 13:39:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:19.943143 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51545f6a-2c1e-4bf7-97c5-889a3ecec483 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:20.034283 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d572717-9145-4cfc-b0c0-9cc161070f58 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:20.046682 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51545f6a-2c1e-4bf7-97c5-889a3ecec483 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:20.069407 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d6d46-a17f-4251-9bdd-88965fc759d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:20.070092 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d6d46-a17f-4251-9bdd-88965fc759d4 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:20.070460 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d6d46-a17f-4251-9bdd-88965fc759d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:20.070821 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d6d46-a17f-4251-9bdd-88965fc759d4 None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:20.071706 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d6d46-a17f-4251-9bdd-88965fc759d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:20.072105 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d6d46-a17f-4251-9bdd-88965fc759d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:20.073656 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d6d46-a17f-4251-9bdd-88965fc759d4 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:20.088497 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91987d2-f55f-4247-9e80-daea52f3cc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:20.089551 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91987d2-f55f-4247-9e80-daea52f3cc68 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:20.089864 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 297/598] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:39:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:20.090136 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91987d2-f55f-4247-9e80-daea52f3cc68 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:20.090559 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91987d2-f55f-4247-9e80-daea52f3cc68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:20.091017 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d6d46-a17f-4251-9bdd-88965fc759d4 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:20.099088 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91987d2-f55f-4247-9e80-daea52f3cc68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:20.101188 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91987d2-f55f-4247-9e80-daea52f3cc68 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:20.118014 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-e91987d2-f55f-4247-9e80-daea52f3cc68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:20.120392 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 302/599] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:20.121272 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91987d2-f55f-4247-9e80-daea52f3cc68 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:20.194771 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d6d46-a17f-4251-9bdd-88965fc759d4 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:20.227154 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d4936-e909-4930-8a3b-f83ea498237d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:20.228076 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d4936-e909-4930-8a3b-f83ea498237d None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:20.228562 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d4936-e909-4930-8a3b-f83ea498237d None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:20.228928 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d4936-e909-4930-8a3b-f83ea498237d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:20.239153 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d4936-e909-4930-8a3b-f83ea498237d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:20.239983 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91987d2-f55f-4247-9e80-daea52f3cc68 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:20.240837 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9d4936-e909-4930-8a3b-f83ea498237d None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:20.258257 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-be9d4936-e909-4930-8a3b-f83ea498237d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:20.259885 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 298/600] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:20.260798 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d4936-e909-4930-8a3b-f83ea498237d None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:20.278657 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6c108-8f74-42fb-a60a-f3ee695b22ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:20.280479 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6c108-8f74-42fb-a60a-f3ee695b22ad None admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:20.280921 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6c108-8f74-42fb-a60a-f3ee695b22ad None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:20.281335 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6c108-8f74-42fb-a60a-f3ee695b22ad None admin] PATH_INFO: `/v3/projects/7d693fb3e9fc4d82a0ed054f31f1e56e/users/56ddb15832b048f5a19d7d3887e088b3/roles/5189c0e028ff42908ca943fdb5ce1873` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:20.300698 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6c108-8f74-42fb-a60a-f3ee695b22ad None admin] RBAC: Authorizing `identity:create_grant(project_id=7d693fb3e9fc4d82a0ed054f31f1e56e, user_id=56ddb15832b048f5a19d7d3887e088b3, role_id=5189c0e028ff42908ca943fdb5ce1873)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:20.302321 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6c108-8f74-42fb-a60a-f3ee695b22ad None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:20.325496 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 303/601] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Mar 8 13:39:20 2022] PUT /identity/v3/projects/7d693fb3e9fc4d82a0ed054f31f1e56e/users/56ddb15832b048f5a19d7d3887e088b3/roles/5189c0e028ff42908ca943fdb5ce1873 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:39:20.326591 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6c108-8f74-42fb-a60a-f3ee695b22ad None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:20.374956 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d4936-e909-4930-8a3b-f83ea498237d None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:20.416123 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d746a0-a014-49e3-85b8-4cac115aeb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:20.429598 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d746a0-a014-49e3-85b8-4cac115aeb75 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:20.429598 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d746a0-a014-49e3-85b8-4cac115aeb75 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:20.429598 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d746a0-a014-49e3-85b8-4cac115aeb75 None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:20.429598 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d746a0-a014-49e3-85b8-4cac115aeb75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:20.429598 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d746a0-a014-49e3-85b8-4cac115aeb75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:20.429598 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d746a0-a014-49e3-85b8-4cac115aeb75 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:20.437559 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 299/602] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:39:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:20.439044 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24765a-a63c-4ae3-bccb-f2acc94dd632 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:20.439338 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24765a-a63c-4ae3-bccb-f2acc94dd632 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:20.439615 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24765a-a63c-4ae3-bccb-f2acc94dd632 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:20.441536 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 300/603] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:20.446308 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24765a-a63c-4ae3-bccb-f2acc94dd632 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:20.495442 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6c108-8f74-42fb-a60a-f3ee695b22ad None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:20.531542 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541547f-13ca-4180-8b95-d4a0f853a2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:20.532221 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541547f-13ca-4180-8b95-d4a0f853a2ae None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:20.532817 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541547f-13ca-4180-8b95-d4a0f853a2ae None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:20.533145 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541547f-13ca-4180-8b95-d4a0f853a2ae None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:20.533914 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541547f-13ca-4180-8b95-d4a0f853a2ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:20.534266 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541547f-13ca-4180-8b95-d4a0f853a2ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:20.535796 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0541547f-13ca-4180-8b95-d4a0f853a2ae None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:20.553341 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 304/604] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:20.554808 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc24765a-a63c-4ae3-bccb-f2acc94dd632 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:20.555062 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193fc7b-54c7-49b2-9428-8aaa4c67853f None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:20.555408 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193fc7b-54c7-49b2-9428-8aaa4c67853f None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:20.555736 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193fc7b-54c7-49b2-9428-8aaa4c67853f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:20.575912 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-4193fc7b-54c7-49b2-9428-8aaa4c67853f None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:20.577163 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-4193fc7b-54c7-49b2-9428-8aaa4c67853f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:20.589702 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41e2fa-9892-4df9-9f68-9d2537bdf8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:20.590592 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41e2fa-9892-4df9-9f68-9d2537bdf8a2 None admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:20.590867 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41e2fa-9892-4df9-9f68-9d2537bdf8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:20.591129 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da41e2fa-9892-4df9-9f68-9d2537bdf8a2 None admin] PATH_INFO: `/v3/projects/7d693fb3e9fc4d82a0ed054f31f1e56e/users/731b8e066deb49e6b48804cbbe5cd6e9/roles/5189c0e028ff42908ca943fdb5ce1873` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:20.605813 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41e2fa-9892-4df9-9f68-9d2537bdf8a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d693fb3e9fc4d82a0ed054f31f1e56e, user_id=731b8e066deb49e6b48804cbbe5cd6e9, role_id=5189c0e028ff42908ca943fdb5ce1873)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:20.607275 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da41e2fa-9892-4df9-9f68-9d2537bdf8a2 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:20.631351 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 301/605] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Mar 8 13:39:20 2022] PUT /identity/v3/projects/7d693fb3e9fc4d82a0ed054f31f1e56e/users/731b8e066deb49e6b48804cbbe5cd6e9/roles/5189c0e028ff42908ca943fdb5ce1873 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:39:20.632124 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41e2fa-9892-4df9-9f68-9d2537bdf8a2 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:20.658284 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 305/606] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:20.686824 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193fc7b-54c7-49b2-9428-8aaa4c67853f None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:20.764369 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da41e2fa-9892-4df9-9f68-9d2537bdf8a2 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:20.793892 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193fc7b-54c7-49b2-9428-8aaa4c67853f None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:20.800130 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc5559-1500-4b37-b103-8671d18cddd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:20.800927 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc5559-1500-4b37-b103-8671d18cddd7 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:20.801202 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc5559-1500-4b37-b103-8671d18cddd7 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:20.801501 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc5559-1500-4b37-b103-8671d18cddd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:20.808866 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc5559-1500-4b37-b103-8671d18cddd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:20.810342 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc5559-1500-4b37-b103-8671d18cddd7 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:20.824148 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-fabc5559-1500-4b37-b103-8671d18cddd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:20.825713 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 302/607] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:20.831200 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc5559-1500-4b37-b103-8671d18cddd7 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:20.832955 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b18a3-b6ed-40c4-834a-86c257d05c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:20.833953 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b18a3-b6ed-40c4-834a-86c257d05c1d None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:20.834400 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b18a3-b6ed-40c4-834a-86c257d05c1d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:20.834823 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b18a3-b6ed-40c4-834a-86c257d05c1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:20.846588 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b18a3-b6ed-40c4-834a-86c257d05c1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:20.854030 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-5c2b18a3-b6ed-40c4-834a-86c257d05c1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:39:20.855726 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 306/608] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Mar 8 13:39:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:39:20.861702 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b18a3-b6ed-40c4-834a-86c257d05c1d None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:20.945003 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc5559-1500-4b37-b103-8671d18cddd7 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:20.993562 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e155e76-4205-44a7-9e74-17aed8df95cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:20.994234 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e155e76-4205-44a7-9e74-17aed8df95cc None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:20.994521 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e155e76-4205-44a7-9e74-17aed8df95cc None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:20.994795 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e155e76-4205-44a7-9e74-17aed8df95cc None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:20.995595 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e155e76-4205-44a7-9e74-17aed8df95cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:20.995906 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e155e76-4205-44a7-9e74-17aed8df95cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:20.997376 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e155e76-4205-44a7-9e74-17aed8df95cc None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:21.020296 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 303/609] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:39:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:21.021533 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e155e76-4205-44a7-9e74-17aed8df95cc None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:21.059527 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b18a3-b6ed-40c4-834a-86c257d05c1d None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:21.119184 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e155e76-4205-44a7-9e74-17aed8df95cc None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:21.119715 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eca535-fb10-4044-ada9-cc2a8ad72ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:21.119955 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eca535-fb10-4044-ada9-cc2a8ad72ea1 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:21.120125 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eca535-fb10-4044-ada9-cc2a8ad72ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:21.120387 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eca535-fb10-4044-ada9-cc2a8ad72ea1 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:21.122093 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eca535-fb10-4044-ada9-cc2a8ad72ea1 None admin] RBAC: Adding query filter params (name=service) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:21.122407 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eca535-fb10-4044-ada9-cc2a8ad72ea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:21.123805 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eca535-fb10-4044-ada9-cc2a8ad72ea1 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:21.137783 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 307/610] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Mar 8 13:39:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:21.144111 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eca535-fb10-4044-ada9-cc2a8ad72ea1 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:21.174560 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b25b2-11fa-4b1e-8edf-191d1767d8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:21.175454 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b25b2-11fa-4b1e-8edf-191d1767d8b6 None admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:21.175787 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b25b2-11fa-4b1e-8edf-191d1767d8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:21.176061 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b25b2-11fa-4b1e-8edf-191d1767d8b6 None admin] PATH_INFO: `/v3/projects/7d693fb3e9fc4d82a0ed054f31f1e56e/users/4c610d719b3049f98b95cc8e9bd56834/roles/5189c0e028ff42908ca943fdb5ce1873` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:21.208669 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b25b2-11fa-4b1e-8edf-191d1767d8b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d693fb3e9fc4d82a0ed054f31f1e56e, user_id=4c610d719b3049f98b95cc8e9bd56834, role_id=5189c0e028ff42908ca943fdb5ce1873)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:21.210133 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b25b2-11fa-4b1e-8edf-191d1767d8b6 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:21.237511 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 304/611] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Mar 8 13:39:21 2022] PUT /identity/v3/projects/7d693fb3e9fc4d82a0ed054f31f1e56e/users/4c610d719b3049f98b95cc8e9bd56834/roles/5189c0e028ff42908ca943fdb5ce1873 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:39:21.289146 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eca535-fb10-4044-ada9-cc2a8ad72ea1 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:21.323749 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b0f7f-6366-46da-a4eb-6e11b4600d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:21.324541 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b0f7f-6366-46da-a4eb-6e11b4600d8b None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:21.324823 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b0f7f-6366-46da-a4eb-6e11b4600d8b None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:21.325099 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b0f7f-6366-46da-a4eb-6e11b4600d8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:21.336287 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b0f7f-6366-46da-a4eb-6e11b4600d8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:21.337794 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b0f7f-6366-46da-a4eb-6e11b4600d8b None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:21.355055 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-732b0f7f-6366-46da-a4eb-6e11b4600d8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:21.356711 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 308/612] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:21.362468 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b25b2-11fa-4b1e-8edf-191d1767d8b6 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:21.516660 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b25b2-11fa-4b1e-8edf-191d1767d8b6 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:21.554256 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f59ebd-b63d-4890-8fca-f4ccb5eee4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:21.554918 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f59ebd-b63d-4890-8fca-f4ccb5eee4d8 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:21.555198 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f59ebd-b63d-4890-8fca-f4ccb5eee4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:21.555473 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f59ebd-b63d-4890-8fca-f4ccb5eee4d8 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:21.556208 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f59ebd-b63d-4890-8fca-f4ccb5eee4d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:21.556513 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f59ebd-b63d-4890-8fca-f4ccb5eee4d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:21.558028 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f59ebd-b63d-4890-8fca-f4ccb5eee4d8 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:21.569887 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 305/613] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:21.575027 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b0f7f-6366-46da-a4eb-6e11b4600d8b None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:21.674191 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b0f7f-6366-46da-a4eb-6e11b4600d8b None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:21.712798 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc8007-5d5a-4739-8532-7b0205b47fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:21.713966 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc8007-5d5a-4739-8532-7b0205b47fa5 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:21.714449 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc8007-5d5a-4739-8532-7b0205b47fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:21.714928 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc8007-5d5a-4739-8532-7b0205b47fa5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:21.727579 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc8007-5d5a-4739-8532-7b0205b47fa5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:21.729287 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc8007-5d5a-4739-8532-7b0205b47fa5 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:21.749622 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-a0bc8007-5d5a-4739-8532-7b0205b47fa5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 13:39:21.751195 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 309/614] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:39:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:21.756894 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f59ebd-b63d-4890-8fca-f4ccb5eee4d8 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:21.878597 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3a596-1727-4c85-afbb-082ddb0bd7ab None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:21.879219 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3a596-1727-4c85-afbb-082ddb0bd7ab None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:21.879681 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3a596-1727-4c85-afbb-082ddb0bd7ab None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:21.881652 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 310/615] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:21.889367 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9e833-c1c0-4869-bf9e-b8a1cae6b0a5 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:21.889892 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9e833-c1c0-4869-bf9e-b8a1cae6b0a5 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:21.890347 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9e833-c1c0-4869-bf9e-b8a1cae6b0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:21.909888 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f59ebd-b63d-4890-8fca-f4ccb5eee4d8 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:21.914644 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-b4b9e833-c1c0-4869-bf9e-b8a1cae6b0a5 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:21.920755 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-b4b9e833-c1c0-4869-bf9e-b8a1cae6b0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:21.968272 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d259189-6c09-4d23-95e3-0c55a967242d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:21.968946 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d259189-6c09-4d23-95e3-0c55a967242d None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:21.969221 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d259189-6c09-4d23-95e3-0c55a967242d None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:21.969524 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d259189-6c09-4d23-95e3-0c55a967242d None admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:21.970365 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d259189-6c09-4d23-95e3-0c55a967242d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:21.971793 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d259189-6c09-4d23-95e3-0c55a967242d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:21.973252 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d259189-6c09-4d23-95e3-0c55a967242d None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:22.007804 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 306/616] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Mar 8 13:39:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:22.013521 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d259189-6c09-4d23-95e3-0c55a967242d None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:22.051610 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 311/617] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:22.086822 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9e833-c1c0-4869-bf9e-b8a1cae6b0a5 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:22.160522 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d259189-6c09-4d23-95e3-0c55a967242d None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:22.223061 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be84d47-2664-45e8-93ce-c68f294b7988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:22.224537 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be84d47-2664-45e8-93ce-c68f294b7988 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:22.225761 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be84d47-2664-45e8-93ce-c68f294b7988 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:22.226051 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be84d47-2664-45e8-93ce-c68f294b7988 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:22.247674 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be84d47-2664-45e8-93ce-c68f294b7988 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:22.249205 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be84d47-2664-45e8-93ce-c68f294b7988 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:22.262760 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9e833-c1c0-4869-bf9e-b8a1cae6b0a5 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:22.281748 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-0be84d47-2664-45e8-93ce-c68f294b7988 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:22.284370 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 307/618] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:22.290264 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be84d47-2664-45e8-93ce-c68f294b7988 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:22.326495 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e38408-9ae0-4aac-b730-d7778f9e96e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:22.327324 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e38408-9ae0-4aac-b730-d7778f9e96e7 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:22.327599 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e38408-9ae0-4aac-b730-d7778f9e96e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:22.327869 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e38408-9ae0-4aac-b730-d7778f9e96e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:22.343811 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e38408-9ae0-4aac-b730-d7778f9e96e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:22.350725 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-d9e38408-9ae0-4aac-b730-d7778f9e96e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:39:22.359576 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 312/619] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Mar 8 13:39:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:22.365045 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e38408-9ae0-4aac-b730-d7778f9e96e7 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:22.423526 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be84d47-2664-45e8-93ce-c68f294b7988 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:22.457031 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76563276-95f6-4a3b-9974-db76955ade09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:22.458066 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76563276-95f6-4a3b-9974-db76955ade09 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:22.458543 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76563276-95f6-4a3b-9974-db76955ade09 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:22.459007 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76563276-95f6-4a3b-9974-db76955ade09 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:22.459943 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76563276-95f6-4a3b-9974-db76955ade09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:22.460440 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76563276-95f6-4a3b-9974-db76955ade09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:22.462030 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76563276-95f6-4a3b-9974-db76955ade09 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:22.473952 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 308/620] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:22.480648 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76563276-95f6-4a3b-9974-db76955ade09 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:22.581776 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76563276-95f6-4a3b-9974-db76955ade09 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:22.601378 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e38408-9ae0-4aac-b730-d7778f9e96e7 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:22.634099 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588c870-d42c-4e68-a00a-d9802e983b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:22.634897 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588c870-d42c-4e68-a00a-d9802e983b51 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:22.635399 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588c870-d42c-4e68-a00a-d9802e983b51 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:22.635716 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d588c870-d42c-4e68-a00a-d9802e983b51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:22.642656 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d588c870-d42c-4e68-a00a-d9802e983b51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:22.644165 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d588c870-d42c-4e68-a00a-d9802e983b51 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:22.654059 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cf9c5-41d6-43e8-89ea-2200860b34b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:22.654736 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cf9c5-41d6-43e8-89ea-2200860b34b4 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:22.655054 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cf9c5-41d6-43e8-89ea-2200860b34b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:22.655331 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cf9c5-41d6-43e8-89ea-2200860b34b4 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:22.656094 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4cf9c5-41d6-43e8-89ea-2200860b34b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:22.656399 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4cf9c5-41d6-43e8-89ea-2200860b34b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:22.658188 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4cf9c5-41d6-43e8-89ea-2200860b34b4 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:22.659674 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-d588c870-d42c-4e68-a00a-d9802e983b51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:22.661231 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 309/621] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:22.666831 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588c870-d42c-4e68-a00a-d9802e983b51 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:22.676885 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 313/622] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Mar 8 13:39:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:22.682293 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cf9c5-41d6-43e8-89ea-2200860b34b4 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:22.770887 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d588c870-d42c-4e68-a00a-d9802e983b51 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:22.804376 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc22d6-61ae-48fb-8367-787c23c8673d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:22.805042 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc22d6-61ae-48fb-8367-787c23c8673d None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:22.805318 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc22d6-61ae-48fb-8367-787c23c8673d None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:22.805630 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dc22d6-61ae-48fb-8367-787c23c8673d None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:22.809376 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc22d6-61ae-48fb-8367-787c23c8673d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:22.809376 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc22d6-61ae-48fb-8367-787c23c8673d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:22.809376 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dc22d6-61ae-48fb-8367-787c23c8673d None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:22.820333 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 310/623] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:39:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:22.826008 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc22d6-61ae-48fb-8367-787c23c8673d None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:22.888280 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cf9c5-41d6-43e8-89ea-2200860b34b4 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:22.926286 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dc22d6-61ae-48fb-8367-787c23c8673d None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:22.954068 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be00372-43e1-4cb6-a02e-a0fdddf81f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:22.954883 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be00372-43e1-4cb6-a02e-a0fdddf81f75 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:22.955165 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be00372-43e1-4cb6-a02e-a0fdddf81f75 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:22.955438 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be00372-43e1-4cb6-a02e-a0fdddf81f75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:22.959975 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e578b2-e4a8-4008-9dfc-59f15e051942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:22.960864 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e578b2-e4a8-4008-9dfc-59f15e051942 None admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:22.961183 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e578b2-e4a8-4008-9dfc-59f15e051942 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:22.961479 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e578b2-e4a8-4008-9dfc-59f15e051942 None admin] PATH_INFO: `/v3/projects/7d693fb3e9fc4d82a0ed054f31f1e56e/users/5a0f442666d0459aa9a34fc2f91228e9/roles/5189c0e028ff42908ca943fdb5ce1873` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:22.974626 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be00372-43e1-4cb6-a02e-a0fdddf81f75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:22.975997 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e578b2-e4a8-4008-9dfc-59f15e051942 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d693fb3e9fc4d82a0ed054f31f1e56e, user_id=5a0f442666d0459aa9a34fc2f91228e9, role_id=5189c0e028ff42908ca943fdb5ce1873)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:22.976107 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be00372-43e1-4cb6-a02e-a0fdddf81f75 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:22.977681 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e578b2-e4a8-4008-9dfc-59f15e051942 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:22.999238 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 311/624] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Mar 8 13:39:22 2022] PUT /identity/v3/projects/7d693fb3e9fc4d82a0ed054f31f1e56e/users/5a0f442666d0459aa9a34fc2f91228e9/roles/5189c0e028ff42908ca943fdb5ce1873 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:39:23.011794 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-0be00372-43e1-4cb6-a02e-a0fdddf81f75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:23.013279 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 314/625] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:39:23.022709 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e578b2-e4a8-4008-9dfc-59f15e051942 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:23.148255 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e578b2-e4a8-4008-9dfc-59f15e051942 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:23.184818 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384539a-97d8-4e0c-a25d-5b9f7dd70746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:23.185607 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384539a-97d8-4e0c-a25d-5b9f7dd70746 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:23.185771 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384539a-97d8-4e0c-a25d-5b9f7dd70746 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:23.186166 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384539a-97d8-4e0c-a25d-5b9f7dd70746 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:23.186906 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384539a-97d8-4e0c-a25d-5b9f7dd70746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:23.187206 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384539a-97d8-4e0c-a25d-5b9f7dd70746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:23.188612 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384539a-97d8-4e0c-a25d-5b9f7dd70746 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:23.201521 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 312/626] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:23.207001 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be00372-43e1-4cb6-a02e-a0fdddf81f75 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:23.308386 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be00372-43e1-4cb6-a02e-a0fdddf81f75 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:23.341380 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396671f-a027-4bd6-ade3-1f5a7bb0c217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:23.342225 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396671f-a027-4bd6-ade3-1f5a7bb0c217 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:23.342516 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396671f-a027-4bd6-ade3-1f5a7bb0c217 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:23.342785 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396671f-a027-4bd6-ade3-1f5a7bb0c217 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:23.347675 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f48af-2a85-4e0f-abb3-1234ab057448 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:23.347953 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f48af-2a85-4e0f-abb3-1234ab057448 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:23.348224 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f48af-2a85-4e0f-abb3-1234ab057448 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:23.350022 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 313/627] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:23.355024 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396671f-a027-4bd6-ade3-1f5a7bb0c217 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:23.355480 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4746fb1-b33c-4f55-b822-5d87e900d4de None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:23.355765 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4746fb1-b33c-4f55-b822-5d87e900d4de None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:23.356035 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4746fb1-b33c-4f55-b822-5d87e900d4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:23.357399 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396671f-a027-4bd6-ade3-1f5a7bb0c217 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:23.372072 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-e396671f-a027-4bd6-ade3-1f5a7bb0c217 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 13:39:23.373975 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 315/628] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Mar 8 13:39:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:23.375115 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-b4746fb1-b33c-4f55-b822-5d87e900d4de None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:23.376300 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-b4746fb1-b33c-4f55-b822-5d87e900d4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:23.383297 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396671f-a027-4bd6-ade3-1f5a7bb0c217 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:23.495055 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 314/629] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:39:23.505345 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396671f-a027-4bd6-ade3-1f5a7bb0c217 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:23.527000 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bbbd0-fa4d-4394-b193-9aed07f90d85 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:23.527307 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bbbd0-fa4d-4394-b193-9aed07f90d85 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:23.527557 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8bbbd0-fa4d-4394-b193-9aed07f90d85 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:23.529667 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 315/630] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:23.538675 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b48548-afe2-4b11-8f68-92dfddb070e4 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:23.538962 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b48548-afe2-4b11-8f68-92dfddb070e4 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:23.539245 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b48548-afe2-4b11-8f68-92dfddb070e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:23.548782 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab61dd-f518-43f3-ba04-8d490cf268b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:23.549498 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab61dd-f518-43f3-ba04-8d490cf268b3 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:23.549830 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab61dd-f518-43f3-ba04-8d490cf268b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:23.550096 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab61dd-f518-43f3-ba04-8d490cf268b3 None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:23.551434 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab61dd-f518-43f3-ba04-8d490cf268b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:23.551738 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab61dd-f518-43f3-ba04-8d490cf268b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:23.553455 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab61dd-f518-43f3-ba04-8d490cf268b3 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:23.556261 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-96b48548-afe2-4b11-8f68-92dfddb070e4 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:23.557483 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-96b48548-afe2-4b11-8f68-92dfddb070e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:23.575765 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 316/631] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Mar 8 13:39:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:23.576694 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab61dd-f518-43f3-ba04-8d490cf268b3 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:23.628000 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 316/632] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:23.628947 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b48548-afe2-4b11-8f68-92dfddb070e4 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:23.691043 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab61dd-f518-43f3-ba04-8d490cf268b3 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:23.735780 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f48ab-a520-409f-b7db-4b131a811602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:23.736583 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f48ab-a520-409f-b7db-4b131a811602 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:23.736853 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f48ab-a520-409f-b7db-4b131a811602 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:23.737114 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f48ab-a520-409f-b7db-4b131a811602 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:23.743766 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b48548-afe2-4b11-8f68-92dfddb070e4 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:23.747493 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f48ab-a520-409f-b7db-4b131a811602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:23.754619 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-130f48ab-a520-409f-b7db-4b131a811602 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:39:23.756287 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 317/633] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Mar 8 13:39:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:23.757213 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f48ab-a520-409f-b7db-4b131a811602 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:23.777520 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c092700-2b8c-44bc-9a1c-00e9b3886ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:23.778291 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c092700-2b8c-44bc-9a1c-00e9b3886ac7 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:23.778662 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c092700-2b8c-44bc-9a1c-00e9b3886ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:23.779021 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c092700-2b8c-44bc-9a1c-00e9b3886ac7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:23.844834 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c092700-2b8c-44bc-9a1c-00e9b3886ac7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:23.846527 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c092700-2b8c-44bc-9a1c-00e9b3886ac7 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:23.855659 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f48ab-a520-409f-b7db-4b131a811602 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:23.888461 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7f585-5f17-48f8-aae9-7841c2a3cbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:23.889600 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7f585-5f17-48f8-aae9-7841c2a3cbdd None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:23.890110 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7f585-5f17-48f8-aae9-7841c2a3cbdd None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:23.890567 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7f585-5f17-48f8-aae9-7841c2a3cbdd None admin] PATH_INFO: `/v3/roles/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:23.900576 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7f585-5f17-48f8-aae9-7841c2a3cbdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:23.908162 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-1de7f585-5f17-48f8-aae9-7841c2a3cbdd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:39:23.909883 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 318/634] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Mar 8 13:39:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:23.910869 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7f585-5f17-48f8-aae9-7841c2a3cbdd None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:23.959606 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 317/635] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:39:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:23.960814 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c092700-2b8c-44bc-9a1c-00e9b3886ac7 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:24.018439 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7f585-5f17-48f8-aae9-7841c2a3cbdd None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:24.056358 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c092700-2b8c-44bc-9a1c-00e9b3886ac7 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:24.057596 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c31e4-538c-45d1-ad38-46518081f012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:24.058331 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c31e4-538c-45d1-ad38-46518081f012 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:24.058616 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c31e4-538c-45d1-ad38-46518081f012 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:24.058879 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c31e4-538c-45d1-ad38-46518081f012 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:24.059622 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c31e4-538c-45d1-ad38-46518081f012 None admin] RBAC: Adding query filter params (name=service) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:24.059918 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c31e4-538c-45d1-ad38-46518081f012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:24.061327 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c31e4-538c-45d1-ad38-46518081f012 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:24.074223 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 319/636] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Mar 8 13:39:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:24.074223 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c31e4-538c-45d1-ad38-46518081f012 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:24.094278 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa20dc9-3c9a-47f0-8951-76430df21846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:24.094948 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa20dc9-3c9a-47f0-8951-76430df21846 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:24.095231 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa20dc9-3c9a-47f0-8951-76430df21846 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:24.095505 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa20dc9-3c9a-47f0-8951-76430df21846 None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:24.096251 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa20dc9-3c9a-47f0-8951-76430df21846 None admin] RBAC: Adding query filter params (name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:24.096555 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa20dc9-3c9a-47f0-8951-76430df21846 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:24.097960 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa20dc9-3c9a-47f0-8951-76430df21846 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:24.110609 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 318/637] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Mar 8 13:39:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:24.110609 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ac68b-ec04-4903-998d-99f1bf829c22 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:24.110609 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ac68b-ec04-4903-998d-99f1bf829c22 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:24.110609 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ac68b-ec04-4903-998d-99f1bf829c22 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:24.110609 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 319/638] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:24.110609 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ac68b-ec04-4903-998d-99f1bf829c22 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:24.173597 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c31e4-538c-45d1-ad38-46518081f012 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:24.204723 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf58780-2845-47d4-a6d3-aad1c51424df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:24.205573 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf58780-2845-47d4-a6d3-aad1c51424df None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:24.205700 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1ac68b-ec04-4903-998d-99f1bf829c22 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:24.206112 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf58780-2845-47d4-a6d3-aad1c51424df None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:24.206112 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf58780-2845-47d4-a6d3-aad1c51424df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:24.216538 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf58780-2845-47d4-a6d3-aad1c51424df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:24.218042 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf58780-2845-47d4-a6d3-aad1c51424df None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:24.233611 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-adf58780-2845-47d4-a6d3-aad1c51424df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:24.234902 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 320/639] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:24.239394 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf58780-2845-47d4-a6d3-aad1c51424df None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:24.239517 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee083ebf-b75c-4396-9b27-cdd2dcad0de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:24.239746 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee083ebf-b75c-4396-9b27-cdd2dcad0de6 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:24.240038 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee083ebf-b75c-4396-9b27-cdd2dcad0de6 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:24.240313 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee083ebf-b75c-4396-9b27-cdd2dcad0de6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:24.250939 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee083ebf-b75c-4396-9b27-cdd2dcad0de6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:24.252400 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee083ebf-b75c-4396-9b27-cdd2dcad0de6 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:24.268807 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-ee083ebf-b75c-4396-9b27-cdd2dcad0de6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:24.269964 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 320/640] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:24.271108 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef469d3-b440-4078-a19c-67e4b247ad6f None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:24.271390 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef469d3-b440-4078-a19c-67e4b247ad6f None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:24.271662 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef469d3-b440-4078-a19c-67e4b247ad6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:24.289056 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-0ef469d3-b440-4078-a19c-67e4b247ad6f None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:24.290243 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-0ef469d3-b440-4078-a19c-67e4b247ad6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:24.337203 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf58780-2845-47d4-a6d3-aad1c51424df None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:24.354005 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 321/641] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:24.355001 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef469d3-b440-4078-a19c-67e4b247ad6f None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:24.379417 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36001f-7082-40a8-9752-cb38f40d8e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:24.380214 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36001f-7082-40a8-9752-cb38f40d8e93 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:24.380487 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36001f-7082-40a8-9752-cb38f40d8e93 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:24.380755 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36001f-7082-40a8-9752-cb38f40d8e93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:24.392199 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36001f-7082-40a8-9752-cb38f40d8e93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:24.393648 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36001f-7082-40a8-9752-cb38f40d8e93 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:24.410092 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-bc36001f-7082-40a8-9752-cb38f40d8e93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:24.411399 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 321/642] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:24.412236 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36001f-7082-40a8-9752-cb38f40d8e93 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:24.474502 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef469d3-b440-4078-a19c-67e4b247ad6f None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:24.510269 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36001f-7082-40a8-9752-cb38f40d8e93 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:24.512392 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d8b75-f47a-41c4-8d9f-257017aa16e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:24.513061 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d8b75-f47a-41c4-8d9f-257017aa16e6 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:24.513342 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d8b75-f47a-41c4-8d9f-257017aa16e6 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:24.513642 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d8b75-f47a-41c4-8d9f-257017aa16e6 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:24.514396 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d8b75-f47a-41c4-8d9f-257017aa16e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:24.514696 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d8b75-f47a-41c4-8d9f-257017aa16e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:24.516067 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d8b75-f47a-41c4-8d9f-257017aa16e6 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:24.531671 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 322/643] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:24.531671 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d8b75-f47a-41c4-8d9f-257017aa16e6 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:24.545614 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93001d-8a2f-47ff-bff8-bdb956cfd091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:24.546279 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93001d-8a2f-47ff-bff8-bdb956cfd091 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:24.546583 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93001d-8a2f-47ff-bff8-bdb956cfd091 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:24.546834 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93001d-8a2f-47ff-bff8-bdb956cfd091 None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:24.547559 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93001d-8a2f-47ff-bff8-bdb956cfd091 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:24.547860 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93001d-8a2f-47ff-bff8-bdb956cfd091 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:24.549210 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d93001d-8a2f-47ff-bff8-bdb956cfd091 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:24.561130 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 322/644] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:24.561969 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93001d-8a2f-47ff-bff8-bdb956cfd091 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:24.626308 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d8b75-f47a-41c4-8d9f-257017aa16e6 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:24.653446 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93001d-8a2f-47ff-bff8-bdb956cfd091 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:24.658683 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cc6ab-d398-4d8c-9a04-b5f33f47f217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:24.659469 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cc6ab-d398-4d8c-9a04-b5f33f47f217 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:24.659745 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cc6ab-d398-4d8c-9a04-b5f33f47f217 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:24.660010 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976cc6ab-d398-4d8c-9a04-b5f33f47f217 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:24.669879 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976cc6ab-d398-4d8c-9a04-b5f33f47f217 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:24.676656 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-976cc6ab-d398-4d8c-9a04-b5f33f47f217 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:39:24.678134 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 323/645] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Mar 8 13:39:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:24.678775 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cc6ab-d398-4d8c-9a04-b5f33f47f217 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:24.689901 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a96d62-1067-413d-89d4-ffc9b3edd1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:24.690587 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a96d62-1067-413d-89d4-ffc9b3edd1c8 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:24.690867 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a96d62-1067-413d-89d4-ffc9b3edd1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:24.691142 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a96d62-1067-413d-89d4-ffc9b3edd1c8 None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:24.691871 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a96d62-1067-413d-89d4-ffc9b3edd1c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:24.692172 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a96d62-1067-413d-89d4-ffc9b3edd1c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:24.693628 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a96d62-1067-413d-89d4-ffc9b3edd1c8 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:24.709828 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 323/646] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:24.709828 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a96d62-1067-413d-89d4-ffc9b3edd1c8 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:24.779897 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976cc6ab-d398-4d8c-9a04-b5f33f47f217 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:24.800991 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a96d62-1067-413d-89d4-ffc9b3edd1c8 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:24.811464 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7875f7-5535-4b1b-8762-7993c3969c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:24.812257 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7875f7-5535-4b1b-8762-7993c3969c9c None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:24.812534 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7875f7-5535-4b1b-8762-7993c3969c9c None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:24.812801 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7875f7-5535-4b1b-8762-7993c3969c9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:24.822473 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7875f7-5535-4b1b-8762-7993c3969c9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:24.823949 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7875f7-5535-4b1b-8762-7993c3969c9c None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:24.833307 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a2913-7872-4916-916a-c0cb34412549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:24.834132 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a2913-7872-4916-916a-c0cb34412549 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:24.834414 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a2913-7872-4916-916a-c0cb34412549 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:24.834688 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a2913-7872-4916-916a-c0cb34412549 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:24.838392 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-cb7875f7-5535-4b1b-8762-7993c3969c9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:24.839759 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 324/647] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:24.844388 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7875f7-5535-4b1b-8762-7993c3969c9c None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:24.845802 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a2913-7872-4916-916a-c0cb34412549 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:24.847319 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a2913-7872-4916-916a-c0cb34412549 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:24.860772 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-469a2913-7872-4916-916a-c0cb34412549 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 08 13:39:24.862152 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 324/648] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:39:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:24.866850 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a2913-7872-4916-916a-c0cb34412549 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:24.934896 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7875f7-5535-4b1b-8762-7993c3969c9c None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:24.961562 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a2913-7872-4916-916a-c0cb34412549 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:24.967189 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edc406-3a53-4ca6-9227-05cd32f9bff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:24.967871 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edc406-3a53-4ca6-9227-05cd32f9bff5 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:24.968136 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edc406-3a53-4ca6-9227-05cd32f9bff5 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:24.968412 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edc406-3a53-4ca6-9227-05cd32f9bff5 None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:24.969170 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3edc406-3a53-4ca6-9227-05cd32f9bff5 None admin] RBAC: Adding query filter params (name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:24.969510 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3edc406-3a53-4ca6-9227-05cd32f9bff5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:24.970876 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3edc406-3a53-4ca6-9227-05cd32f9bff5 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:24.983043 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 325/649] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Mar 8 13:39:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:24.983043 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edc406-3a53-4ca6-9227-05cd32f9bff5 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:24.997963 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c381cf-4e82-4983-b929-efa9009500b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:24.998923 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c381cf-4e82-4983-b929-efa9009500b6 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:24.999212 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c381cf-4e82-4983-b929-efa9009500b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:24.999484 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c381cf-4e82-4983-b929-efa9009500b6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:25.007167 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c381cf-4e82-4983-b929-efa9009500b6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:25.008612 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c381cf-4e82-4983-b929-efa9009500b6 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:25.021849 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-b9c381cf-4e82-4983-b929-efa9009500b6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Mar 08 13:39:25.023083 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 325/650] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:39:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:25.023841 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c381cf-4e82-4983-b929-efa9009500b6 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:25.083356 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edc406-3a53-4ca6-9227-05cd32f9bff5 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:25.117102 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c60492-3441-4f97-84ae-5a27f5cb9dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:25.117811 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c60492-3441-4f97-84ae-5a27f5cb9dbf None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:25.118090 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c60492-3441-4f97-84ae-5a27f5cb9dbf None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:25.118359 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c60492-3441-4f97-84ae-5a27f5cb9dbf None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:25.119148 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c60492-3441-4f97-84ae-5a27f5cb9dbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:25.119455 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c60492-3441-4f97-84ae-5a27f5cb9dbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:25.120924 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c60492-3441-4f97-84ae-5a27f5cb9dbf None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:25.128645 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c381cf-4e82-4983-b929-efa9009500b6 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:25.138342 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 326/651] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:39:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:25.138342 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c60492-3441-4f97-84ae-5a27f5cb9dbf None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:25.164573 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cce07-e9d4-4723-9a7c-f4b35cc9584a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:25.165242 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cce07-e9d4-4723-9a7c-f4b35cc9584a None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:25.165566 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cce07-e9d4-4723-9a7c-f4b35cc9584a None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:25.165828 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8cce07-e9d4-4723-9a7c-f4b35cc9584a None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:25.166662 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8cce07-e9d4-4723-9a7c-f4b35cc9584a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:25.166967 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8cce07-e9d4-4723-9a7c-f4b35cc9584a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:25.168399 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8cce07-e9d4-4723-9a7c-f4b35cc9584a None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:25.189587 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 326/652] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Mar 8 13:39:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:25.189587 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cce07-e9d4-4723-9a7c-f4b35cc9584a None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:25.242881 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c60492-3441-4f97-84ae-5a27f5cb9dbf None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:25.276634 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798e671-fa44-4ce1-ad10-bc9e8a00ba88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:25.277450 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798e671-fa44-4ce1-ad10-bc9e8a00ba88 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:25.277730 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798e671-fa44-4ce1-ad10-bc9e8a00ba88 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:25.277996 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798e671-fa44-4ce1-ad10-bc9e8a00ba88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:25.287492 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8cce07-e9d4-4723-9a7c-f4b35cc9584a None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:25.288095 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798e671-fa44-4ce1-ad10-bc9e8a00ba88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:25.289644 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798e671-fa44-4ce1-ad10-bc9e8a00ba88 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:25.305846 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-d798e671-fa44-4ce1-ad10-bc9e8a00ba88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:25.311688 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 327/653] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:25.311688 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798e671-fa44-4ce1-ad10-bc9e8a00ba88 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:25.319970 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d458259-d1cd-40c2-9a0a-5024d94b7fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:25.320641 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d458259-d1cd-40c2-9a0a-5024d94b7fa3 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:25.320920 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d458259-d1cd-40c2-9a0a-5024d94b7fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:25.321252 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d458259-d1cd-40c2-9a0a-5024d94b7fa3 None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:25.322160 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d458259-d1cd-40c2-9a0a-5024d94b7fa3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:25.322473 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d458259-d1cd-40c2-9a0a-5024d94b7fa3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:25.323887 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d458259-d1cd-40c2-9a0a-5024d94b7fa3 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:25.345536 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 327/654] 10.222.0.18 () {56 vars in 1137 bytes} [Tue Mar 8 13:39:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:25.345536 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d458259-d1cd-40c2-9a0a-5024d94b7fa3 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:25.411419 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798e671-fa44-4ce1-ad10-bc9e8a00ba88 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:25.436740 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d458259-d1cd-40c2-9a0a-5024d94b7fa3 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:25.445592 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5b6ca-208a-4b21-b290-ce76424d5317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:25.446247 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5b6ca-208a-4b21-b290-ce76424d5317 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:25.446528 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5b6ca-208a-4b21-b290-ce76424d5317 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:25.446800 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5b6ca-208a-4b21-b290-ce76424d5317 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:25.447626 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5b6ca-208a-4b21-b290-ce76424d5317 None admin] RBAC: Adding query filter params (role.id=5189c0e028ff42908ca943fdb5ce1873, scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e, user.id=21ec894123044d4382995791c74c587b) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:25.447934 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5b6ca-208a-4b21-b290-ce76424d5317 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:25.449388 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe5b6ca-208a-4b21-b290-ce76424d5317 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:25.465489 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 328/655] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:39:25 2022] GET /identity/v3/role_assignments?user.id=21ec894123044d4382995791c74c587b&scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e&role.id=5189c0e028ff42908ca943fdb5ce1873 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:25.465489 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5b6ca-208a-4b21-b290-ce76424d5317 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:25.469789 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb979c49-be66-44c0-abc0-8a1dd8342c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:25.470451 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb979c49-be66-44c0-abc0-8a1dd8342c6c None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:25.470733 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb979c49-be66-44c0-abc0-8a1dd8342c6c None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:25.471004 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb979c49-be66-44c0-abc0-8a1dd8342c6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:25.546482 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb979c49-be66-44c0-abc0-8a1dd8342c6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:25.547979 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb979c49-be66-44c0-abc0-8a1dd8342c6c None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:25.577608 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5b6ca-208a-4b21-b290-ce76424d5317 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:25.611893 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a5076e-ef66-45c6-a7d7-739145e58f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:25.612477 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5076e-ef66-45c6-a7d7-739145e58f20 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:25.612752 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5076e-ef66-45c6-a7d7-739145e58f20 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:25.613019 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5076e-ef66-45c6-a7d7-739145e58f20 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:25.613780 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a5076e-ef66-45c6-a7d7-739145e58f20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:25.614080 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a5076e-ef66-45c6-a7d7-739145e58f20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:25.615464 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a5076e-ef66-45c6-a7d7-739145e58f20 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:25.632154 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 329/656] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:25.632154 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a5076e-ef66-45c6-a7d7-739145e58f20 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:25.650995 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 328/657] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:39:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:25.650995 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ca912-f6c5-476c-a603-3863e207ff4d None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:25.650995 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ca912-f6c5-476c-a603-3863e207ff4d None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:25.650995 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ca912-f6c5-476c-a603-3863e207ff4d None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:25.656510 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 329/658] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:25.656510 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ca912-f6c5-476c-a603-3863e207ff4d None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:25.732571 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a5076e-ef66-45c6-a7d7-739145e58f20 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:25.756620 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ca912-f6c5-476c-a603-3863e207ff4d None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:25.766364 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef4530-8afc-4c7c-a6d5-6eae409a3e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:25.767259 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef4530-8afc-4c7c-a6d5-6eae409a3e16 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:25.767713 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef4530-8afc-4c7c-a6d5-6eae409a3e16 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:25.768156 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef4530-8afc-4c7c-a6d5-6eae409a3e16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:25.791223 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2c448-90f4-4e6b-a000-4d3e35d989db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:25.792306 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2c448-90f4-4e6b-a000-4d3e35d989db None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:25.792752 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2c448-90f4-4e6b-a000-4d3e35d989db None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:25.793191 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2c448-90f4-4e6b-a000-4d3e35d989db None admin] PATH_INFO: `/v3/users/neutron` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:25.800458 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2c448-90f4-4e6b-a000-4d3e35d989db None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:25.801921 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2c448-90f4-4e6b-a000-4d3e35d989db None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:25.815330 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-b5d2c448-90f4-4e6b-a000-4d3e35d989db None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Mar 08 13:39:25.821176 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 330/659] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Mar 8 13:39:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:25.821176 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2c448-90f4-4e6b-a000-4d3e35d989db None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:25.836844 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef4530-8afc-4c7c-a6d5-6eae409a3e16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:25.838354 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef4530-8afc-4c7c-a6d5-6eae409a3e16 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:25.912724 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2c448-90f4-4e6b-a000-4d3e35d989db None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:25.932495 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 330/660] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:39:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:25.934102 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302f388-11bc-4d00-8acb-966c3ba3cbdc None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:25.934590 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302f388-11bc-4d00-8acb-966c3ba3cbdc None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:25.935075 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302f388-11bc-4d00-8acb-966c3ba3cbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:25.949742 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f1d9c-41c3-4444-9692-c4902073f3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:25.950551 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f1d9c-41c3-4444-9692-c4902073f3f9 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:25.950831 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f1d9c-41c3-4444-9692-c4902073f3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:25.951101 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f1d9c-41c3-4444-9692-c4902073f3f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:25.951939 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-4302f388-11bc-4d00-8acb-966c3ba3cbdc None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:25.953130 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-4302f388-11bc-4d00-8acb-966c3ba3cbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:25.961125 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f1d9c-41c3-4444-9692-c4902073f3f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:25.962618 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f1d9c-41c3-4444-9692-c4902073f3f9 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:25.981244 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-378f1d9c-41c3-4444-9692-c4902073f3f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:25.982715 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 331/661] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:25.983374 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f1d9c-41c3-4444-9692-c4902073f3f9 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:26.029376 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 331/662] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:26.029376 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302f388-11bc-4d00-8acb-966c3ba3cbdc None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:26.109159 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f1d9c-41c3-4444-9692-c4902073f3f9 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:26.113221 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302f388-11bc-4d00-8acb-966c3ba3cbdc None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:26.142793 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c127149-f68c-4288-9970-d81c6f09e482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:26.143449 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c127149-f68c-4288-9970-d81c6f09e482 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:26.143725 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c127149-f68c-4288-9970-d81c6f09e482 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:26.143989 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c127149-f68c-4288-9970-d81c6f09e482 None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:26.144809 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c127149-f68c-4288-9970-d81c6f09e482 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:26.145110 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c127149-f68c-4288-9970-d81c6f09e482 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:26.146616 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c127149-f68c-4288-9970-d81c6f09e482 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:26.149780 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc54910-9b1d-4195-bf94-57022e95509c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:26.150564 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc54910-9b1d-4195-bf94-57022e95509c None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:26.150843 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc54910-9b1d-4195-bf94-57022e95509c None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:26.151111 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc54910-9b1d-4195-bf94-57022e95509c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:26.161099 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc54910-9b1d-4195-bf94-57022e95509c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:26.162585 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc54910-9b1d-4195-bf94-57022e95509c None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:26.167847 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 332/663] 10.222.0.18 () {56 vars in 1139 bytes} [Tue Mar 8 13:39:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:26.167847 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c127149-f68c-4288-9970-d81c6f09e482 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:26.183905 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-7bc54910-9b1d-4195-bf94-57022e95509c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:26.189413 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 332/664] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:26.189413 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc54910-9b1d-4195-bf94-57022e95509c None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:26.262888 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c127149-f68c-4288-9970-d81c6f09e482 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:26.289386 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc54910-9b1d-4195-bf94-57022e95509c None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:26.296276 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18a2f8-0f5a-4ecd-8e38-ec8cde89dcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:26.296938 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18a2f8-0f5a-4ecd-8e38-ec8cde89dcee None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:26.297221 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18a2f8-0f5a-4ecd-8e38-ec8cde89dcee None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:26.297595 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18a2f8-0f5a-4ecd-8e38-ec8cde89dcee None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:26.298340 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18a2f8-0f5a-4ecd-8e38-ec8cde89dcee None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:26.298647 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18a2f8-0f5a-4ecd-8e38-ec8cde89dcee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:26.299996 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18a2f8-0f5a-4ecd-8e38-ec8cde89dcee None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:26.311035 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 333/665] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:26.312108 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18a2f8-0f5a-4ecd-8e38-ec8cde89dcee None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:26.329656 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69796b0d-e08f-4c00-842b-fd30dca64aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:26.330454 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69796b0d-e08f-4c00-842b-fd30dca64aff None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:26.330730 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69796b0d-e08f-4c00-842b-fd30dca64aff None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:26.330995 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69796b0d-e08f-4c00-842b-fd30dca64aff None admin] PATH_INFO: `/v3/roles/service` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:26.340897 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69796b0d-e08f-4c00-842b-fd30dca64aff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:26.347724 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-69796b0d-e08f-4c00-842b-fd30dca64aff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:39:26.353956 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 333/666] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Mar 8 13:39:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:26.353956 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69796b0d-e08f-4c00-842b-fd30dca64aff None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:26.406660 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18a2f8-0f5a-4ecd-8e38-ec8cde89dcee None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:26.439371 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41842f6-c81b-4332-8121-82efdf3e54fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:26.439994 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41842f6-c81b-4332-8121-82efdf3e54fa None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:26.440231 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41842f6-c81b-4332-8121-82efdf3e54fa None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:26.440494 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41842f6-c81b-4332-8121-82efdf3e54fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:26.447775 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69796b0d-e08f-4c00-842b-fd30dca64aff None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:26.485043 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7537212-6f6d-4b5e-aff9-0bc5c199e2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:26.486091 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7537212-6f6d-4b5e-aff9-0bc5c199e2b6 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:26.486592 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7537212-6f6d-4b5e-aff9-0bc5c199e2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:26.487005 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7537212-6f6d-4b5e-aff9-0bc5c199e2b6 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:26.487870 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7537212-6f6d-4b5e-aff9-0bc5c199e2b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:26.488328 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7537212-6f6d-4b5e-aff9-0bc5c199e2b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:26.489913 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7537212-6f6d-4b5e-aff9-0bc5c199e2b6 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:26.505384 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 334/667] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:26.505384 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7537212-6f6d-4b5e-aff9-0bc5c199e2b6 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:26.510685 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41842f6-c81b-4332-8121-82efdf3e54fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:26.512146 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41842f6-c81b-4332-8121-82efdf3e54fa None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:26.596557 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7537212-6f6d-4b5e-aff9-0bc5c199e2b6 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:26.608567 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 334/668] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:39:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:26.608567 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41842f6-c81b-4332-8121-82efdf3e54fa None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:26.630254 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853811d6-c296-404c-83a2-3ef74eb3d2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:26.631115 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853811d6-c296-404c-83a2-3ef74eb3d2f8 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:26.631408 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853811d6-c296-404c-83a2-3ef74eb3d2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:26.631668 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853811d6-c296-404c-83a2-3ef74eb3d2f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:26.638517 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853811d6-c296-404c-83a2-3ef74eb3d2f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:26.640303 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853811d6-c296-404c-83a2-3ef74eb3d2f8 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:26.653896 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-853811d6-c296-404c-83a2-3ef74eb3d2f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:26.656306 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 335/669] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:26.657655 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853811d6-c296-404c-83a2-3ef74eb3d2f8 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:26.699059 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41842f6-c81b-4332-8121-82efdf3e54fa None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:26.730850 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7b49b-95b9-4215-9ac3-7f92db36d71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:26.731505 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7b49b-95b9-4215-9ac3-7f92db36d71d None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:26.731835 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7b49b-95b9-4215-9ac3-7f92db36d71d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:26.732105 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7b49b-95b9-4215-9ac3-7f92db36d71d None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:26.732866 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7b49b-95b9-4215-9ac3-7f92db36d71d None admin] RBAC: Adding query filter params (name=service) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:26.733160 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7b49b-95b9-4215-9ac3-7f92db36d71d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:26.734531 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7b49b-95b9-4215-9ac3-7f92db36d71d None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:26.745465 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 335/670] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Mar 8 13:39:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:26.745465 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7b49b-95b9-4215-9ac3-7f92db36d71d None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:26.756993 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853811d6-c296-404c-83a2-3ef74eb3d2f8 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:26.788333 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed810ff5-e23c-47fc-b1ea-fe4e78c24477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:26.789121 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed810ff5-e23c-47fc-b1ea-fe4e78c24477 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:26.789461 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed810ff5-e23c-47fc-b1ea-fe4e78c24477 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:26.789697 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed810ff5-e23c-47fc-b1ea-fe4e78c24477 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:26.796183 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed810ff5-e23c-47fc-b1ea-fe4e78c24477 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:26.797555 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed810ff5-e23c-47fc-b1ea-fe4e78c24477 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:26.810222 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-ed810ff5-e23c-47fc-b1ea-fe4e78c24477 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:26.816176 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 336/671] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:26.816176 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed810ff5-e23c-47fc-b1ea-fe4e78c24477 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:26.844394 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7b49b-95b9-4215-9ac3-7f92db36d71d None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:26.875596 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6697f-bbe8-4ec9-94f4-e49f9927424e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:26.876473 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6697f-bbe8-4ec9-94f4-e49f9927424e None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:26.876816 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6697f-bbe8-4ec9-94f4-e49f9927424e None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:26.877150 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6697f-bbe8-4ec9-94f4-e49f9927424e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:26.888362 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6697f-bbe8-4ec9-94f4-e49f9927424e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:26.889890 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c6697f-bbe8-4ec9-94f4-e49f9927424e None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:26.905876 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-74c6697f-bbe8-4ec9-94f4-e49f9927424e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:26.911770 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 336/672] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:26.911770 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6697f-bbe8-4ec9-94f4-e49f9927424e None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:26.912801 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed810ff5-e23c-47fc-b1ea-fe4e78c24477 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:26.949142 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72d302-582f-4cef-a7b1-6f1c23a93229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:26.949808 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72d302-582f-4cef-a7b1-6f1c23a93229 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:26.950086 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72d302-582f-4cef-a7b1-6f1c23a93229 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:26.950357 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72d302-582f-4cef-a7b1-6f1c23a93229 None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:26.951143 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72d302-582f-4cef-a7b1-6f1c23a93229 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:26.951479 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72d302-582f-4cef-a7b1-6f1c23a93229 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:26.952951 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72d302-582f-4cef-a7b1-6f1c23a93229 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:26.969933 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 337/673] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:39:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:26.970597 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72d302-582f-4cef-a7b1-6f1c23a93229 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:27.004824 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6697f-bbe8-4ec9-94f4-e49f9927424e None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:27.036896 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726563a-1eb8-4392-91df-437111273070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:27.037697 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726563a-1eb8-4392-91df-437111273070 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:27.037971 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726563a-1eb8-4392-91df-437111273070 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:27.038237 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726563a-1eb8-4392-91df-437111273070 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:27.048497 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726563a-1eb8-4392-91df-437111273070 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:27.050025 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d726563a-1eb8-4392-91df-437111273070 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:27.065950 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-d726563a-1eb8-4392-91df-437111273070 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:27.067107 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 337/674] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:27.069310 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72d302-582f-4cef-a7b1-6f1c23a93229 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:27.072264 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726563a-1eb8-4392-91df-437111273070 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:27.102913 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a28e0-038a-4414-9c4c-a4937c46d588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:27.103550 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a28e0-038a-4414-9c4c-a4937c46d588 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:27.103823 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a28e0-038a-4414-9c4c-a4937c46d588 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:27.104093 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a28e0-038a-4414-9c4c-a4937c46d588 None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:27.104901 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a28e0-038a-4414-9c4c-a4937c46d588 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:27.105189 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a28e0-038a-4414-9c4c-a4937c46d588 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:27.106659 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a28e0-038a-4414-9c4c-a4937c46d588 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:27.118442 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 338/675] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:39:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:27.119237 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a28e0-038a-4414-9c4c-a4937c46d588 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:27.184602 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726563a-1eb8-4392-91df-437111273070 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:27.216780 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ab06e-a161-4555-a35c-0f6b84546ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:27.217011 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a28e0-038a-4414-9c4c-a4937c46d588 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:27.217393 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ab06e-a161-4555-a35c-0f6b84546ee4 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:27.217678 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ab06e-a161-4555-a35c-0f6b84546ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:27.217954 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ab06e-a161-4555-a35c-0f6b84546ee4 None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:27.218677 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ab06e-a161-4555-a35c-0f6b84546ee4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:27.218985 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ab06e-a161-4555-a35c-0f6b84546ee4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:27.220349 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ab06e-a161-4555-a35c-0f6b84546ee4 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:27.236198 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 338/676] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:27.236198 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ab06e-a161-4555-a35c-0f6b84546ee4 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:27.255503 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcaf02-451b-4723-b125-d3ffe198b633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:27.256159 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcaf02-451b-4723-b125-d3ffe198b633 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:27.256440 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcaf02-451b-4723-b125-d3ffe198b633 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:27.256713 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcaf02-451b-4723-b125-d3ffe198b633 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:27.257563 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcaf02-451b-4723-b125-d3ffe198b633 None admin] RBAC: Adding query filter params (role.id=5189c0e028ff42908ca943fdb5ce1873, scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e, user.id=56ddb15832b048f5a19d7d3887e088b3) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:27.257872 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcaf02-451b-4723-b125-d3ffe198b633 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:27.259301 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcaf02-451b-4723-b125-d3ffe198b633 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:27.265441 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 339/677] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:39:27 2022] GET /identity/v3/role_assignments?user.id=56ddb15832b048f5a19d7d3887e088b3&scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e&role.id=5189c0e028ff42908ca943fdb5ce1873 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:27.266238 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcaf02-451b-4723-b125-d3ffe198b633 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:27.353021 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ab06e-a161-4555-a35c-0f6b84546ee4 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:27.373644 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcaf02-451b-4723-b125-d3ffe198b633 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:27.399330 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010d738-9723-44f4-bcc4-289d3a318496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:27.400638 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010d738-9723-44f4-bcc4-289d3a318496 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:27.401106 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010d738-9723-44f4-bcc4-289d3a318496 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:27.401715 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010d738-9723-44f4-bcc4-289d3a318496 None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:27.403259 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010d738-9723-44f4-bcc4-289d3a318496 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:27.403798 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010d738-9723-44f4-bcc4-289d3a318496 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:27.406239 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010d738-9723-44f4-bcc4-289d3a318496 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:27.410074 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227dab54-c7fb-46fd-ba65-57f0ce1b0976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:27.410790 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dab54-c7fb-46fd-ba65-57f0ce1b0976 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:27.411067 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dab54-c7fb-46fd-ba65-57f0ce1b0976 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:27.411342 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dab54-c7fb-46fd-ba65-57f0ce1b0976 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:27.412235 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227dab54-c7fb-46fd-ba65-57f0ce1b0976 None admin] RBAC: Adding query filter params (role.id=5189c0e028ff42908ca943fdb5ce1873, scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e, user.id=731b8e066deb49e6b48804cbbe5cd6e9) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:27.412549 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227dab54-c7fb-46fd-ba65-57f0ce1b0976 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:27.414135 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227dab54-c7fb-46fd-ba65-57f0ce1b0976 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:27.426780 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 339/679] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:27.426965 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 340/679] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:39:27 2022] GET /identity/v3/role_assignments?user.id=731b8e066deb49e6b48804cbbe5cd6e9&scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e&role.id=5189c0e028ff42908ca943fdb5ce1873 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:27.427851 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227dab54-c7fb-46fd-ba65-57f0ce1b0976 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:27.428372 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010d738-9723-44f4-bcc4-289d3a318496 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:27.560123 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010d738-9723-44f4-bcc4-289d3a318496 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:27.560857 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227dab54-c7fb-46fd-ba65-57f0ce1b0976 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:27.596010 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a81721-acc8-4ba3-b4ab-038f3110d329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:27.597040 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf0b7e-a327-4cfb-bf1e-3bfa05c8004a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:27.597438 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a81721-acc8-4ba3-b4ab-038f3110d329 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:27.597987 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf0b7e-a327-4cfb-bf1e-3bfa05c8004a None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:27.598324 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf0b7e-a327-4cfb-bf1e-3bfa05c8004a None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:27.598651 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf0b7e-a327-4cfb-bf1e-3bfa05c8004a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:27.599706 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a81721-acc8-4ba3-b4ab-038f3110d329 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:27.600170 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a81721-acc8-4ba3-b4ab-038f3110d329 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:27.606682 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf0b7e-a327-4cfb-bf1e-3bfa05c8004a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:27.608443 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf0b7e-a327-4cfb-bf1e-3bfa05c8004a None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:27.609619 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a81721-acc8-4ba3-b4ab-038f3110d329 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:27.611264 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a81721-acc8-4ba3-b4ab-038f3110d329 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:27.622813 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-1ddf0b7e-a327-4cfb-bf1e-3bfa05c8004a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:27.624516 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 341/680] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:27.630675 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-f2a81721-acc8-4ba3-b4ab-038f3110d329 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 13:39:27.631251 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 340/681] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:39:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:27.632396 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf0b7e-a327-4cfb-bf1e-3bfa05c8004a None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:27.639828 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a81721-acc8-4ba3-b4ab-038f3110d329 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:27.748543 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a81721-acc8-4ba3-b4ab-038f3110d329 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:27.759535 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf0b7e-a327-4cfb-bf1e-3bfa05c8004a None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:27.781277 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90816555-8deb-4dfd-afca-e45cb1536b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:27.782367 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90816555-8deb-4dfd-afca-e45cb1536b9f None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:27.782649 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90816555-8deb-4dfd-afca-e45cb1536b9f None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:27.782920 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90816555-8deb-4dfd-afca-e45cb1536b9f None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:27.783756 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90816555-8deb-4dfd-afca-e45cb1536b9f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:27.784058 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90816555-8deb-4dfd-afca-e45cb1536b9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:27.785504 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90816555-8deb-4dfd-afca-e45cb1536b9f None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:27.798995 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c40c9-1477-4f5d-9159-b97d9a563a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:27.800010 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c40c9-1477-4f5d-9159-b97d9a563a4c None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:27.800492 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c40c9-1477-4f5d-9159-b97d9a563a4c None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:27.800949 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c40c9-1477-4f5d-9159-b97d9a563a4c None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:27.802012 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c40c9-1477-4f5d-9159-b97d9a563a4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:27.802529 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c40c9-1477-4f5d-9159-b97d9a563a4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:27.804463 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c40c9-1477-4f5d-9159-b97d9a563a4c None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:27.816882 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 341/682] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Mar 8 13:39:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:27.817862 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90816555-8deb-4dfd-afca-e45cb1536b9f None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:27.826554 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 342/683] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:39:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:27.833375 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c40c9-1477-4f5d-9159-b97d9a563a4c None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:27.917257 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90816555-8deb-4dfd-afca-e45cb1536b9f None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:27.951743 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c40c9-1477-4f5d-9159-b97d9a563a4c None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:27.952745 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d7e79-225e-45d4-9995-f03f3a2a268e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:27.953598 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d7e79-225e-45d4-9995-f03f3a2a268e None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:27.954727 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d7e79-225e-45d4-9995-f03f3a2a268e None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:27.954984 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d7e79-225e-45d4-9995-f03f3a2a268e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:27.987228 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e84b18-d1ef-4ffb-b0d9-547d8f7b05c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:27.987923 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e84b18-d1ef-4ffb-b0d9-547d8f7b05c4 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:27.988200 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e84b18-d1ef-4ffb-b0d9-547d8f7b05c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:27.988466 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e84b18-d1ef-4ffb-b0d9-547d8f7b05c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:27.989432 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e84b18-d1ef-4ffb-b0d9-547d8f7b05c4 None admin] RBAC: Adding query filter params (role.id=5189c0e028ff42908ca943fdb5ce1873, scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e, user.id=4c610d719b3049f98b95cc8e9bd56834) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:27.989796 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e84b18-d1ef-4ffb-b0d9-547d8f7b05c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:27.991220 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e84b18-d1ef-4ffb-b0d9-547d8f7b05c4 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:27.997424 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 343/684] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:39:27 2022] GET /identity/v3/role_assignments?user.id=4c610d719b3049f98b95cc8e9bd56834&scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e&role.id=5189c0e028ff42908ca943fdb5ce1873 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:27.998865 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c587f-d4ea-4516-9363-b2ebdb1d44bf None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:27.999155 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c587f-d4ea-4516-9363-b2ebdb1d44bf None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:27.999429 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c587f-d4ea-4516-9363-b2ebdb1d44bf None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:28.001404 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 344/685] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:28.007071 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741dd47-06a4-4016-b8a4-bf06cd10c5f3 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:28.007489 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741dd47-06a4-4016-b8a4-bf06cd10c5f3 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:28.007859 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741dd47-06a4-4016-b8a4-bf06cd10c5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:28.026988 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-f741dd47-06a4-4016-b8a4-bf06cd10c5f3 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:28.028309 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-f741dd47-06a4-4016-b8a4-bf06cd10c5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:28.040407 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d7e79-225e-45d4-9995-f03f3a2a268e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:28.042565 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d7e79-225e-45d4-9995-f03f3a2a268e None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:28.127765 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 345/686] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:28.178435 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741dd47-06a4-4016-b8a4-bf06cd10c5f3 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:28.188007 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 342/687] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:39:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 13:39:28.193564 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d7e79-225e-45d4-9995-f03f3a2a268e None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:28.334308 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741dd47-06a4-4016-b8a4-bf06cd10c5f3 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:28.347008 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d7e79-225e-45d4-9995-f03f3a2a268e None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:28.376960 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d046dff-9cd4-4272-8416-71575fa99649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:28.378535 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d046dff-9cd4-4272-8416-71575fa99649 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:28.379018 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d046dff-9cd4-4272-8416-71575fa99649 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:28.379513 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d046dff-9cd4-4272-8416-71575fa99649 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:28.388091 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5a5eb-6606-48df-a3d7-ee328e78b113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:28.388921 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5a5eb-6606-48df-a3d7-ee328e78b113 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:28.389198 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5a5eb-6606-48df-a3d7-ee328e78b113 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:28.389515 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5a5eb-6606-48df-a3d7-ee328e78b113 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:28.391211 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d046dff-9cd4-4272-8416-71575fa99649 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:28.399147 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-5d046dff-9cd4-4272-8416-71575fa99649 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:39:28.400098 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5a5eb-6606-48df-a3d7-ee328e78b113 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:28.401158 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 346/688] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:39:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:28.401640 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5a5eb-6606-48df-a3d7-ee328e78b113 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:28.411910 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d046dff-9cd4-4272-8416-71575fa99649 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:28.420108 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-28f5a5eb-6606-48df-a3d7-ee328e78b113 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:28.421937 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 343/689] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:28.427159 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5a5eb-6606-48df-a3d7-ee328e78b113 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:28.515203 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d046dff-9cd4-4272-8416-71575fa99649 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:28.548515 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cad8c8-2b72-4df3-851a-b2ec22deac70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:28.549207 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cad8c8-2b72-4df3-851a-b2ec22deac70 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:28.549514 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cad8c8-2b72-4df3-851a-b2ec22deac70 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:28.549782 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cad8c8-2b72-4df3-851a-b2ec22deac70 None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:28.550533 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cad8c8-2b72-4df3-851a-b2ec22deac70 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:28.552638 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cad8c8-2b72-4df3-851a-b2ec22deac70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:28.552638 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cad8c8-2b72-4df3-851a-b2ec22deac70 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:28.561000 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 347/690] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:39:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:28.567160 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cad8c8-2b72-4df3-851a-b2ec22deac70 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:28.571416 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5a5eb-6606-48df-a3d7-ee328e78b113 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:28.647116 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc249eb9-1f90-4ffd-95da-65d7b05abaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:28.647709 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc249eb9-1f90-4ffd-95da-65d7b05abaf2 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:28.647990 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc249eb9-1f90-4ffd-95da-65d7b05abaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:28.648262 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc249eb9-1f90-4ffd-95da-65d7b05abaf2 None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:28.648996 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc249eb9-1f90-4ffd-95da-65d7b05abaf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:28.649300 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc249eb9-1f90-4ffd-95da-65d7b05abaf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:28.650706 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc249eb9-1f90-4ffd-95da-65d7b05abaf2 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:28.673107 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cad8c8-2b72-4df3-851a-b2ec22deac70 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:28.680062 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 344/691] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:28.685723 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc249eb9-1f90-4ffd-95da-65d7b05abaf2 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:28.720933 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35a29d-bb3a-4b39-ab92-56fce7151b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:28.721801 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35a29d-bb3a-4b39-ab92-56fce7151b60 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:28.722084 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35a29d-bb3a-4b39-ab92-56fce7151b60 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:28.722356 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35a29d-bb3a-4b39-ab92-56fce7151b60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:28.746176 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35a29d-bb3a-4b39-ab92-56fce7151b60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:28.749318 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35a29d-bb3a-4b39-ab92-56fce7151b60 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:28.796754 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-0f35a29d-bb3a-4b39-ab92-56fce7151b60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:28.798023 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 348/692] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:39:28.804217 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35a29d-bb3a-4b39-ab92-56fce7151b60 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:28.860456 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc249eb9-1f90-4ffd-95da-65d7b05abaf2 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:28.903590 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c1e29-3b61-4e35-b856-ce727cd56e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:28.904382 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c1e29-3b61-4e35-b856-ce727cd56e25 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:28.904695 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c1e29-3b61-4e35-b856-ce727cd56e25 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:28.904972 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c1e29-3b61-4e35-b856-ce727cd56e25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:28.917435 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c1e29-3b61-4e35-b856-ce727cd56e25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:28.919996 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c1e29-3b61-4e35-b856-ce727cd56e25 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:28.946196 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-d91c1e29-3b61-4e35-b856-ce727cd56e25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:28.956137 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 345/693] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:39:28.961800 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c1e29-3b61-4e35-b856-ce727cd56e25 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:29.007172 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35a29d-bb3a-4b39-ab92-56fce7151b60 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:29.051201 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee649c-a9ed-4339-bd54-9150369ec73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:29.051865 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee649c-a9ed-4339-bd54-9150369ec73a None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:29.052165 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee649c-a9ed-4339-bd54-9150369ec73a None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:29.052437 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee649c-a9ed-4339-bd54-9150369ec73a None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:29.053160 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee649c-a9ed-4339-bd54-9150369ec73a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:29.054639 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee649c-a9ed-4339-bd54-9150369ec73a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:29.058321 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee649c-a9ed-4339-bd54-9150369ec73a None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:29.081692 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 349/694] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:29.088971 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee649c-a9ed-4339-bd54-9150369ec73a None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:29.171715 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c1e29-3b61-4e35-b856-ce727cd56e25 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:29.214492 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee649c-a9ed-4339-bd54-9150369ec73a None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:29.251921 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0d30c-6e84-40dc-981b-3f6b1b455762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:29.252769 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0d30c-6e84-40dc-981b-3f6b1b455762 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:29.253043 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0d30c-6e84-40dc-981b-3f6b1b455762 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:29.253312 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0d30c-6e84-40dc-981b-3f6b1b455762 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:29.256465 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82f86d-19ed-4ea0-ba03-a5f8a3121940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:29.257121 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82f86d-19ed-4ea0-ba03-a5f8a3121940 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:29.257428 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82f86d-19ed-4ea0-ba03-a5f8a3121940 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:29.257700 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82f86d-19ed-4ea0-ba03-a5f8a3121940 None admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:29.258496 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82f86d-19ed-4ea0-ba03-a5f8a3121940 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:29.258804 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82f86d-19ed-4ea0-ba03-a5f8a3121940 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:29.260235 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82f86d-19ed-4ea0-ba03-a5f8a3121940 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:29.273086 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 346/695] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:39:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:29.274277 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0d30c-6e84-40dc-981b-3f6b1b455762 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:29.275736 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0d30c-6e84-40dc-981b-3f6b1b455762 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:29.279892 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82f86d-19ed-4ea0-ba03-a5f8a3121940 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:29.301310 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-06c0d30c-6e84-40dc-981b-3f6b1b455762 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 13:39:29.306619 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 350/696] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Mar 8 13:39:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:29.310212 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0d30c-6e84-40dc-981b-3f6b1b455762 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:29.405709 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82f86d-19ed-4ea0-ba03-a5f8a3121940 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:29.464519 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e71ab-536c-474e-8c4d-27bc6d2c5e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:29.465401 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e71ab-536c-474e-8c4d-27bc6d2c5e31 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:29.465688 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e71ab-536c-474e-8c4d-27bc6d2c5e31 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:29.465959 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e71ab-536c-474e-8c4d-27bc6d2c5e31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:29.469276 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e71ab-536c-474e-8c4d-27bc6d2c5e31 None admin] RBAC: Adding query filter params (role.id=5189c0e028ff42908ca943fdb5ce1873, scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e, user.id=5a0f442666d0459aa9a34fc2f91228e9) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:29.469276 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e71ab-536c-474e-8c4d-27bc6d2c5e31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:29.469276 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e71ab-536c-474e-8c4d-27bc6d2c5e31 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:29.476622 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 347/697] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:39:29 2022] GET /identity/v3/role_assignments?user.id=5a0f442666d0459aa9a34fc2f91228e9&scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e&role.id=5189c0e028ff42908ca943fdb5ce1873 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:29.517508 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0d30c-6e84-40dc-981b-3f6b1b455762 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:29.581164 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620103ad-5c66-41e2-bae7-851f95ebd9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:29.581884 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620103ad-5c66-41e2-bae7-851f95ebd9dd None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:29.582301 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620103ad-5c66-41e2-bae7-851f95ebd9dd None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:29.582583 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620103ad-5c66-41e2-bae7-851f95ebd9dd None admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:29.583534 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620103ad-5c66-41e2-bae7-851f95ebd9dd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:29.583846 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620103ad-5c66-41e2-bae7-851f95ebd9dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:29.585368 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620103ad-5c66-41e2-bae7-851f95ebd9dd None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:29.616580 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 351/698] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Mar 8 13:39:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:29.621822 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e71ab-536c-474e-8c4d-27bc6d2c5e31 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:29.738548 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e71ab-536c-474e-8c4d-27bc6d2c5e31 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:29.772986 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2be66d-c1c4-474f-9511-bae82401f4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:29.773661 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2be66d-c1c4-474f-9511-bae82401f4b3 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:29.773939 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2be66d-c1c4-474f-9511-bae82401f4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:29.774206 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2be66d-c1c4-474f-9511-bae82401f4b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:29.840899 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2be66d-c1c4-474f-9511-bae82401f4b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:29.842454 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2be66d-c1c4-474f-9511-bae82401f4b3 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:29.941847 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 348/699] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:39:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Mar 08 13:39:29.947496 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620103ad-5c66-41e2-bae7-851f95ebd9dd None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:30.008652 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dbdc6-62a7-4593-a1c8-f19d209e148a None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:30.008855 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dbdc6-62a7-4593-a1c8-f19d209e148a None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:30.009121 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3dbdc6-62a7-4593-a1c8-f19d209e148a None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:30.011179 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 349/700] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:39:30.017384 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92453ed-df6a-4c87-8b5b-cdb747b50cfc None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:30.017384 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92453ed-df6a-4c87-8b5b-cdb747b50cfc None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:30.017761 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92453ed-df6a-4c87-8b5b-cdb747b50cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:30.035005 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-b92453ed-df6a-4c87-8b5b-cdb747b50cfc None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:30.036510 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-b92453ed-df6a-4c87-8b5b-cdb747b50cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:30.074607 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620103ad-5c66-41e2-bae7-851f95ebd9dd None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:30.113748 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 350/701] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Mar 08 13:39:30.124743 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d032f4a-054c-4a09-81e2-1841d55282c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:30.125666 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d032f4a-054c-4a09-81e2-1841d55282c1 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:30.125927 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d032f4a-054c-4a09-81e2-1841d55282c1 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:30.126248 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d032f4a-054c-4a09-81e2-1841d55282c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:30.137209 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92453ed-df6a-4c87-8b5b-cdb747b50cfc None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:30.143898 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d032f4a-054c-4a09-81e2-1841d55282c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:30.145389 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d032f4a-054c-4a09-81e2-1841d55282c1 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:30.171485 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-8d032f4a-054c-4a09-81e2-1841d55282c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:30.179137 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 352/702] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:30.184339 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d032f4a-054c-4a09-81e2-1841d55282c1 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:30.235415 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92453ed-df6a-4c87-8b5b-cdb747b50cfc None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:30.302050 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8eaa8-853f-4e2d-a883-d9a3e39c81e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:30.303246 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8eaa8-853f-4e2d-a883-d9a3e39c81e8 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:30.303738 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8eaa8-853f-4e2d-a883-d9a3e39c81e8 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:30.304190 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8eaa8-853f-4e2d-a883-d9a3e39c81e8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:30.305047 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8eaa8-853f-4e2d-a883-d9a3e39c81e8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:30.306644 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8eaa8-853f-4e2d-a883-d9a3e39c81e8 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:30.319965 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-a4e8eaa8-853f-4e2d-a883-d9a3e39c81e8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 08 13:39:30.321752 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 351/703] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Mar 8 13:39:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:30.327774 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a33eb-1f71-463f-9f67-0df70bad857c None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:30.328328 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a33eb-1f71-463f-9f67-0df70bad857c None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:30.328794 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a33eb-1f71-463f-9f67-0df70bad857c None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:30.330944 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 352/704] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:30.331402 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d032f4a-054c-4a09-81e2-1841d55282c1 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:30.332045 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a33eb-1f71-463f-9f67-0df70bad857c None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:30.369562 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15766582-8ff5-4de7-94b6-051a5f9bdc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:30.370270 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15766582-8ff5-4de7-94b6-051a5f9bdc22 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:30.370551 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15766582-8ff5-4de7-94b6-051a5f9bdc22 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:30.370820 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15766582-8ff5-4de7-94b6-051a5f9bdc22 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:30.371543 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15766582-8ff5-4de7-94b6-051a5f9bdc22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:30.371845 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15766582-8ff5-4de7-94b6-051a5f9bdc22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:30.373310 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15766582-8ff5-4de7-94b6-051a5f9bdc22 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:30.385207 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 353/705] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:30.386623 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39795547-5b85-4968-b192-b23847bb2d4e None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:30.386908 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39795547-5b85-4968-b192-b23847bb2d4e None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:30.387182 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39795547-5b85-4968-b192-b23847bb2d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:30.404095 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-39795547-5b85-4968-b192-b23847bb2d4e None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:30.405663 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-39795547-5b85-4968-b192-b23847bb2d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:30.436763 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a33eb-1f71-463f-9f67-0df70bad857c None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:30.475387 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcd466-0e4e-488c-95ed-c3070513695f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:30.476904 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcd466-0e4e-488c-95ed-c3070513695f None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:30.477374 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcd466-0e4e-488c-95ed-c3070513695f None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:30.477813 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcd466-0e4e-488c-95ed-c3070513695f None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:30.478690 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbcd466-0e4e-488c-95ed-c3070513695f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:30.479153 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbcd466-0e4e-488c-95ed-c3070513695f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:30.480695 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbcd466-0e4e-488c-95ed-c3070513695f None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:30.485459 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 354/706] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:30.486730 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39795547-5b85-4968-b192-b23847bb2d4e None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:30.492953 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 353/707] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Mar 8 13:39:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:30.507374 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcd466-0e4e-488c-95ed-c3070513695f None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:30.594191 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39795547-5b85-4968-b192-b23847bb2d4e None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:30.606049 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcd466-0e4e-488c-95ed-c3070513695f None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:30.629308 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ffa2b-7d6f-4e03-81ec-2d0b1fe5d10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:30.630956 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ffa2b-7d6f-4e03-81ec-2d0b1fe5d10f None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:30.631744 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ffa2b-7d6f-4e03-81ec-2d0b1fe5d10f None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:30.632235 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ffa2b-7d6f-4e03-81ec-2d0b1fe5d10f None admin] PATH_INFO: `/v3/projects/service` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:30.640995 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ffa2b-7d6f-4e03-81ec-2d0b1fe5d10f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:30.641233 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d8587-ba6d-4856-9ae8-15e0a25f6e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:30.642154 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d8587-ba6d-4856-9ae8-15e0a25f6e77 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:30.642438 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d8587-ba6d-4856-9ae8-15e0a25f6e77 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:30.642709 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98d8587-ba6d-4856-9ae8-15e0a25f6e77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:30.643937 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ffa2b-7d6f-4e03-81ec-2d0b1fe5d10f None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:30.653688 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d8587-ba6d-4856-9ae8-15e0a25f6e77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:30.655328 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98d8587-ba6d-4856-9ae8-15e0a25f6e77 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:30.660279 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-234ffa2b-7d6f-4e03-81ec-2d0b1fe5d10f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:30.662375 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 355/708] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:30.663390 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ffa2b-7d6f-4e03-81ec-2d0b1fe5d10f None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:30.672515 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-d98d8587-ba6d-4856-9ae8-15e0a25f6e77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:30.677501 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 354/709] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:39:30.678419 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d8587-ba6d-4856-9ae8-15e0a25f6e77 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:30.772161 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ffa2b-7d6f-4e03-81ec-2d0b1fe5d10f None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:30.799874 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98d8587-ba6d-4856-9ae8-15e0a25f6e77 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:30.809047 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c621be-1441-4d72-a5f6-db8058647851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:30.810026 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c621be-1441-4d72-a5f6-db8058647851 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:30.810976 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c621be-1441-4d72-a5f6-db8058647851 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:30.811423 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c621be-1441-4d72-a5f6-db8058647851 None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:30.812607 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c621be-1441-4d72-a5f6-db8058647851 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:30.813347 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c621be-1441-4d72-a5f6-db8058647851 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:30.815068 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c621be-1441-4d72-a5f6-db8058647851 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:30.823112 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 356/710] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Mar 8 13:39:30 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:30.824150 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c621be-1441-4d72-a5f6-db8058647851 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:30.848978 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd37a3d-7c12-4f9d-880e-7d8af90bc43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:30.850670 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd37a3d-7c12-4f9d-880e-7d8af90bc43d None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:30.850964 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd37a3d-7c12-4f9d-880e-7d8af90bc43d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:30.851240 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd37a3d-7c12-4f9d-880e-7d8af90bc43d None admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:30.852285 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd37a3d-7c12-4f9d-880e-7d8af90bc43d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:30.852592 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd37a3d-7c12-4f9d-880e-7d8af90bc43d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:30.855769 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd37a3d-7c12-4f9d-880e-7d8af90bc43d None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:30.872582 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 355/711] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:39:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:30.874159 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ac7c8-8899-4f2c-a941-5f3f5799e814 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:30.874446 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ac7c8-8899-4f2c-a941-5f3f5799e814 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:30.874718 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ac7c8-8899-4f2c-a941-5f3f5799e814 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:30.880702 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 356/712] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:30.881646 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ac7c8-8899-4f2c-a941-5f3f5799e814 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:30.946798 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c621be-1441-4d72-a5f6-db8058647851 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:30.981442 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8a514-ff40-42ea-b481-f1319218201e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:30.982172 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8a514-ff40-42ea-b481-f1319218201e None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:30.982647 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8a514-ff40-42ea-b481-f1319218201e None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:30.982928 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8a514-ff40-42ea-b481-f1319218201e None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:30.983714 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8a514-ff40-42ea-b481-f1319218201e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:30.984023 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8a514-ff40-42ea-b481-f1319218201e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:30.985464 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8a514-ff40-42ea-b481-f1319218201e None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:31.002189 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 357/713] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:31.003665 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788ccee-45c7-43bc-9dd4-d8287ef9d743 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:31.003949 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788ccee-45c7-43bc-9dd4-d8287ef9d743 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:31.004218 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788ccee-45c7-43bc-9dd4-d8287ef9d743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:31.016960 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ac7c8-8899-4f2c-a941-5f3f5799e814 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:31.025280 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-d788ccee-45c7-43bc-9dd4-d8287ef9d743 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:31.026562 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-d788ccee-45c7-43bc-9dd4-d8287ef9d743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:31.058596 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b19e13-bb0d-47fd-b482-e8c234ba9b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:31.059246 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b19e13-bb0d-47fd-b482-e8c234ba9b0a None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:31.059519 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b19e13-bb0d-47fd-b482-e8c234ba9b0a None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:31.059785 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b19e13-bb0d-47fd-b482-e8c234ba9b0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:31.060701 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b19e13-bb0d-47fd-b482-e8c234ba9b0a None admin] RBAC: Adding query filter params (role.id=fc021ed5870a44f5a0f0b8fff994d6f0, scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e, user.id=21ec894123044d4382995791c74c587b) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:31.060999 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b19e13-bb0d-47fd-b482-e8c234ba9b0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:31.062452 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b19e13-bb0d-47fd-b482-e8c234ba9b0a None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:31.068442 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 357/714] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:39:30 2022] GET /identity/v3/role_assignments?user.id=21ec894123044d4382995791c74c587b&scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e&role.id=fc021ed5870a44f5a0f0b8fff994d6f0 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:31.069266 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b19e13-bb0d-47fd-b482-e8c234ba9b0a None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:31.113595 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 358/715] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:31.128875 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788ccee-45c7-43bc-9dd4-d8287ef9d743 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:31.170241 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b19e13-bb0d-47fd-b482-e8c234ba9b0a None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:31.206193 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40156722-793c-4dc9-95fa-eb6b7fca8c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:31.206878 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40156722-793c-4dc9-95fa-eb6b7fca8c16 None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:31.207164 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40156722-793c-4dc9-95fa-eb6b7fca8c16 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:31.207442 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40156722-793c-4dc9-95fa-eb6b7fca8c16 None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:31.208664 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40156722-793c-4dc9-95fa-eb6b7fca8c16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:31.209704 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40156722-793c-4dc9-95fa-eb6b7fca8c16 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:31.238937 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788ccee-45c7-43bc-9dd4-d8287ef9d743 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:31.243976 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 358/716] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Mar 8 13:39:31 2022] POST /identity/v3/users => generated 254 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:39:31.283660 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ff863-6ff4-4c23-827f-f4ef4b581063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:31.285578 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ff863-6ff4-4c23-827f-f4ef4b581063 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:31.286130 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ff863-6ff4-4c23-827f-f4ef4b581063 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:31.286596 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ff863-6ff4-4c23-827f-f4ef4b581063 None admin] PATH_INFO: `/v3/services/network` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:31.287499 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ff863-6ff4-4c23-827f-f4ef4b581063 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:31.289411 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ff863-6ff4-4c23-827f-f4ef4b581063 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:31.315769 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-031ff863-6ff4-4c23-827f-f4ef4b581063 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 08 13:39:31.317431 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 359/717] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:31 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:39:31.325011 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40156722-793c-4dc9-95fa-eb6b7fca8c16 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:31.480761 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40156722-793c-4dc9-95fa-eb6b7fca8c16 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:31.521556 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204c495-4941-41ab-8552-c2aba55cdb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:31.522223 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204c495-4941-41ab-8552-c2aba55cdb46 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:31.522503 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204c495-4941-41ab-8552-c2aba55cdb46 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:31.522763 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204c495-4941-41ab-8552-c2aba55cdb46 None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:31.523465 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204c495-4941-41ab-8552-c2aba55cdb46 None admin] RBAC: Adding query filter params (name=network) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:31.523764 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204c495-4941-41ab-8552-c2aba55cdb46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:31.525118 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204c495-4941-41ab-8552-c2aba55cdb46 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:31.529878 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 359/718] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Mar 8 13:39:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:31.535888 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ff863-6ff4-4c23-827f-f4ef4b581063 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:31.652127 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ff863-6ff4-4c23-827f-f4ef4b581063 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:31.685386 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4ade3-bcad-45f1-9e18-3212bfc68a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:31.686056 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4ade3-bcad-45f1-9e18-3212bfc68a7c None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:31.686359 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4ade3-bcad-45f1-9e18-3212bfc68a7c None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:31.686644 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4ade3-bcad-45f1-9e18-3212bfc68a7c None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:31.687372 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4ade3-bcad-45f1-9e18-3212bfc68a7c None admin] RBAC: Adding query filter params (type=network) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:31.687675 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4ade3-bcad-45f1-9e18-3212bfc68a7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:31.689063 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4ade3-bcad-45f1-9e18-3212bfc68a7c None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:31.694175 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 360/719] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Mar 8 13:39:31 2022] GET /identity/v3/services?type=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:32.575226 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea96a9e-a08c-4ad0-997b-1057799d4b8f None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:32.576056 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea96a9e-a08c-4ad0-997b-1057799d4b8f None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:32.576056 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea96a9e-a08c-4ad0-997b-1057799d4b8f None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:32.577791 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 360/720] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:32.587094 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b287f-6a8a-4c8d-af45-050f2faeee72 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:32.587386 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b287f-6a8a-4c8d-af45-050f2faeee72 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:32.587658 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b287f-6a8a-4c8d-af45-050f2faeee72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:32.608629 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-762b287f-6a8a-4c8d-af45-050f2faeee72 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:32.609900 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-762b287f-6a8a-4c8d-af45-050f2faeee72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:32.703789 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 361/721] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:32.751508 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea96a9e-a08c-4ad0-997b-1057799d4b8f None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:32.934062 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea96a9e-a08c-4ad0-997b-1057799d4b8f None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:32.975373 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80ae9c-552d-4a5a-af4a-4d9a027cf8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:32.977137 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80ae9c-552d-4a5a-af4a-4d9a027cf8b4 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:32.977840 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80ae9c-552d-4a5a-af4a-4d9a027cf8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:32.978402 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80ae9c-552d-4a5a-af4a-4d9a027cf8b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:33.006261 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d80ae9c-552d-4a5a-af4a-4d9a027cf8b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:33.013258 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-4d80ae9c-552d-4a5a-af4a-4d9a027cf8b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:39:33.018952 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 361/722] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:39:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:33.025124 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b287f-6a8a-4c8d-af45-050f2faeee72 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:33.257128 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b287f-6a8a-4c8d-af45-050f2faeee72 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:33.323286 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72101819-0af8-4ac3-a3ee-e529b5bd5520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:33.323968 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72101819-0af8-4ac3-a3ee-e529b5bd5520 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:33.324245 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72101819-0af8-4ac3-a3ee-e529b5bd5520 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:33.324515 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72101819-0af8-4ac3-a3ee-e529b5bd5520 None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:33.325267 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72101819-0af8-4ac3-a3ee-e529b5bd5520 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:33.325630 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72101819-0af8-4ac3-a3ee-e529b5bd5520 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:33.327049 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72101819-0af8-4ac3-a3ee-e529b5bd5520 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:33.342340 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 362/723] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:39:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:33.347585 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80ae9c-552d-4a5a-af4a-4d9a027cf8b4 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:33.482539 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80ae9c-552d-4a5a-af4a-4d9a027cf8b4 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:33.520836 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7ae7c-5dc2-4b3e-92cd-981f75b01489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:33.521594 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7ae7c-5dc2-4b3e-92cd-981f75b01489 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:33.521874 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7ae7c-5dc2-4b3e-92cd-981f75b01489 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:33.522144 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7ae7c-5dc2-4b3e-92cd-981f75b01489 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:33.525915 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c57628-a99f-46a9-b801-16fad85b86fe None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:33.526207 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c57628-a99f-46a9-b801-16fad85b86fe None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:33.526484 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c57628-a99f-46a9-b801-16fad85b86fe None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:33.528501 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 363/724] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:33.533652 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db33656-99da-4674-b92d-b9343a3daeac None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:33.533891 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7ae7c-5dc2-4b3e-92cd-981f75b01489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:33.533987 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db33656-99da-4674-b92d-b9343a3daeac None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:33.534202 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db33656-99da-4674-b92d-b9343a3daeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:33.535260 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7ae7c-5dc2-4b3e-92cd-981f75b01489 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:33.552524 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-76a7ae7c-5dc2-4b3e-92cd-981f75b01489 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:33.554078 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 362/725] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:33.559126 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7ae7c-5dc2-4b3e-92cd-981f75b01489 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:33.571143 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-1db33656-99da-4674-b92d-b9343a3daeac None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:33.574311 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-1db33656-99da-4674-b92d-b9343a3daeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:33.678826 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7ae7c-5dc2-4b3e-92cd-981f75b01489 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:33.717342 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 364/726] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:33.727777 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441b293-6628-4995-9ea8-dae68717d72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:33.728689 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441b293-6628-4995-9ea8-dae68717d72d None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:33.729133 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441b293-6628-4995-9ea8-dae68717d72d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:33.729623 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441b293-6628-4995-9ea8-dae68717d72d None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:33.730622 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441b293-6628-4995-9ea8-dae68717d72d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:33.731107 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441b293-6628-4995-9ea8-dae68717d72d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:33.732744 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441b293-6628-4995-9ea8-dae68717d72d None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:33.744981 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 363/727] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:33.749574 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db33656-99da-4674-b92d-b9343a3daeac None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:33.760962 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441b293-6628-4995-9ea8-dae68717d72d None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:33.868794 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db33656-99da-4674-b92d-b9343a3daeac None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:33.901759 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441b293-6628-4995-9ea8-dae68717d72d None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:33.930958 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032338f3-a5d0-41a8-913f-12e006f33793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:33.931952 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032338f3-a5d0-41a8-913f-12e006f33793 None admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:33.932422 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032338f3-a5d0-41a8-913f-12e006f33793 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:33.932881 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032338f3-a5d0-41a8-913f-12e006f33793 None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:33.933825 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032338f3-a5d0-41a8-913f-12e006f33793 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:33.935403 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032338f3-a5d0-41a8-913f-12e006f33793 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:33.945313 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa732c-23a7-45bd-94ee-affe02146fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:33.946689 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa732c-23a7-45bd-94ee-affe02146fca None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:33.947165 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa732c-23a7-45bd-94ee-affe02146fca None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:33.947643 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa732c-23a7-45bd-94ee-affe02146fca None admin] PATH_INFO: `/v3/users/swift` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:33.957284 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 365/728] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Mar 8 13:39:33 2022] POST /identity/v3/services => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:39:33.970655 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa732c-23a7-45bd-94ee-affe02146fca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:33.972569 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa732c-23a7-45bd-94ee-affe02146fca None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:33.988450 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-6daa732c-23a7-45bd-94ee-affe02146fca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 13:39:33.990418 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 364/729] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:39:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:33.997530 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032338f3-a5d0-41a8-913f-12e006f33793 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:34.061597 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c041cf8-cce9-4dc0-9497-62268825b048 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:34.062266 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c041cf8-cce9-4dc0-9497-62268825b048 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:34.062732 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c041cf8-cce9-4dc0-9497-62268825b048 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:34.065257 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 365/730] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:34.071283 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2e985-84e8-4893-a9e7-8d9ac8f527f5 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:34.071891 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2e985-84e8-4893-a9e7-8d9ac8f527f5 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:34.072373 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2e985-84e8-4893-a9e7-8d9ac8f527f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:34.103300 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-90d2e985-84e8-4893-a9e7-8d9ac8f527f5 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:34.105066 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-90d2e985-84e8-4893-a9e7-8d9ac8f527f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:34.195247 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 366/731] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:34.202485 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032338f3-a5d0-41a8-913f-12e006f33793 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:34.229077 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2e985-84e8-4893-a9e7-8d9ac8f527f5 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:34.251872 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38de35-2127-42b9-950b-b8b94c04fcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:34.252549 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38de35-2127-42b9-950b-b8b94c04fcd4 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:34.252828 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38de35-2127-42b9-950b-b8b94c04fcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:34.253097 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38de35-2127-42b9-950b-b8b94c04fcd4 None admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:34.253981 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38de35-2127-42b9-950b-b8b94c04fcd4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:34.254286 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38de35-2127-42b9-950b-b8b94c04fcd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:34.255724 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38de35-2127-42b9-950b-b8b94c04fcd4 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:34.279424 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 366/732] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Mar 8 13:39:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:34.285865 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38de35-2127-42b9-950b-b8b94c04fcd4 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:34.351018 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2e985-84e8-4893-a9e7-8d9ac8f527f5 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:34.390068 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38de35-2127-42b9-950b-b8b94c04fcd4 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:34.396990 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6cf59-ac8d-4592-89d7-2cf1c4dc7ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:34.398099 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6cf59-ac8d-4592-89d7-2cf1c4dc7ca7 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:34.399112 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6cf59-ac8d-4592-89d7-2cf1c4dc7ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:34.399553 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6cf59-ac8d-4592-89d7-2cf1c4dc7ca7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:34.415146 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb6cf59-ac8d-4592-89d7-2cf1c4dc7ca7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:34.424244 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-8fb6cf59-ac8d-4592-89d7-2cf1c4dc7ca7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:39:34.426297 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 367/733] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:39:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:34.431986 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6cf59-ac8d-4592-89d7-2cf1c4dc7ca7 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:34.435527 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd23aa7-32bf-45f6-bfbc-0be18c62a336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:34.436371 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd23aa7-32bf-45f6-bfbc-0be18c62a336 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:34.439049 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd23aa7-32bf-45f6-bfbc-0be18c62a336 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:34.439485 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd23aa7-32bf-45f6-bfbc-0be18c62a336 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:34.549443 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd23aa7-32bf-45f6-bfbc-0be18c62a336 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:34.551525 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd23aa7-32bf-45f6-bfbc-0be18c62a336 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:34.561889 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6cf59-ac8d-4592-89d7-2cf1c4dc7ca7 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:34.595056 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27915e6-934c-4ae7-ad41-cf9e5b34962e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:34.595832 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27915e6-934c-4ae7-ad41-cf9e5b34962e None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:34.596175 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27915e6-934c-4ae7-ad41-cf9e5b34962e None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:34.596535 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27915e6-934c-4ae7-ad41-cf9e5b34962e None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:34.597377 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27915e6-934c-4ae7-ad41-cf9e5b34962e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:34.597775 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27915e6-934c-4ae7-ad41-cf9e5b34962e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:34.599211 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27915e6-934c-4ae7-ad41-cf9e5b34962e None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:34.608097 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 368/734] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:39:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:34.609713 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd436ebf-6d84-4f6f-8d97-43a6b315e85c None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:34.609942 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd436ebf-6d84-4f6f-8d97-43a6b315e85c None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:34.610286 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd436ebf-6d84-4f6f-8d97-43a6b315e85c None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:34.616182 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 369/735] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:34.617064 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd436ebf-6d84-4f6f-8d97-43a6b315e85c None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:34.672003 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 367/736] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:39:34 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Mar 08 13:39:34.673597 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d82795-87e5-423d-808a-6c44f49c9c06 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:34.674022 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d82795-87e5-423d-808a-6c44f49c9c06 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:34.674431 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d82795-87e5-423d-808a-6c44f49c9c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:34.693959 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-f4d82795-87e5-423d-808a-6c44f49c9c06 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:34.695313 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-f4d82795-87e5-423d-808a-6c44f49c9c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:34.723706 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd436ebf-6d84-4f6f-8d97-43a6b315e85c None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:34.757347 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24134100-a142-4ff0-90a4-9c4b06112018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:34.758192 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24134100-a142-4ff0-90a4-9c4b06112018 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:34.758475 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24134100-a142-4ff0-90a4-9c4b06112018 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:34.758760 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24134100-a142-4ff0-90a4-9c4b06112018 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:34.763723 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 368/737] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:34.769381 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d82795-87e5-423d-808a-6c44f49c9c06 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:34.773727 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24134100-a142-4ff0-90a4-9c4b06112018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:34.775972 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24134100-a142-4ff0-90a4-9c4b06112018 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:34.796725 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-24134100-a142-4ff0-90a4-9c4b06112018 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:34.801391 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 370/738] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:34.801391 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43891370-0c3e-492b-a7b4-2ff35a779316 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:34.801391 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43891370-0c3e-492b-a7b4-2ff35a779316 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:34.801391 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43891370-0c3e-492b-a7b4-2ff35a779316 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:34.801391 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 371/739] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:34.802037 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43891370-0c3e-492b-a7b4-2ff35a779316 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:34.873076 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d82795-87e5-423d-808a-6c44f49c9c06 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:34.898507 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43891370-0c3e-492b-a7b4-2ff35a779316 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:34.905190 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995235bf-d63e-4323-a3fd-3a6646365367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:34.906038 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995235bf-d63e-4323-a3fd-3a6646365367 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:34.906648 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995235bf-d63e-4323-a3fd-3a6646365367 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:34.906918 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995235bf-d63e-4323-a3fd-3a6646365367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:34.917087 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995235bf-d63e-4323-a3fd-3a6646365367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:34.918559 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995235bf-d63e-4323-a3fd-3a6646365367 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:34.935399 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0cd816-464b-45d6-82b7-e0adf78f003b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:34.935575 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-995235bf-d63e-4323-a3fd-3a6646365367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:34.936545 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cd816-464b-45d6-82b7-e0adf78f003b None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:34.936649 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 369/740] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:34.937096 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cd816-464b-45d6-82b7-e0adf78f003b None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:34.937373 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995235bf-d63e-4323-a3fd-3a6646365367 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:34.937720 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0cd816-464b-45d6-82b7-e0adf78f003b None admin] PATH_INFO: `/v3/roles/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:34.950730 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0cd816-464b-45d6-82b7-e0adf78f003b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:34.957672 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-7c0cd816-464b-45d6-82b7-e0adf78f003b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:39:34.959001 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 372/741] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Mar 8 13:39:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:34.960083 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc6bb5-fafe-4dce-920e-55ee273a982d None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:34.960373 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc6bb5-fafe-4dce-920e-55ee273a982d None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:34.960648 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc6bb5-fafe-4dce-920e-55ee273a982d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:34.977517 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-e3cc6bb5-fafe-4dce-920e-55ee273a982d None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:34.978720 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-e3cc6bb5-fafe-4dce-920e-55ee273a982d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:35.041182 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995235bf-d63e-4323-a3fd-3a6646365367 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:35.053755 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 373/742] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Mar 08 13:39:35.053755 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc6bb5-fafe-4dce-920e-55ee273a982d None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:35.077966 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6386c-d5b6-46c2-a0b9-18ab574337cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:35.078630 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6386c-d5b6-46c2-a0b9-18ab574337cc None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:35.078909 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6386c-d5b6-46c2-a0b9-18ab574337cc None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:35.079180 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6386c-d5b6-46c2-a0b9-18ab574337cc None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:35.079899 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6386c-d5b6-46c2-a0b9-18ab574337cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:35.080206 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6386c-d5b6-46c2-a0b9-18ab574337cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:35.081595 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6386c-d5b6-46c2-a0b9-18ab574337cc None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:35.093154 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 370/743] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:35.093991 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6386c-d5b6-46c2-a0b9-18ab574337cc None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:35.159206 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc6bb5-fafe-4dce-920e-55ee273a982d None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:35.191859 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8e4a9-8525-4b8c-bbaf-73e1a8dfe887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:35.192514 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8e4a9-8525-4b8c-bbaf-73e1a8dfe887 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:35.192786 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8e4a9-8525-4b8c-bbaf-73e1a8dfe887 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:35.193052 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f8e4a9-8525-4b8c-bbaf-73e1a8dfe887 None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:35.193145 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6386c-d5b6-46c2-a0b9-18ab574337cc None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:35.193797 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8e4a9-8525-4b8c-bbaf-73e1a8dfe887 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:35.194129 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8e4a9-8525-4b8c-bbaf-73e1a8dfe887 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:35.195499 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f8e4a9-8525-4b8c-bbaf-73e1a8dfe887 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:35.207031 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 374/744] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:35.207654 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8e4a9-8525-4b8c-bbaf-73e1a8dfe887 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:35.229409 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e3813-630c-4359-9995-0a67e272413a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:35.230077 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e3813-630c-4359-9995-0a67e272413a None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:35.230359 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e3813-630c-4359-9995-0a67e272413a None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:35.230630 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e3813-630c-4359-9995-0a67e272413a None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:35.231377 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e3813-630c-4359-9995-0a67e272413a None admin] RBAC: Adding query filter params (name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:35.231704 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e3813-630c-4359-9995-0a67e272413a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:35.233095 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18e3813-630c-4359-9995-0a67e272413a None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:35.240801 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 371/745] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Mar 8 13:39:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:35.241590 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e3813-630c-4359-9995-0a67e272413a None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:35.309682 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f8e4a9-8525-4b8c-bbaf-73e1a8dfe887 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:35.334968 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e3813-630c-4359-9995-0a67e272413a None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:35.342552 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a679641-e472-4637-90a1-a0c911a82608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:35.343225 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a679641-e472-4637-90a1-a0c911a82608 None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:35.343498 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a679641-e472-4637-90a1-a0c911a82608 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:35.343757 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a679641-e472-4637-90a1-a0c911a82608 None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:35.344502 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a679641-e472-4637-90a1-a0c911a82608 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:35.345931 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a679641-e472-4637-90a1-a0c911a82608 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:35.373387 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 375/746] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Mar 8 13:39:35 2022] POST /identity/v3/services => generated 240 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:39:35.373387 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a679641-e472-4637-90a1-a0c911a82608 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:35.390799 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea5c6e-17f4-4e00-af97-4c2cda464dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:35.392061 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea5c6e-17f4-4e00-af97-4c2cda464dce None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:35.392487 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea5c6e-17f4-4e00-af97-4c2cda464dce None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:35.392903 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea5c6e-17f4-4e00-af97-4c2cda464dce None admin] PATH_INFO: `/v3/users/nova` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:35.405401 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea5c6e-17f4-4e00-af97-4c2cda464dce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:35.407663 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea5c6e-17f4-4e00-af97-4c2cda464dce None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:35.425905 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-68ea5c6e-17f4-4e00-af97-4c2cda464dce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 13:39:35.427993 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 372/747] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Mar 8 13:39:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:35.428812 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea5c6e-17f4-4e00-af97-4c2cda464dce None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:35.483264 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a679641-e472-4637-90a1-a0c911a82608 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:35.522520 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33266322-2cdd-4c3e-a6bd-7260dd41ba81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:35.523615 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33266322-2cdd-4c3e-a6bd-7260dd41ba81 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:35.524023 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33266322-2cdd-4c3e-a6bd-7260dd41ba81 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:35.524425 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33266322-2cdd-4c3e-a6bd-7260dd41ba81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:35.532324 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33266322-2cdd-4c3e-a6bd-7260dd41ba81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:35.534273 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33266322-2cdd-4c3e-a6bd-7260dd41ba81 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:35.553598 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-33266322-2cdd-4c3e-a6bd-7260dd41ba81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:35.560079 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 376/748] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:35.560079 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33266322-2cdd-4c3e-a6bd-7260dd41ba81 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:35.575207 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea5c6e-17f4-4e00-af97-4c2cda464dce None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:35.612164 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb8832-a292-4ad0-a3b4-d25a6eef4363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:35.612960 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb8832-a292-4ad0-a3b4-d25a6eef4363 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:35.613240 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb8832-a292-4ad0-a3b4-d25a6eef4363 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:35.613546 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb8832-a292-4ad0-a3b4-d25a6eef4363 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:35.624157 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb8832-a292-4ad0-a3b4-d25a6eef4363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:35.626052 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb8832-a292-4ad0-a3b4-d25a6eef4363 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:35.642070 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-38fb8832-a292-4ad0-a3b4-d25a6eef4363 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:35.643574 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 373/749] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:35.644357 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb8832-a292-4ad0-a3b4-d25a6eef4363 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:35.669420 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33266322-2cdd-4c3e-a6bd-7260dd41ba81 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:35.711831 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7fb33-67fc-456a-941c-44c8e9e01316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:35.712582 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7fb33-67fc-456a-941c-44c8e9e01316 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:35.712867 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7fb33-67fc-456a-941c-44c8e9e01316 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:35.713138 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7fb33-67fc-456a-941c-44c8e9e01316 None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:35.714322 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7fb33-67fc-456a-941c-44c8e9e01316 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:35.714629 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7fb33-67fc-456a-941c-44c8e9e01316 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:35.717072 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7fb33-67fc-456a-941c-44c8e9e01316 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:35.741276 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 377/750] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Mar 8 13:39:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:35.742158 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7fb33-67fc-456a-941c-44c8e9e01316 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:35.755065 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb8832-a292-4ad0-a3b4-d25a6eef4363 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:35.789563 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd30883-979d-4f7b-a4a8-f162e4b7b5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:35.790231 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd30883-979d-4f7b-a4a8-f162e4b7b5ad None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:35.790457 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd30883-979d-4f7b-a4a8-f162e4b7b5ad None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:35.790721 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd30883-979d-4f7b-a4a8-f162e4b7b5ad None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:35.791513 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd30883-979d-4f7b-a4a8-f162e4b7b5ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:35.791821 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd30883-979d-4f7b-a4a8-f162e4b7b5ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:35.793542 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd30883-979d-4f7b-a4a8-f162e4b7b5ad None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:35.805809 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 374/751] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:39:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:35.806660 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd30883-979d-4f7b-a4a8-f162e4b7b5ad None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:35.872642 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7fb33-67fc-456a-941c-44c8e9e01316 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:35.910626 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e94417-a420-4621-9af4-6352ffdf3cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:35.911297 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e94417-a420-4621-9af4-6352ffdf3cf8 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:35.911574 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e94417-a420-4621-9af4-6352ffdf3cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:35.911844 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e94417-a420-4621-9af4-6352ffdf3cf8 None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:35.912575 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e94417-a420-4621-9af4-6352ffdf3cf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:35.912856 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e94417-a420-4621-9af4-6352ffdf3cf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:35.914269 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e94417-a420-4621-9af4-6352ffdf3cf8 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:35.923623 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd30883-979d-4f7b-a4a8-f162e4b7b5ad None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:35.925882 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 378/752] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:35.926960 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e94417-a420-4621-9af4-6352ffdf3cf8 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:35.959499 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346b9e4-5407-4ed8-8fdd-64f6face7277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:35.960702 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346b9e4-5407-4ed8-8fdd-64f6face7277 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:35.961179 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346b9e4-5407-4ed8-8fdd-64f6face7277 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:35.961665 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b346b9e4-5407-4ed8-8fdd-64f6face7277 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:35.972625 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b346b9e4-5407-4ed8-8fdd-64f6face7277 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:35.975083 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b346b9e4-5407-4ed8-8fdd-64f6face7277 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:35.994406 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-b346b9e4-5407-4ed8-8fdd-64f6face7277 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:36.000592 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 375/753] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:36.001693 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346b9e4-5407-4ed8-8fdd-64f6face7277 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:36.024536 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e94417-a420-4621-9af4-6352ffdf3cf8 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:36.058094 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0398b0a-f249-467d-8c88-74c9a477f123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:36.058753 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0398b0a-f249-467d-8c88-74c9a477f123 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:36.059047 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0398b0a-f249-467d-8c88-74c9a477f123 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:36.059389 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0398b0a-f249-467d-8c88-74c9a477f123 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:36.060176 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0398b0a-f249-467d-8c88-74c9a477f123 None admin] RBAC: Adding query filter params (role.id=fc021ed5870a44f5a0f0b8fff994d6f0, scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e, user.id=5a0f442666d0459aa9a34fc2f91228e9) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:36.060491 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0398b0a-f249-467d-8c88-74c9a477f123 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:36.062062 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0398b0a-f249-467d-8c88-74c9a477f123 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:36.067860 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 379/754] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:39:35 2022] GET /identity/v3/role_assignments?user.id=5a0f442666d0459aa9a34fc2f91228e9&scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e&role.id=fc021ed5870a44f5a0f0b8fff994d6f0 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:36.068540 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0398b0a-f249-467d-8c88-74c9a477f123 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:36.108935 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b346b9e4-5407-4ed8-8fdd-64f6face7277 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:36.145252 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddb6f5-5b72-4911-9a68-61e65e329787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:36.146582 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddb6f5-5b72-4911-9a68-61e65e329787 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:36.147077 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddb6f5-5b72-4911-9a68-61e65e329787 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:36.147546 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ddb6f5-5b72-4911-9a68-61e65e329787 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:36.156461 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddb6f5-5b72-4911-9a68-61e65e329787 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:36.158354 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ddb6f5-5b72-4911-9a68-61e65e329787 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:36.174183 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0398b0a-f249-467d-8c88-74c9a477f123 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:36.176216 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-d3ddb6f5-5b72-4911-9a68-61e65e329787 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 13:39:36.178060 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 376/755] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Mar 8 13:39:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:36.190572 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddb6f5-5b72-4911-9a68-61e65e329787 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:36.211477 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abb7df-7050-46e3-ba2c-75b7547092de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:36.212144 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abb7df-7050-46e3-ba2c-75b7547092de None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:36.212424 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abb7df-7050-46e3-ba2c-75b7547092de None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:36.217514 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abb7df-7050-46e3-ba2c-75b7547092de None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:36.217514 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abb7df-7050-46e3-ba2c-75b7547092de None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:36.217514 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abb7df-7050-46e3-ba2c-75b7547092de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:36.217514 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abb7df-7050-46e3-ba2c-75b7547092de None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:36.228575 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 380/756] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:36.238436 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abb7df-7050-46e3-ba2c-75b7547092de None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:36.351794 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ddb6f5-5b72-4911-9a68-61e65e329787 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:36.355257 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abb7df-7050-46e3-ba2c-75b7547092de None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:36.390130 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587837e-d8bd-424c-9453-3ccec4b98bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:36.390930 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587837e-d8bd-424c-9453-3ccec4b98bb4 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:36.391208 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587837e-d8bd-424c-9453-3ccec4b98bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:36.391478 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587837e-d8bd-424c-9453-3ccec4b98bb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:36.398512 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587837e-d8bd-424c-9453-3ccec4b98bb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:36.399898 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587837e-d8bd-424c-9453-3ccec4b98bb4 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:36.413381 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-c587837e-d8bd-424c-9453-3ccec4b98bb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:36.415218 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 381/757] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:36.418114 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6edaaf-24e2-45d1-8d92-6cac6c868e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:36.418795 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6edaaf-24e2-45d1-8d92-6cac6c868e43 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:36.419098 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6edaaf-24e2-45d1-8d92-6cac6c868e43 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:36.419414 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6edaaf-24e2-45d1-8d92-6cac6c868e43 None admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:36.420260 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6edaaf-24e2-45d1-8d92-6cac6c868e43 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:36.420591 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6edaaf-24e2-45d1-8d92-6cac6c868e43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:36.422020 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587837e-d8bd-424c-9453-3ccec4b98bb4 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:36.426464 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6edaaf-24e2-45d1-8d92-6cac6c868e43 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:36.467574 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 377/758] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Mar 8 13:39:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:36.473168 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6edaaf-24e2-45d1-8d92-6cac6c868e43 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:36.596330 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6edaaf-24e2-45d1-8d92-6cac6c868e43 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:36.611474 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587837e-d8bd-424c-9453-3ccec4b98bb4 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:36.638580 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fda191-26eb-44dd-aaff-727e8cbf20b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:36.639463 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fda191-26eb-44dd-aaff-727e8cbf20b8 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:36.640040 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fda191-26eb-44dd-aaff-727e8cbf20b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:36.640617 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fda191-26eb-44dd-aaff-727e8cbf20b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:36.645122 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b5043-5c24-421c-80bb-1f0360662b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:36.645803 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b5043-5c24-421c-80bb-1f0360662b05 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:36.646081 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b5043-5c24-421c-80bb-1f0360662b05 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:36.646349 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b5043-5c24-421c-80bb-1f0360662b05 None admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:36.647132 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b5043-5c24-421c-80bb-1f0360662b05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:36.647446 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b5043-5c24-421c-80bb-1f0360662b05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:36.649411 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b5043-5c24-421c-80bb-1f0360662b05 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:36.666489 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 382/759] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:39:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:36.667886 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f3bbe-bc7a-43a8-abf5-bc8e5d5d63a9 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:36.668175 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f3bbe-bc7a-43a8-abf5-bc8e5d5d63a9 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:36.668448 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f3bbe-bc7a-43a8-abf5-bc8e5d5d63a9 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:36.670418 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 383/760] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:36.671909 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f3bbe-bc7a-43a8-abf5-bc8e5d5d63a9 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:36.725985 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fda191-26eb-44dd-aaff-727e8cbf20b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:36.728484 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fda191-26eb-44dd-aaff-727e8cbf20b8 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:36.797225 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f3bbe-bc7a-43a8-abf5-bc8e5d5d63a9 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:36.835219 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 378/761] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:39:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:39:36.836608 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d87ef6-830f-4331-898d-4b2b6e2a2fe5 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:36.836895 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d87ef6-830f-4331-898d-4b2b6e2a2fe5 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:36.837244 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d87ef6-830f-4331-898d-4b2b6e2a2fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:36.838395 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa1755-f49d-4fca-b044-22e82001d7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:36.839285 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa1755-f49d-4fca-b044-22e82001d7cc None admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:36.839565 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa1755-f49d-4fca-b044-22e82001d7cc None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:36.839839 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa1755-f49d-4fca-b044-22e82001d7cc None admin] PATH_INFO: `/v3/projects/7d693fb3e9fc4d82a0ed054f31f1e56e/users/21ec894123044d4382995791c74c587b/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:36.842187 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa1755-f49d-4fca-b044-22e82001d7cc None admin] RBAC: Authorizing `identity:create_grant(project_id=7d693fb3e9fc4d82a0ed054f31f1e56e, user_id=21ec894123044d4382995791c74c587b, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:36.844746 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa1755-f49d-4fca-b044-22e82001d7cc None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:36.854589 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-f8d87ef6-830f-4331-898d-4b2b6e2a2fe5 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:36.855921 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-f8d87ef6-830f-4331-898d-4b2b6e2a2fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:36.862143 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 384/762] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Mar 8 13:39:36 2022] PUT /identity/v3/projects/7d693fb3e9fc4d82a0ed054f31f1e56e/users/21ec894123044d4382995791c74c587b/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:39:36.865469 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa1755-f49d-4fca-b044-22e82001d7cc None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:36.979069 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 379/763] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:39:37.015866 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d87ef6-830f-4331-898d-4b2b6e2a2fe5 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:37.037032 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa1755-f49d-4fca-b044-22e82001d7cc None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:37.104406 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fb6eb-d919-4a78-bb76-820c87c66100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:37.105217 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fb6eb-d919-4a78-bb76-820c87c66100 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:37.105523 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fb6eb-d919-4a78-bb76-820c87c66100 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:37.105796 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345fb6eb-d919-4a78-bb76-820c87c66100 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:37.119716 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345fb6eb-d919-4a78-bb76-820c87c66100 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:37.122166 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345fb6eb-d919-4a78-bb76-820c87c66100 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:37.145406 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-345fb6eb-d919-4a78-bb76-820c87c66100 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:37.147549 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 385/764] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:37.154010 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fb6eb-d919-4a78-bb76-820c87c66100 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:37.158387 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d87ef6-830f-4331-898d-4b2b6e2a2fe5 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:37.211493 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cf373-9b19-44f5-bbb1-aa60f3ce799e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:37.211493 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cf373-9b19-44f5-bbb1-aa60f3ce799e None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:37.211493 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cf373-9b19-44f5-bbb1-aa60f3ce799e None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:37.211493 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cf373-9b19-44f5-bbb1-aa60f3ce799e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:37.212289 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61cf373-9b19-44f5-bbb1-aa60f3ce799e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:37.212289 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61cf373-9b19-44f5-bbb1-aa60f3ce799e None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:37.227378 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-d61cf373-9b19-44f5-bbb1-aa60f3ce799e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 08 13:39:37.234575 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 380/765] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Mar 8 13:39:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:39:37.242465 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cf373-9b19-44f5-bbb1-aa60f3ce799e None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:37.337192 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345fb6eb-d919-4a78-bb76-820c87c66100 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:37.373326 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cf373-9b19-44f5-bbb1-aa60f3ce799e None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:37.398011 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad0e33-d012-485e-b110-be87d072210e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:37.399073 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad0e33-d012-485e-b110-be87d072210e None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:37.399564 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad0e33-d012-485e-b110-be87d072210e None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:37.400017 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad0e33-d012-485e-b110-be87d072210e None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:37.400957 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad0e33-d012-485e-b110-be87d072210e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:37.401508 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad0e33-d012-485e-b110-be87d072210e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:37.403103 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad0e33-d012-485e-b110-be87d072210e None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:37.415748 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 386/766] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:37.421447 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad0e33-d012-485e-b110-be87d072210e None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:37.442801 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f48da-3454-405b-9aec-5d2186c3f6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:37.443904 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f48da-3454-405b-9aec-5d2186c3f6fb None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:37.444381 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f48da-3454-405b-9aec-5d2186c3f6fb None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:37.444834 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f48da-3454-405b-9aec-5d2186c3f6fb None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:37.445754 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f48da-3454-405b-9aec-5d2186c3f6fb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:37.446245 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f48da-3454-405b-9aec-5d2186c3f6fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:37.448037 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f48da-3454-405b-9aec-5d2186c3f6fb None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:37.456258 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 381/767] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Mar 8 13:39:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:37.463153 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f48da-3454-405b-9aec-5d2186c3f6fb None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:37.587615 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad0e33-d012-485e-b110-be87d072210e None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:37.630815 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f48da-3454-405b-9aec-5d2186c3f6fb None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:37.645627 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757e1bd-97fe-4f84-aa95-c4fa1b6c0200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:37.646432 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757e1bd-97fe-4f84-aa95-c4fa1b6c0200 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:37.646710 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757e1bd-97fe-4f84-aa95-c4fa1b6c0200 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:37.646981 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757e1bd-97fe-4f84-aa95-c4fa1b6c0200 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:37.660259 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757e1bd-97fe-4f84-aa95-c4fa1b6c0200 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:37.661801 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757e1bd-97fe-4f84-aa95-c4fa1b6c0200 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:37.665119 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805154e-4fa8-44de-b8c6-add4cb1f567c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:37.665810 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805154e-4fa8-44de-b8c6-add4cb1f567c None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:37.666082 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805154e-4fa8-44de-b8c6-add4cb1f567c None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:37.666346 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805154e-4fa8-44de-b8c6-add4cb1f567c None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:37.667047 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805154e-4fa8-44de-b8c6-add4cb1f567c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:37.667353 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805154e-4fa8-44de-b8c6-add4cb1f567c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:37.668764 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b805154e-4fa8-44de-b8c6-add4cb1f567c None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:37.674061 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 382/768] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Mar 8 13:39:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:37.679788 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805154e-4fa8-44de-b8c6-add4cb1f567c None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:37.691492 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-f757e1bd-97fe-4f84-aa95-c4fa1b6c0200 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:37.694364 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 387/769] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:39:37.699130 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757e1bd-97fe-4f84-aa95-c4fa1b6c0200 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:37.811731 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757e1bd-97fe-4f84-aa95-c4fa1b6c0200 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:37.870531 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38ee8c-b9a2-4090-90d4-087a7947a900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:37.871569 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38ee8c-b9a2-4090-90d4-087a7947a900 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:37.872090 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38ee8c-b9a2-4090-90d4-087a7947a900 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:37.872555 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38ee8c-b9a2-4090-90d4-087a7947a900 None admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:37.873576 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38ee8c-b9a2-4090-90d4-087a7947a900 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:37.875130 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38ee8c-b9a2-4090-90d4-087a7947a900 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:37.877913 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38ee8c-b9a2-4090-90d4-087a7947a900 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:37.895119 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805154e-4fa8-44de-b8c6-add4cb1f567c None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:37.911737 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 388/770] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:39:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:37.922411 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38ee8c-b9a2-4090-90d4-087a7947a900 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:37.937118 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7645e2-5e94-4eb4-b80b-0989f381fd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:37.938188 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7645e2-5e94-4eb4-b80b-0989f381fd18 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:37.939090 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7645e2-5e94-4eb4-b80b-0989f381fd18 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:37.939569 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7645e2-5e94-4eb4-b80b-0989f381fd18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:37.940557 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7645e2-5e94-4eb4-b80b-0989f381fd18 None admin] RBAC: Adding query filter params (interface=public, service_id=b28dc21b049f4dd28b626d2818874890, region_id=RegionOne) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:37.941069 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7645e2-5e94-4eb4-b80b-0989f381fd18 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:37.942658 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7645e2-5e94-4eb4-b80b-0989f381fd18 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:37.951634 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 383/771] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Mar 8 13:39:37 2022] GET /identity/v3/endpoints?service_id=b28dc21b049f4dd28b626d2818874890&interface=public®ion_id=RegionOne => generated 194 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:37.957101 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7645e2-5e94-4eb4-b80b-0989f381fd18 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:38.082645 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7645e2-5e94-4eb4-b80b-0989f381fd18 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:38.112303 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38ee8c-b9a2-4090-90d4-087a7947a900 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:38.115959 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028a926-1f56-4e41-ab0e-8cfe82760f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:38.116909 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028a926-1f56-4e41-ab0e-8cfe82760f4b None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:38.117408 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028a926-1f56-4e41-ab0e-8cfe82760f4b None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:38.117869 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028a926-1f56-4e41-ab0e-8cfe82760f4b None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:38.118748 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028a926-1f56-4e41-ab0e-8cfe82760f4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:38.120346 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028a926-1f56-4e41-ab0e-8cfe82760f4b None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:38.125955 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 384/772] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Mar 8 13:39:37 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:38.159535 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a9d01-079e-4bda-af0b-9cdd4cf08c03 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:38.160144 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a9d01-079e-4bda-af0b-9cdd4cf08c03 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:38.160629 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a9d01-079e-4bda-af0b-9cdd4cf08c03 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:38.162947 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 385/773] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:38.172666 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701dda89-bf03-41e0-a1f9-f5356d5319ea None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:38.173279 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701dda89-bf03-41e0-a1f9-f5356d5319ea None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:38.173762 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701dda89-bf03-41e0-a1f9-f5356d5319ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:38.174703 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9da601-98c8-419a-9dab-a82ec43489fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:38.175370 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9da601-98c8-419a-9dab-a82ec43489fe None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:38.175648 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9da601-98c8-419a-9dab-a82ec43489fe None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:38.181381 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9da601-98c8-419a-9dab-a82ec43489fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:38.181381 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9da601-98c8-419a-9dab-a82ec43489fe None admin] RBAC: Adding query filter params (role.id=5189c0e028ff42908ca943fdb5ce1873, scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e, user.id=817bcd2c5f6e4bceb049eeb122d4e432) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:38.181381 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9da601-98c8-419a-9dab-a82ec43489fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:38.181381 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9da601-98c8-419a-9dab-a82ec43489fe None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:38.186306 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 389/774] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:39:37 2022] GET /identity/v3/role_assignments?user.id=817bcd2c5f6e4bceb049eeb122d4e432&scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e&role.id=5189c0e028ff42908ca943fdb5ce1873 => generated 259 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:38.210666 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-701dda89-bf03-41e0-a1f9-f5356d5319ea None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:38.212315 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-701dda89-bf03-41e0-a1f9-f5356d5319ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:38.306386 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 386/775] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:39:38.344976 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9da601-98c8-419a-9dab-a82ec43489fe None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:38.464050 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9da601-98c8-419a-9dab-a82ec43489fe None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:38.501433 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfb47c-b8a7-4d95-8016-8d93ed15efc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:38.502928 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfb47c-b8a7-4d95-8016-8d93ed15efc3 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:38.502928 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfb47c-b8a7-4d95-8016-8d93ed15efc3 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:38.503171 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bfb47c-b8a7-4d95-8016-8d93ed15efc3 None admin] PATH_INFO: `/v3/services/network` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:38.509395 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfb47c-b8a7-4d95-8016-8d93ed15efc3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:38.509395 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bfb47c-b8a7-4d95-8016-8d93ed15efc3 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:38.516010 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-32bfb47c-b8a7-4d95-8016-8d93ed15efc3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 08 13:39:38.517503 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 390/776] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:38 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:38.526676 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701dda89-bf03-41e0-a1f9-f5356d5319ea None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:38.627212 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701dda89-bf03-41e0-a1f9-f5356d5319ea None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:38.668872 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c70be-46f3-44a3-80f4-e5b030a4461c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:38.669612 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c70be-46f3-44a3-80f4-e5b030a4461c None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:38.669894 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c70be-46f3-44a3-80f4-e5b030a4461c None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:38.670163 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c70be-46f3-44a3-80f4-e5b030a4461c None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:38.670878 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c70be-46f3-44a3-80f4-e5b030a4461c None admin] RBAC: Adding query filter params (name=network) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:38.671185 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c70be-46f3-44a3-80f4-e5b030a4461c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:38.672666 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c70be-46f3-44a3-80f4-e5b030a4461c None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:38.677797 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 387/777] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Mar 8 13:39:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:38.683385 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfb47c-b8a7-4d95-8016-8d93ed15efc3 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:38.785992 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e81f1-f0aa-4b19-8633-61cec522b767 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:38.786312 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e81f1-f0aa-4b19-8633-61cec522b767 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:38.786551 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e81f1-f0aa-4b19-8633-61cec522b767 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:38.788338 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 388/778] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:39:38.801445 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bfb47c-b8a7-4d95-8016-8d93ed15efc3 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:38.802871 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7cf1e-0252-4db5-a64b-df1330b7f585 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:38.803156 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7cf1e-0252-4db5-a64b-df1330b7f585 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:38.803429 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7cf1e-0252-4db5-a64b-df1330b7f585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:38.838243 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-9bd7cf1e-0252-4db5-a64b-df1330b7f585 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:38.839422 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-9bd7cf1e-0252-4db5-a64b-df1330b7f585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:38.842885 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab937611-3347-4138-960f-25eefb5e99b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:38.843558 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab937611-3347-4138-960f-25eefb5e99b3 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:38.843835 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab937611-3347-4138-960f-25eefb5e99b3 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:38.844101 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab937611-3347-4138-960f-25eefb5e99b3 None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:38.844808 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab937611-3347-4138-960f-25eefb5e99b3 None admin] RBAC: Adding query filter params (type=network) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:38.845108 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab937611-3347-4138-960f-25eefb5e99b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:38.846487 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab937611-3347-4138-960f-25eefb5e99b3 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:38.859855 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 391/779] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Mar 8 13:39:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:38.865686 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab937611-3347-4138-960f-25eefb5e99b3 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:38.970292 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 389/780] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:39:39.003770 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7cf1e-0252-4db5-a64b-df1330b7f585 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:39.023308 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab937611-3347-4138-960f-25eefb5e99b3 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:39.089106 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc297f70-ff0f-4e40-ae6e-9541ecd5e669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:39.089822 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc297f70-ff0f-4e40-ae6e-9541ecd5e669 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:39.090100 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc297f70-ff0f-4e40-ae6e-9541ecd5e669 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:39.090370 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc297f70-ff0f-4e40-ae6e-9541ecd5e669 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:39.091215 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc297f70-ff0f-4e40-ae6e-9541ecd5e669 None admin] RBAC: Adding query filter params (interface=public, service_id=2eba3dcaea5842d690f41d73995b57e5, region_id=RegionOne) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:39.091520 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc297f70-ff0f-4e40-ae6e-9541ecd5e669 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:39.092915 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc297f70-ff0f-4e40-ae6e-9541ecd5e669 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:39.109023 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 392/781] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Mar 8 13:39:38 2022] GET /identity/v3/endpoints?service_id=2eba3dcaea5842d690f41d73995b57e5&interface=public®ion_id=RegionOne => generated 194 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:39.115558 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc297f70-ff0f-4e40-ae6e-9541ecd5e669 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:39.179509 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7cf1e-0252-4db5-a64b-df1330b7f585 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:39.218502 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12baf26-841b-4c30-9927-796e528e2d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:39.219676 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12baf26-841b-4c30-9927-796e528e2d13 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:39.220195 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12baf26-841b-4c30-9927-796e528e2d13 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:39.220723 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12baf26-841b-4c30-9927-796e528e2d13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:39.232990 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12baf26-841b-4c30-9927-796e528e2d13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:39.240947 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-d12baf26-841b-4c30-9927-796e528e2d13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:39:39.242758 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 390/782] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:39:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:39:39.248327 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12baf26-841b-4c30-9927-796e528e2d13 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:39.286899 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc297f70-ff0f-4e40-ae6e-9541ecd5e669 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:39.354493 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d4e77-b03b-44ec-8a22-4847c9691921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:39.355165 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d4e77-b03b-44ec-8a22-4847c9691921 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:39.355442 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d4e77-b03b-44ec-8a22-4847c9691921 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:39.355798 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d4e77-b03b-44ec-8a22-4847c9691921 None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:39.356454 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d4e77-b03b-44ec-8a22-4847c9691921 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:39.357854 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d4e77-b03b-44ec-8a22-4847c9691921 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:39.376055 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12baf26-841b-4c30-9927-796e528e2d13 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:39.380327 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 393/783] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Mar 8 13:39:39 2022] GET /identity/v3/services => generated 772 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:39.414352 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242efa1-c526-4a8c-81ae-0c134f5c3ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:39.415457 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242efa1-c526-4a8c-81ae-0c134f5c3ad9 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:39.415963 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242efa1-c526-4a8c-81ae-0c134f5c3ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:39.416461 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242efa1-c526-4a8c-81ae-0c134f5c3ad9 None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:39.417496 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242efa1-c526-4a8c-81ae-0c134f5c3ad9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:39.418033 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242efa1-c526-4a8c-81ae-0c134f5c3ad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:39.419702 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b242efa1-c526-4a8c-81ae-0c134f5c3ad9 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:39.430114 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 391/784] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:39:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:39.438818 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d4e77-b03b-44ec-8a22-4847c9691921 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:39.489650 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125d99a-1c87-44d6-9824-93656c65e541 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:39.490256 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125d99a-1c87-44d6-9824-93656c65e541 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:39.490732 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125d99a-1c87-44d6-9824-93656c65e541 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:39.493104 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 392/785] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:39:39.506413 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05366da-864d-4224-b4bd-94005a315ef1 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:39.506968 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05366da-864d-4224-b4bd-94005a315ef1 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:39.507497 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05366da-864d-4224-b4bd-94005a315ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:39.538907 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-b05366da-864d-4224-b4bd-94005a315ef1 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:39.542982 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-b05366da-864d-4224-b4bd-94005a315ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:39.623292 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d4e77-b03b-44ec-8a22-4847c9691921 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:39.634769 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 393/786] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:39:39.657224 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05366da-864d-4224-b4bd-94005a315ef1 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:39.666492 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd988f97-8667-4e9e-a800-5ed101731af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:39.666928 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd988f97-8667-4e9e-a800-5ed101731af8 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:39.668979 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd988f97-8667-4e9e-a800-5ed101731af8 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:39.668979 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd988f97-8667-4e9e-a800-5ed101731af8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:39.680115 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd988f97-8667-4e9e-a800-5ed101731af8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:39.681587 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd988f97-8667-4e9e-a800-5ed101731af8 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:39.698480 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-fd988f97-8667-4e9e-a800-5ed101731af8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:39.699994 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 394/787] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:39.709377 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd988f97-8667-4e9e-a800-5ed101731af8 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:39.795096 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05366da-864d-4224-b4bd-94005a315ef1 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:39.829962 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1825d8-b32b-4c5a-b890-d7b4ac2b83da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:39.830918 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1825d8-b32b-4c5a-b890-d7b4ac2b83da None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:39.831204 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1825d8-b32b-4c5a-b890-d7b4ac2b83da None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:39.831481 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1825d8-b32b-4c5a-b890-d7b4ac2b83da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:39.849420 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1825d8-b32b-4c5a-b890-d7b4ac2b83da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:39.864770 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-ff1825d8-b32b-4c5a-b890-d7b4ac2b83da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:39:39.866419 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 394/788] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:39:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:39.872248 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1825d8-b32b-4c5a-b890-d7b4ac2b83da None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:39.876560 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd988f97-8667-4e9e-a800-5ed101731af8 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:39.928241 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6351fb5-a11a-42a2-b2c7-adc670a416ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:39.928901 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6351fb5-a11a-42a2-b2c7-adc670a416ee None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:39.929177 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6351fb5-a11a-42a2-b2c7-adc670a416ee None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:39.929478 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6351fb5-a11a-42a2-b2c7-adc670a416ee None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:39.930210 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6351fb5-a11a-42a2-b2c7-adc670a416ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:39.930515 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6351fb5-a11a-42a2-b2c7-adc670a416ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:39.931866 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6351fb5-a11a-42a2-b2c7-adc670a416ee None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:39.955170 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 395/789] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:39.962320 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6351fb5-a11a-42a2-b2c7-adc670a416ee None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:40.062126 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6351fb5-a11a-42a2-b2c7-adc670a416ee None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:40.083570 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1825d8-b32b-4c5a-b890-d7b4ac2b83da None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:40.099388 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafc1fd-f331-4131-9d21-f4a7b5d828d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:40.100187 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafc1fd-f331-4131-9d21-f4a7b5d828d0 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:40.100467 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafc1fd-f331-4131-9d21-f4a7b5d828d0 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:40.100739 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafc1fd-f331-4131-9d21-f4a7b5d828d0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:40.118524 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafc1fd-f331-4131-9d21-f4a7b5d828d0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:40.119962 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafc1fd-f331-4131-9d21-f4a7b5d828d0 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:40.128756 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e058c-2c4f-41fd-b714-79baf120628e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:40.129504 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e058c-2c4f-41fd-b714-79baf120628e None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:40.129937 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e058c-2c4f-41fd-b714-79baf120628e None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:40.130217 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e058c-2c4f-41fd-b714-79baf120628e None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:40.130983 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e058c-2c4f-41fd-b714-79baf120628e None admin] RBAC: Adding query filter params (name=admin) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:40.131284 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e058c-2c4f-41fd-b714-79baf120628e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:40.132703 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e058c-2c4f-41fd-b714-79baf120628e None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:40.146643 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-fcafc1fd-f331-4131-9d21-f4a7b5d828d0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 13:39:40.148166 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 396/790] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:39:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:40.153801 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafc1fd-f331-4131-9d21-f4a7b5d828d0 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:40.154908 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 395/791] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:39:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:40.160771 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e058c-2c4f-41fd-b714-79baf120628e None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:40.286778 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e058c-2c4f-41fd-b714-79baf120628e None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:40.313946 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafc1fd-f331-4131-9d21-f4a7b5d828d0 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:40.350177 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947130d-479e-45b9-a463-8e3b6dbe75f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:40.350857 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947130d-479e-45b9-a463-8e3b6dbe75f0 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:40.351142 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947130d-479e-45b9-a463-8e3b6dbe75f0 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:40.351415 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947130d-479e-45b9-a463-8e3b6dbe75f0 None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:40.352271 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947130d-479e-45b9-a463-8e3b6dbe75f0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:40.352584 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947130d-479e-45b9-a463-8e3b6dbe75f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:40.354452 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f947130d-479e-45b9-a463-8e3b6dbe75f0 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:40.365375 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f73e2-c1f9-4460-b527-6a53aa4b3ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:40.366205 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f73e2-c1f9-4460-b527-6a53aa4b3ad8 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:40.366486 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f73e2-c1f9-4460-b527-6a53aa4b3ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:40.366763 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f73e2-c1f9-4460-b527-6a53aa4b3ad8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:40.385705 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 397/792] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Mar 8 13:39:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:40.386735 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f73e2-c1f9-4460-b527-6a53aa4b3ad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:40.388371 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f73e2-c1f9-4460-b527-6a53aa4b3ad8 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:40.390214 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947130d-479e-45b9-a463-8e3b6dbe75f0 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:40.414273 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-648f73e2-c1f9-4460-b527-6a53aa4b3ad8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:40.417289 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 396/793] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:39:40.423986 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f73e2-c1f9-4460-b527-6a53aa4b3ad8 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:40.511099 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f947130d-479e-45b9-a463-8e3b6dbe75f0 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:40.548835 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79fe1e-cb02-418d-ac1e-c10e5d73951d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:40.549995 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79fe1e-cb02-418d-ac1e-c10e5d73951d None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:40.550324 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79fe1e-cb02-418d-ac1e-c10e5d73951d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:40.550601 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79fe1e-cb02-418d-ac1e-c10e5d73951d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:40.561369 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79fe1e-cb02-418d-ac1e-c10e5d73951d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:40.563259 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79fe1e-cb02-418d-ac1e-c10e5d73951d None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:40.581312 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-bc79fe1e-cb02-418d-ac1e-c10e5d73951d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:40.582780 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 398/794] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:39:40.587890 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79fe1e-cb02-418d-ac1e-c10e5d73951d None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:40.698654 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79fe1e-cb02-418d-ac1e-c10e5d73951d None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:40.703179 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f73e2-c1f9-4460-b527-6a53aa4b3ad8 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:40.741655 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99862be-3596-4ad8-8c1d-63e3c9942e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:40.742492 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99862be-3596-4ad8-8c1d-63e3c9942e83 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:40.742780 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99862be-3596-4ad8-8c1d-63e3c9942e83 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:40.743054 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99862be-3596-4ad8-8c1d-63e3c9942e83 None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:40.743789 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99862be-3596-4ad8-8c1d-63e3c9942e83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:40.744091 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99862be-3596-4ad8-8c1d-63e3c9942e83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:40.745523 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99862be-3596-4ad8-8c1d-63e3c9942e83 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:40.758735 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 399/795] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:40.764433 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99862be-3596-4ad8-8c1d-63e3c9942e83 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:40.798096 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0272b-36b3-44a9-9d70-474d391a81da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:40.798769 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0272b-36b3-44a9-9d70-474d391a81da None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:40.799240 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0272b-36b3-44a9-9d70-474d391a81da None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:40.799368 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0272b-36b3-44a9-9d70-474d391a81da None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:40.800060 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0272b-36b3-44a9-9d70-474d391a81da None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:40.800366 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0272b-36b3-44a9-9d70-474d391a81da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:40.801793 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0272b-36b3-44a9-9d70-474d391a81da None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:40.814190 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 397/796] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:40.815550 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458942be-b330-4fda-bc33-7b774424b1fd None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:40.815836 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458942be-b330-4fda-bc33-7b774424b1fd None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:40.816111 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458942be-b330-4fda-bc33-7b774424b1fd None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:40.822395 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 398/797] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:40.823173 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458942be-b330-4fda-bc33-7b774424b1fd None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:40.877241 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99862be-3596-4ad8-8c1d-63e3c9942e83 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:40.921590 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c30a1-79ab-4b64-a553-53efe15bd36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:40.922398 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c30a1-79ab-4b64-a553-53efe15bd36e None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:40.922679 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c30a1-79ab-4b64-a553-53efe15bd36e None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:40.922952 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c30a1-79ab-4b64-a553-53efe15bd36e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:40.923232 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458942be-b330-4fda-bc33-7b774424b1fd None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:40.931492 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c30a1-79ab-4b64-a553-53efe15bd36e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:40.933295 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c30a1-79ab-4b64-a553-53efe15bd36e None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:40.951042 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-a18c30a1-79ab-4b64-a553-53efe15bd36e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:40.953106 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 400/798] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:40.954441 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff6cca-8b08-415c-87ef-169fc6f65304 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:40.954777 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff6cca-8b08-415c-87ef-169fc6f65304 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:40.954992 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff6cca-8b08-415c-87ef-169fc6f65304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:40.957674 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce17472-789e-46f1-b364-444edd01eb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:40.958527 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce17472-789e-46f1-b364-444edd01eb1b None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:40.958904 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce17472-789e-46f1-b364-444edd01eb1b None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:40.959182 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce17472-789e-46f1-b364-444edd01eb1b None admin] PATH_INFO: `/v3/users/nova` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:40.968735 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce17472-789e-46f1-b364-444edd01eb1b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:40.970259 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce17472-789e-46f1-b364-444edd01eb1b None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:40.974780 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-c6ff6cca-8b08-415c-87ef-169fc6f65304 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:40.975978 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-c6ff6cca-8b08-415c-87ef-169fc6f65304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:40.984284 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-cce17472-789e-46f1-b364-444edd01eb1b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 13:39:40.990249 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 399/799] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Mar 8 13:39:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:40.991111 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce17472-789e-46f1-b364-444edd01eb1b None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:41.054860 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 401/800] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:39:41.055719 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff6cca-8b08-415c-87ef-169fc6f65304 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:41.093136 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce17472-789e-46f1-b364-444edd01eb1b None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:41.126184 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7b146-e82c-47ab-ac93-e9bb19165101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:41.126886 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7b146-e82c-47ab-ac93-e9bb19165101 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:41.127166 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7b146-e82c-47ab-ac93-e9bb19165101 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:41.127487 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7b146-e82c-47ab-ac93-e9bb19165101 None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:41.128226 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7b146-e82c-47ab-ac93-e9bb19165101 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:41.128532 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7b146-e82c-47ab-ac93-e9bb19165101 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:41.130024 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7b146-e82c-47ab-ac93-e9bb19165101 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:41.141759 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 400/801] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:39:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:41.142711 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bdaf4-199c-48cb-a3cb-4897085c21bb None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:41.142999 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bdaf4-199c-48cb-a3cb-4897085c21bb None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:41.143250 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bdaf4-199c-48cb-a3cb-4897085c21bb None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:41.145081 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 401/802] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:41.145583 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bdaf4-199c-48cb-a3cb-4897085c21bb None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:41.171959 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff6cca-8b08-415c-87ef-169fc6f65304 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:41.205983 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad25148-e646-4c02-95ae-ff57945ea580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:41.206651 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad25148-e646-4c02-95ae-ff57945ea580 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:41.206932 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad25148-e646-4c02-95ae-ff57945ea580 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:41.207220 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad25148-e646-4c02-95ae-ff57945ea580 None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:41.208045 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad25148-e646-4c02-95ae-ff57945ea580 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:41.208347 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad25148-e646-4c02-95ae-ff57945ea580 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:41.209794 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad25148-e646-4c02-95ae-ff57945ea580 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:41.231854 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 402/803] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Mar 8 13:39:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:41.231854 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad25148-e646-4c02-95ae-ff57945ea580 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:41.251078 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bdaf4-199c-48cb-a3cb-4897085c21bb None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:41.285056 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887fda4-4131-447b-b01c-f97e0dda5538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:41.285876 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887fda4-4131-447b-b01c-f97e0dda5538 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:41.286151 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887fda4-4131-447b-b01c-f97e0dda5538 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:41.286418 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887fda4-4131-447b-b01c-f97e0dda5538 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:41.287063 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887fda4-4131-447b-b01c-f97e0dda5538 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:41.288413 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6887fda4-4131-447b-b01c-f97e0dda5538 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:41.299622 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-6887fda4-4131-447b-b01c-f97e0dda5538 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Mar 08 13:39:41.305704 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 402/804] 10.222.0.18 () {56 vars in 1129 bytes} [Tue Mar 8 13:39:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:41.305704 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a4ba2-3e07-494a-a14f-4f9615853454 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:41.305704 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a4ba2-3e07-494a-a14f-4f9615853454 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:41.305704 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a4ba2-3e07-494a-a14f-4f9615853454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:41.321314 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-375a4ba2-3e07-494a-a14f-4f9615853454 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:41.322525 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-375a4ba2-3e07-494a-a14f-4f9615853454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:41.335672 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad25148-e646-4c02-95ae-ff57945ea580 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:41.368546 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f073f4-0382-4a9a-8610-dd82e004b3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:41.369478 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f073f4-0382-4a9a-8610-dd82e004b3c4 None admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:41.369756 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f073f4-0382-4a9a-8610-dd82e004b3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:41.370022 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f073f4-0382-4a9a-8610-dd82e004b3c4 None admin] PATH_INFO: `/v3/projects/7d693fb3e9fc4d82a0ed054f31f1e56e/users/5a0f442666d0459aa9a34fc2f91228e9/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:41.372019 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f073f4-0382-4a9a-8610-dd82e004b3c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d693fb3e9fc4d82a0ed054f31f1e56e, user_id=5a0f442666d0459aa9a34fc2f91228e9, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:41.373465 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f073f4-0382-4a9a-8610-dd82e004b3c4 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:41.387001 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 403/805] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Mar 8 13:39:41 2022] PUT /identity/v3/projects/7d693fb3e9fc4d82a0ed054f31f1e56e/users/5a0f442666d0459aa9a34fc2f91228e9/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:39:41.387874 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f073f4-0382-4a9a-8610-dd82e004b3c4 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:41.408675 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 403/806] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:39:41.413398 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a4ba2-3e07-494a-a14f-4f9615853454 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:41.526077 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f073f4-0382-4a9a-8610-dd82e004b3c4 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:41.563354 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d208fe8-0b60-4bbd-aaac-de55e46bb7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:41.564396 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d208fe8-0b60-4bbd-aaac-de55e46bb7ec None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:41.564858 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d208fe8-0b60-4bbd-aaac-de55e46bb7ec None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:41.565271 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a4ba2-3e07-494a-a14f-4f9615853454 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:41.565548 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d208fe8-0b60-4bbd-aaac-de55e46bb7ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:41.606013 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24643db-807b-40b2-bfb7-da5eee0170a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:41.606822 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24643db-807b-40b2-bfb7-da5eee0170a3 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:41.607107 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24643db-807b-40b2-bfb7-da5eee0170a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:41.607377 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24643db-807b-40b2-bfb7-da5eee0170a3 None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:41.608081 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24643db-807b-40b2-bfb7-da5eee0170a3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:41.608386 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24643db-807b-40b2-bfb7-da5eee0170a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:41.610346 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24643db-807b-40b2-bfb7-da5eee0170a3 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:41.614700 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 404/807] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Mar 8 13:39:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:41.615484 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24643db-807b-40b2-bfb7-da5eee0170a3 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:41.653374 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d208fe8-0b60-4bbd-aaac-de55e46bb7ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:41.654739 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d208fe8-0b60-4bbd-aaac-de55e46bb7ec None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:41.723006 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24643db-807b-40b2-bfb7-da5eee0170a3 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:41.759989 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fc6af-ca10-44f1-baeb-51056f7b51dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:41.760814 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fc6af-ca10-44f1-baeb-51056f7b51dc None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:41.761095 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fc6af-ca10-44f1-baeb-51056f7b51dc None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:41.761394 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fc6af-ca10-44f1-baeb-51056f7b51dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:41.762329 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 404/808] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:39:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:39:41.763174 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d208fe8-0b60-4bbd-aaac-de55e46bb7ec None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:41.772158 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fc6af-ca10-44f1-baeb-51056f7b51dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:41.779248 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-f64fc6af-ca10-44f1-baeb-51056f7b51dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:39:41.781075 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 405/809] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Mar 8 13:39:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:41.782025 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fc6af-ca10-44f1-baeb-51056f7b51dc None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:41.866607 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d208fe8-0b60-4bbd-aaac-de55e46bb7ec None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:41.880138 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fc6af-ca10-44f1-baeb-51056f7b51dc None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:41.904835 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490a3eb-580d-4bac-b059-6ff4865c2ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:41.905488 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490a3eb-580d-4bac-b059-6ff4865c2ca5 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:41.906087 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490a3eb-580d-4bac-b059-6ff4865c2ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:41.906360 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490a3eb-580d-4bac-b059-6ff4865c2ca5 None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:41.907066 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490a3eb-580d-4bac-b059-6ff4865c2ca5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:41.907369 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490a3eb-580d-4bac-b059-6ff4865c2ca5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:41.908777 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490a3eb-580d-4bac-b059-6ff4865c2ca5 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:41.913539 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 405/810] 10.222.0.18 () {56 vars in 1124 bytes} [Tue Mar 8 13:39:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:41.913894 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd18fb-eb71-4c43-8234-a2bed347b8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:41.914306 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490a3eb-580d-4bac-b059-6ff4865c2ca5 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:41.914690 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd18fb-eb71-4c43-8234-a2bed347b8ee None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:41.914977 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd18fb-eb71-4c43-8234-a2bed347b8ee None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:41.915250 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd18fb-eb71-4c43-8234-a2bed347b8ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:41.926010 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd18fb-eb71-4c43-8234-a2bed347b8ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:41.927459 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd18fb-eb71-4c43-8234-a2bed347b8ee None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:41.944127 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-3fdd18fb-eb71-4c43-8234-a2bed347b8ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:41.945638 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 406/811] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:41.946477 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd18fb-eb71-4c43-8234-a2bed347b8ee None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:42.015139 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490a3eb-580d-4bac-b059-6ff4865c2ca5 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:42.043956 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd18fb-eb71-4c43-8234-a2bed347b8ee None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:42.048783 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2327b-e939-4872-ac3d-c5f434acd5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:42.049497 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2327b-e939-4872-ac3d-c5f434acd5e4 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:42.049781 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2327b-e939-4872-ac3d-c5f434acd5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:42.050069 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2327b-e939-4872-ac3d-c5f434acd5e4 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:42.050803 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2327b-e939-4872-ac3d-c5f434acd5e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:42.051103 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2327b-e939-4872-ac3d-c5f434acd5e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:42.052464 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2327b-e939-4872-ac3d-c5f434acd5e4 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:42.060451 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 406/812] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Mar 8 13:39:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:42.061237 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2327b-e939-4872-ac3d-c5f434acd5e4 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:42.077149 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e96de-42f5-4686-ae96-3b744396df81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:42.077861 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e96de-42f5-4686-ae96-3b744396df81 None admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:42.078143 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e96de-42f5-4686-ae96-3b744396df81 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:42.078418 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4e96de-42f5-4686-ae96-3b744396df81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:42.079164 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e96de-42f5-4686-ae96-3b744396df81 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:42.080540 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4e96de-42f5-4686-ae96-3b744396df81 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:42.103316 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 407/813] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Mar 8 13:39:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:39:42.104210 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e96de-42f5-4686-ae96-3b744396df81 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:42.198265 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2327b-e939-4872-ac3d-c5f434acd5e4 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:42.239919 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdadc04-03df-420b-a74a-a1e93915b824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:42.240250 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4e96de-42f5-4686-ae96-3b744396df81 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:42.240589 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdadc04-03df-420b-a74a-a1e93915b824 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:42.240869 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdadc04-03df-420b-a74a-a1e93915b824 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:42.241142 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdadc04-03df-420b-a74a-a1e93915b824 None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:42.241937 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdadc04-03df-420b-a74a-a1e93915b824 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:42.242239 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdadc04-03df-420b-a74a-a1e93915b824 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:42.244518 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdadc04-03df-420b-a74a-a1e93915b824 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:42.256738 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 407/814] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:42.258286 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efc4b0-4433-427e-bb65-64fa9f0bcec5 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:42.258576 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efc4b0-4433-427e-bb65-64fa9f0bcec5 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:42.259202 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efc4b0-4433-427e-bb65-64fa9f0bcec5 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:42.264721 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 408/815] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:42.264721 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efc4b0-4433-427e-bb65-64fa9f0bcec5 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:42.285121 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ca98f-9034-4f54-9b36-770086eef5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:42.286517 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ca98f-9034-4f54-9b36-770086eef5e7 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:42.286517 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ca98f-9034-4f54-9b36-770086eef5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:42.286845 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ca98f-9034-4f54-9b36-770086eef5e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:42.298339 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ca98f-9034-4f54-9b36-770086eef5e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:42.299966 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ca98f-9034-4f54-9b36-770086eef5e7 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:42.317628 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-953ca98f-9034-4f54-9b36-770086eef5e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:42.323425 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 408/816] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:42.323425 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c017b-369a-4fd6-a5eb-b4783f6c9cbc None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:42.323425 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c017b-369a-4fd6-a5eb-b4783f6c9cbc None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:42.323425 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c017b-369a-4fd6-a5eb-b4783f6c9cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:42.344973 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-d98c017b-369a-4fd6-a5eb-b4783f6c9cbc None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:42.346812 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-d98c017b-369a-4fd6-a5eb-b4783f6c9cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:42.386124 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efc4b0-4433-427e-bb65-64fa9f0bcec5 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:42.420113 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 409/817] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:39:42.421178 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c017b-369a-4fd6-a5eb-b4783f6c9cbc None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:42.428036 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46d438-f679-4e16-9123-77e3a2591aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:42.428846 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46d438-f679-4e16-9123-77e3a2591aaf None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:42.429597 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46d438-f679-4e16-9123-77e3a2591aaf None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:42.429877 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee46d438-f679-4e16-9123-77e3a2591aaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:42.439146 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46d438-f679-4e16-9123-77e3a2591aaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:42.440870 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee46d438-f679-4e16-9123-77e3a2591aaf None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:42.458225 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-ee46d438-f679-4e16-9123-77e3a2591aaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:42.459637 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 409/818] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:42.460901 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46d438-f679-4e16-9123-77e3a2591aaf None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:42.523589 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98c017b-369a-4fd6-a5eb-b4783f6c9cbc None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:42.557705 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056c8b7-44e7-4faa-9636-a0eec438e370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:42.558525 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056c8b7-44e7-4faa-9636-a0eec438e370 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:42.558901 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056c8b7-44e7-4faa-9636-a0eec438e370 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:42.559349 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056c8b7-44e7-4faa-9636-a0eec438e370 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:42.560177 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056c8b7-44e7-4faa-9636-a0eec438e370 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:42.560584 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056c8b7-44e7-4faa-9636-a0eec438e370 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:42.562104 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056c8b7-44e7-4faa-9636-a0eec438e370 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:42.574040 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 410/819] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:42.575057 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056c8b7-44e7-4faa-9636-a0eec438e370 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:42.583107 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee46d438-f679-4e16-9123-77e3a2591aaf None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:42.626744 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03b4d3-5f80-484f-8733-a117dae7b121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:42.627558 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03b4d3-5f80-484f-8733-a117dae7b121 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:42.627987 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03b4d3-5f80-484f-8733-a117dae7b121 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:42.628263 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03b4d3-5f80-484f-8733-a117dae7b121 None admin] PATH_INFO: `/v3/services/network` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:42.629613 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03b4d3-5f80-484f-8733-a117dae7b121 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:42.630974 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03b4d3-5f80-484f-8733-a117dae7b121 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:42.641989 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-9d03b4d3-5f80-484f-8733-a117dae7b121 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Mar 08 13:39:42.643494 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 410/820] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:42 2022] GET /identity/v3/services/network => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:42.644271 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03b4d3-5f80-484f-8733-a117dae7b121 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:42.679562 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056c8b7-44e7-4faa-9636-a0eec438e370 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:42.713053 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f933a-80f5-4cec-bda6-9000f31c85f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:42.713675 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f933a-80f5-4cec-bda6-9000f31c85f6 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:42.713955 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f933a-80f5-4cec-bda6-9000f31c85f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:42.714288 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f933a-80f5-4cec-bda6-9000f31c85f6 None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:42.715073 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f933a-80f5-4cec-bda6-9000f31c85f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:42.715474 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f933a-80f5-4cec-bda6-9000f31c85f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:42.716928 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f933a-80f5-4cec-bda6-9000f31c85f6 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:42.729393 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 411/821] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:39:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:42.730263 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f933a-80f5-4cec-bda6-9000f31c85f6 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:42.742402 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03b4d3-5f80-484f-8733-a117dae7b121 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:42.775486 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03568636-6565-4248-8631-3074d43b5ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:42.776298 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03568636-6565-4248-8631-3074d43b5ee8 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:42.776579 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03568636-6565-4248-8631-3074d43b5ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:42.776851 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03568636-6565-4248-8631-3074d43b5ee8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:42.784724 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03568636-6565-4248-8631-3074d43b5ee8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:42.786190 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03568636-6565-4248-8631-3074d43b5ee8 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:42.799674 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-03568636-6565-4248-8631-3074d43b5ee8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 13:39:42.801132 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 411/822] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Mar 8 13:39:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:42.801986 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03568636-6565-4248-8631-3074d43b5ee8 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:42.829775 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f933a-80f5-4cec-bda6-9000f31c85f6 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:42.864319 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7683e-3622-40e2-8505-b6eb093037d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:42.865024 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7683e-3622-40e2-8505-b6eb093037d3 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:42.865306 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7683e-3622-40e2-8505-b6eb093037d3 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:42.865605 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7683e-3622-40e2-8505-b6eb093037d3 None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:42.866359 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7683e-3622-40e2-8505-b6eb093037d3 None admin] RBAC: Adding query filter params (name=network) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:42.866667 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7683e-3622-40e2-8505-b6eb093037d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:42.868042 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7683e-3622-40e2-8505-b6eb093037d3 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:42.873012 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 412/823] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Mar 8 13:39:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:42.873895 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7683e-3622-40e2-8505-b6eb093037d3 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:42.897720 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03568636-6565-4248-8631-3074d43b5ee8 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:42.932427 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accfd54-05d0-4c04-b55a-19197f27cc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:42.933706 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accfd54-05d0-4c04-b55a-19197f27cc62 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:42.937377 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accfd54-05d0-4c04-b55a-19197f27cc62 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:42.937377 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accfd54-05d0-4c04-b55a-19197f27cc62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:42.937377 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accfd54-05d0-4c04-b55a-19197f27cc62 None admin] RBAC: Adding query filter params (role.id=fc021ed5870a44f5a0f0b8fff994d6f0, scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e, user.id=21ec894123044d4382995791c74c587b) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:42.937377 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accfd54-05d0-4c04-b55a-19197f27cc62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:42.937969 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3accfd54-05d0-4c04-b55a-19197f27cc62 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:42.945900 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 412/824] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:39:42 2022] GET /identity/v3/role_assignments?user.id=21ec894123044d4382995791c74c587b&scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e&role.id=fc021ed5870a44f5a0f0b8fff994d6f0 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:42.946713 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accfd54-05d0-4c04-b55a-19197f27cc62 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:42.973791 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7683e-3622-40e2-8505-b6eb093037d3 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:43.010076 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889aac3-88df-405c-b025-551e84706cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:43.010776 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889aac3-88df-405c-b025-551e84706cf4 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:43.011052 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889aac3-88df-405c-b025-551e84706cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:43.011327 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889aac3-88df-405c-b025-551e84706cf4 None admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:43.012252 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889aac3-88df-405c-b025-551e84706cf4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:43.012569 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889aac3-88df-405c-b025-551e84706cf4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:43.014175 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889aac3-88df-405c-b025-551e84706cf4 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:43.033764 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 413/825] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Mar 8 13:39:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:43.044868 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889aac3-88df-405c-b025-551e84706cf4 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:43.072243 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accfd54-05d0-4c04-b55a-19197f27cc62 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:43.113525 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922a506-e571-46c7-996e-c7012137adcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:43.114201 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922a506-e571-46c7-996e-c7012137adcc None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:43.114485 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922a506-e571-46c7-996e-c7012137adcc None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:43.114759 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922a506-e571-46c7-996e-c7012137adcc None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:43.115480 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922a506-e571-46c7-996e-c7012137adcc None admin] RBAC: Adding query filter params (type=network) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:43.115783 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922a506-e571-46c7-996e-c7012137adcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:43.125417 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922a506-e571-46c7-996e-c7012137adcc None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:43.132136 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 413/826] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Mar 8 13:39:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:43.138172 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922a506-e571-46c7-996e-c7012137adcc None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:43.205967 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889aac3-88df-405c-b025-551e84706cf4 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:43.239538 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ecd4d5-7818-4700-a73f-6d2c56f881c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:43.240261 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecd4d5-7818-4700-a73f-6d2c56f881c6 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:43.240540 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecd4d5-7818-4700-a73f-6d2c56f881c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:43.240815 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ecd4d5-7818-4700-a73f-6d2c56f881c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:43.251147 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ecd4d5-7818-4700-a73f-6d2c56f881c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:43.252607 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ecd4d5-7818-4700-a73f-6d2c56f881c6 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:43.269212 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-a1ecd4d5-7818-4700-a73f-6d2c56f881c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:43.269437 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922a506-e571-46c7-996e-c7012137adcc None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:43.270439 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 414/827] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:43.275917 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ecd4d5-7818-4700-a73f-6d2c56f881c6 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:43.305758 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c048b8-3d35-44b0-8087-15085ed7ae6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:43.306425 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c048b8-3d35-44b0-8087-15085ed7ae6e None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:43.306704 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c048b8-3d35-44b0-8087-15085ed7ae6e None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:43.306973 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c048b8-3d35-44b0-8087-15085ed7ae6e None admin] PATH_INFO: `/v3/endpoints` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:43.307723 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c048b8-3d35-44b0-8087-15085ed7ae6e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:43.309158 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c048b8-3d35-44b0-8087-15085ed7ae6e None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:43.334196 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 414/828] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Mar 8 13:39:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:39:43.387519 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ecd4d5-7818-4700-a73f-6d2c56f881c6 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:43.440904 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94f475-0c42-4819-b79e-87c62aeb38c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:43.441941 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94f475-0c42-4819-b79e-87c62aeb38c6 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:43.442356 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94f475-0c42-4819-b79e-87c62aeb38c6 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:43.442786 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94f475-0c42-4819-b79e-87c62aeb38c6 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:43.443682 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94f475-0c42-4819-b79e-87c62aeb38c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:43.444168 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94f475-0c42-4819-b79e-87c62aeb38c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:43.445746 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94f475-0c42-4819-b79e-87c62aeb38c6 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:43.458573 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 415/829] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:43.463984 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c048b8-3d35-44b0-8087-15085ed7ae6e None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:43.630448 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c048b8-3d35-44b0-8087-15085ed7ae6e None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:43.675545 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe8763-35bf-421b-82ea-766d42ad23a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:43.676554 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe8763-35bf-421b-82ea-766d42ad23a4 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:43.676922 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe8763-35bf-421b-82ea-766d42ad23a4 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:43.677288 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe8763-35bf-421b-82ea-766d42ad23a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:43.688415 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe8763-35bf-421b-82ea-766d42ad23a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:43.690051 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe8763-35bf-421b-82ea-766d42ad23a4 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:43.708599 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-fffe8763-35bf-421b-82ea-766d42ad23a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:43.710332 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 415/830] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:43.716608 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94f475-0c42-4819-b79e-87c62aeb38c6 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:43.825208 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94f475-0c42-4819-b79e-87c62aeb38c6 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:43.862290 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a640287-9dcb-45d4-88b8-3b2798a1be97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:43.863312 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a640287-9dcb-45d4-88b8-3b2798a1be97 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:43.863788 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a640287-9dcb-45d4-88b8-3b2798a1be97 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:43.864286 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a640287-9dcb-45d4-88b8-3b2798a1be97 None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:43.865269 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a640287-9dcb-45d4-88b8-3b2798a1be97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:43.865798 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a640287-9dcb-45d4-88b8-3b2798a1be97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:43.867429 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a640287-9dcb-45d4-88b8-3b2798a1be97 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:43.880376 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 416/831] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:39:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:43.889373 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe8763-35bf-421b-82ea-766d42ad23a4 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:43.945284 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45167f3-7c5a-46ec-85d6-4fb0ffb4210e None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:43.945926 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45167f3-7c5a-46ec-85d6-4fb0ffb4210e None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:43.946393 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45167f3-7c5a-46ec-85d6-4fb0ffb4210e None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:43.948670 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 417/832] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:39:43.953382 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ef987-5b3b-43a8-a9a8-c3bc8822876b None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:43.953911 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ef987-5b3b-43a8-a9a8-c3bc8822876b None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:43.954386 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ef987-5b3b-43a8-a9a8-c3bc8822876b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:43.972039 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-901ef987-5b3b-43a8-a9a8-c3bc8822876b None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:43.973558 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-901ef987-5b3b-43a8-a9a8-c3bc8822876b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:43.989634 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe8763-35bf-421b-82ea-766d42ad23a4 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:44.024148 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbd84d-f0e7-462c-a1a6-a6ae55e9c260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:44.025043 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbd84d-f0e7-462c-a1a6-a6ae55e9c260 None admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:44.025325 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbd84d-f0e7-462c-a1a6-a6ae55e9c260 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:44.025626 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fbd84d-f0e7-462c-a1a6-a6ae55e9c260 None admin] PATH_INFO: `/v3/projects/7d693fb3e9fc4d82a0ed054f31f1e56e/users/817bcd2c5f6e4bceb049eeb122d4e432/roles/5189c0e028ff42908ca943fdb5ce1873` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:44.044756 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fbd84d-f0e7-462c-a1a6-a6ae55e9c260 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d693fb3e9fc4d82a0ed054f31f1e56e, user_id=817bcd2c5f6e4bceb049eeb122d4e432, role_id=5189c0e028ff42908ca943fdb5ce1873)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:44.046225 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fbd84d-f0e7-462c-a1a6-a6ae55e9c260 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:44.048083 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 418/833] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:39:44.063693 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 416/834] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Mar 8 13:39:43 2022] PUT /identity/v3/projects/7d693fb3e9fc4d82a0ed054f31f1e56e/users/817bcd2c5f6e4bceb049eeb122d4e432/roles/5189c0e028ff42908ca943fdb5ce1873 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:39:44.076175 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ef987-5b3b-43a8-a9a8-c3bc8822876b None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:44.181193 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ef987-5b3b-43a8-a9a8-c3bc8822876b None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:44.221822 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf1ff0-1326-41f0-8102-b2bb1e7e08d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:44.222638 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf1ff0-1326-41f0-8102-b2bb1e7e08d4 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:44.222921 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf1ff0-1326-41f0-8102-b2bb1e7e08d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:44.223195 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf1ff0-1326-41f0-8102-b2bb1e7e08d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:44.235613 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf1ff0-1326-41f0-8102-b2bb1e7e08d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:44.242727 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-5bbf1ff0-1326-41f0-8102-b2bb1e7e08d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:39:44.244334 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 419/835] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:39:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:44.250269 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbd84d-f0e7-462c-a1a6-a6ae55e9c260 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:44.357656 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fbd84d-f0e7-462c-a1a6-a6ae55e9c260 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:44.394155 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8ecd9-231a-4bc9-91f8-7f514f157e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:44.394840 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8ecd9-231a-4bc9-91f8-7f514f157e52 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:44.395119 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8ecd9-231a-4bc9-91f8-7f514f157e52 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:44.395393 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8ecd9-231a-4bc9-91f8-7f514f157e52 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:44.396168 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8ecd9-231a-4bc9-91f8-7f514f157e52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:44.396470 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8ecd9-231a-4bc9-91f8-7f514f157e52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:44.397931 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8ecd9-231a-4bc9-91f8-7f514f157e52 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:44.408085 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 417/836] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:39:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:44.413622 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf1ff0-1326-41f0-8102-b2bb1e7e08d4 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:44.512576 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf1ff0-1326-41f0-8102-b2bb1e7e08d4 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:44.546669 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a16b55-8f89-4385-be0a-3cb367e310a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:44.547464 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a16b55-8f89-4385-be0a-3cb367e310a9 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:44.547851 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a16b55-8f89-4385-be0a-3cb367e310a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:44.548135 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a16b55-8f89-4385-be0a-3cb367e310a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:44.558602 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a16b55-8f89-4385-be0a-3cb367e310a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:44.560088 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a16b55-8f89-4385-be0a-3cb367e310a9 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:44.576135 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-b9a16b55-8f89-4385-be0a-3cb367e310a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:44.577510 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 420/837] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:39:44.583305 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8ecd9-231a-4bc9-91f8-7f514f157e52 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:44.679940 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8ecd9-231a-4bc9-91f8-7f514f157e52 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:44.712572 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d9b46-035e-4e88-b60f-8b9b71daffb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:44.713226 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d9b46-035e-4e88-b60f-8b9b71daffb4 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:44.713535 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d9b46-035e-4e88-b60f-8b9b71daffb4 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:44.713811 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d9b46-035e-4e88-b60f-8b9b71daffb4 None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:44.714540 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d9b46-035e-4e88-b60f-8b9b71daffb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:44.714843 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d9b46-035e-4e88-b60f-8b9b71daffb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:44.716259 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d9b46-035e-4e88-b60f-8b9b71daffb4 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:44.728114 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 418/838] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:44.733628 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a16b55-8f89-4385-be0a-3cb367e310a9 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:44.791934 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453304f-bd0f-45b5-b0f6-4a8d48e07e49 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:44.792240 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453304f-bd0f-45b5-b0f6-4a8d48e07e49 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:44.792485 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453304f-bd0f-45b5-b0f6-4a8d48e07e49 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:44.795282 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 419/839] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:39:44.803747 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0379d-c00d-425e-b117-7effd6facc2f None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:44.804291 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0379d-c00d-425e-b117-7effd6facc2f None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:44.804762 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0379d-c00d-425e-b117-7effd6facc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:44.821947 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-96f0379d-c00d-425e-b117-7effd6facc2f None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:44.823449 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-96f0379d-c00d-425e-b117-7effd6facc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:44.839097 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a16b55-8f89-4385-be0a-3cb367e310a9 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:44.871895 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ad811-cd5e-4d83-90cc-cac50942e412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:44.872676 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ad811-cd5e-4d83-90cc-cac50942e412 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:44.872955 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ad811-cd5e-4d83-90cc-cac50942e412 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:44.873227 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ad811-cd5e-4d83-90cc-cac50942e412 None admin] PATH_INFO: `/v3/users/swift` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:44.881172 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ad811-cd5e-4d83-90cc-cac50942e412 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:44.883167 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ad811-cd5e-4d83-90cc-cac50942e412 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:44.901399 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-c52ad811-cd5e-4d83-90cc-cac50942e412 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Mar 08 13:39:44.901399 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 421/840] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:39:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:39:44.902039 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 420/841] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Mar 08 13:39:44.903739 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ad811-cd5e-4d83-90cc-cac50942e412 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:44.918619 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0379d-c00d-425e-b117-7effd6facc2f None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:45.020080 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ad811-cd5e-4d83-90cc-cac50942e412 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:45.022020 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0379d-c00d-425e-b117-7effd6facc2f None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:45.058654 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371822e-246f-46c3-8895-c673c7d28c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:45.059601 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371822e-246f-46c3-8895-c673c7d28c4d None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:45.059969 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371822e-246f-46c3-8895-c673c7d28c4d None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:45.060432 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371822e-246f-46c3-8895-c673c7d28c4d None admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:45.061567 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371822e-246f-46c3-8895-c673c7d28c4d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:45.061968 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371822e-246f-46c3-8895-c673c7d28c4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:45.062766 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a3f77-801f-457e-9ec1-3cd17eea55a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:45.063592 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371822e-246f-46c3-8895-c673c7d28c4d None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:45.063964 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a3f77-801f-457e-9ec1-3cd17eea55a2 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:45.064412 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a3f77-801f-457e-9ec1-3cd17eea55a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:45.064864 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a3f77-801f-457e-9ec1-3cd17eea55a2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:45.065896 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a3f77-801f-457e-9ec1-3cd17eea55a2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:45.068308 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a3f77-801f-457e-9ec1-3cd17eea55a2 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:45.081673 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-cd5a3f77-801f-457e-9ec1-3cd17eea55a2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 08 13:39:45.085395 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 422/842] 10.222.0.18 () {56 vars in 1135 bytes} [Tue Mar 8 13:39:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:45.089417 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 421/843] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Mar 8 13:39:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:45.090369 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371822e-246f-46c3-8895-c673c7d28c4d None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:45.091620 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a3f77-801f-457e-9ec1-3cd17eea55a2 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:45.191870 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371822e-246f-46c3-8895-c673c7d28c4d None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:45.209870 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a3f77-801f-457e-9ec1-3cd17eea55a2 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:45.226418 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf0a9d-fbdb-434c-a9e1-9bebb387ffbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:45.227765 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf0a9d-fbdb-434c-a9e1-9bebb387ffbb None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:45.228257 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf0a9d-fbdb-434c-a9e1-9bebb387ffbb None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:45.228723 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf0a9d-fbdb-434c-a9e1-9bebb387ffbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:45.243330 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78438144-fef2-413d-9713-c6ce2cfd84cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:45.244015 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78438144-fef2-413d-9713-c6ce2cfd84cf None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:45.244298 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78438144-fef2-413d-9713-c6ce2cfd84cf None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:45.244575 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78438144-fef2-413d-9713-c6ce2cfd84cf None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:45.245309 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78438144-fef2-413d-9713-c6ce2cfd84cf None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:45.245674 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78438144-fef2-413d-9713-c6ce2cfd84cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:45.247122 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78438144-fef2-413d-9713-c6ce2cfd84cf None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:45.257150 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 422/844] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Mar 8 13:39:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:45.258159 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78438144-fef2-413d-9713-c6ce2cfd84cf None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:45.302482 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf0a9d-fbdb-434c-a9e1-9bebb387ffbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:45.304318 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf0a9d-fbdb-434c-a9e1-9bebb387ffbb None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:45.358583 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78438144-fef2-413d-9713-c6ce2cfd84cf None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:45.392562 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56620251-31c9-40a8-aa94-3454f13929f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:45.393227 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56620251-31c9-40a8-aa94-3454f13929f6 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:45.393551 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56620251-31c9-40a8-aa94-3454f13929f6 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:45.393826 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56620251-31c9-40a8-aa94-3454f13929f6 None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:45.394537 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56620251-31c9-40a8-aa94-3454f13929f6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:45.394841 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56620251-31c9-40a8-aa94-3454f13929f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:45.396192 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56620251-31c9-40a8-aa94-3454f13929f6 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:45.400955 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 423/845] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Mar 8 13:39:45 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:45.413701 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 423/846] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:39:45 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:39:45.415592 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56620251-31c9-40a8-aa94-3454f13929f6 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:45.534067 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56620251-31c9-40a8-aa94-3454f13929f6 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:45.569564 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111a082-ad16-4d4f-b150-f7c67e8c3f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:45.570301 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111a082-ad16-4d4f-b150-f7c67e8c3f8c None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:45.570580 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111a082-ad16-4d4f-b150-f7c67e8c3f8c None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:45.570856 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111a082-ad16-4d4f-b150-f7c67e8c3f8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:45.583986 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111a082-ad16-4d4f-b150-f7c67e8c3f8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:45.585491 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111a082-ad16-4d4f-b150-f7c67e8c3f8c None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:45.603205 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-b111a082-ad16-4d4f-b150-f7c67e8c3f8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:45.604872 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 424/847] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:39:45.610578 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf0a9d-fbdb-434c-a9e1-9bebb387ffbb None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:45.713554 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf0a9d-fbdb-434c-a9e1-9bebb387ffbb None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:45.722439 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d1f81-2f15-408d-8833-a95b59e7c53d None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:45.722716 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d1f81-2f15-408d-8833-a95b59e7c53d None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:45.723090 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d1f81-2f15-408d-8833-a95b59e7c53d None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:45.726165 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 425/848] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:39:45.731439 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb382ba9-9bd6-40de-8643-473cac24a6b3 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:45.731718 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb382ba9-9bd6-40de-8643-473cac24a6b3 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:45.731990 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb382ba9-9bd6-40de-8643-473cac24a6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:45.750248 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cd858-debe-4c34-be36-8a74fb14cc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:45.750735 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-fb382ba9-9bd6-40de-8643-473cac24a6b3 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:45.751519 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cd858-debe-4c34-be36-8a74fb14cc55 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:45.751926 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-fb382ba9-9bd6-40de-8643-473cac24a6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:45.752196 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cd858-debe-4c34-be36-8a74fb14cc55 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:45.752655 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cd858-debe-4c34-be36-8a74fb14cc55 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:45.753587 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cd858-debe-4c34-be36-8a74fb14cc55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:45.754103 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cd858-debe-4c34-be36-8a74fb14cc55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:45.755664 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cd858-debe-4c34-be36-8a74fb14cc55 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:45.767672 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 424/849] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:45.773948 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cd858-debe-4c34-be36-8a74fb14cc55 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:45.829557 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 426/850] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:39:45.844982 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb382ba9-9bd6-40de-8643-473cac24a6b3 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:45.891354 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cd858-debe-4c34-be36-8a74fb14cc55 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:45.934068 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff453aff-b637-4223-b4db-261a9fca5c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:45.935551 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff453aff-b637-4223-b4db-261a9fca5c16 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:45.936232 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff453aff-b637-4223-b4db-261a9fca5c16 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:45.936678 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff453aff-b637-4223-b4db-261a9fca5c16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:45.943641 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb382ba9-9bd6-40de-8643-473cac24a6b3 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:45.945023 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff453aff-b637-4223-b4db-261a9fca5c16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:45.947496 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff453aff-b637-4223-b4db-261a9fca5c16 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:45.963728 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-ff453aff-b637-4223-b4db-261a9fca5c16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:45.969419 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 425/851] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:45.971375 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff453aff-b637-4223-b4db-261a9fca5c16 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:45.983674 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743ceb6-5762-4d32-a644-b6374fa8c9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:45.984484 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743ceb6-5762-4d32-a644-b6374fa8c9aa None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:45.984759 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743ceb6-5762-4d32-a644-b6374fa8c9aa None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:45.985085 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743ceb6-5762-4d32-a644-b6374fa8c9aa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:45.985775 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743ceb6-5762-4d32-a644-b6374fa8c9aa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:45.987226 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743ceb6-5762-4d32-a644-b6374fa8c9aa None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:45.998559 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-b743ceb6-5762-4d32-a644-b6374fa8c9aa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 08 13:39:46.004912 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 427/852] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Mar 8 13:39:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:39:46.006164 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743ceb6-5762-4d32-a644-b6374fa8c9aa None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:46.086786 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff453aff-b637-4223-b4db-261a9fca5c16 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:46.120695 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f54ec-ebec-4557-9046-ee0e9a0ab44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:46.121626 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f54ec-ebec-4557-9046-ee0e9a0ab44f None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:46.121737 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f54ec-ebec-4557-9046-ee0e9a0ab44f None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:46.121935 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f54ec-ebec-4557-9046-ee0e9a0ab44f None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:46.122768 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f54ec-ebec-4557-9046-ee0e9a0ab44f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:46.122997 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f54ec-ebec-4557-9046-ee0e9a0ab44f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:46.124417 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368f54ec-ebec-4557-9046-ee0e9a0ab44f None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:46.128713 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743ceb6-5762-4d32-a644-b6374fa8c9aa None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:46.135803 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 426/853] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:39:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:46.141473 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f54ec-ebec-4557-9046-ee0e9a0ab44f None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:46.170873 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74969257-34d0-4318-9717-a21f03ff9e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:46.172305 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74969257-34d0-4318-9717-a21f03ff9e37 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:46.172736 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74969257-34d0-4318-9717-a21f03ff9e37 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:46.173183 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74969257-34d0-4318-9717-a21f03ff9e37 None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:46.174118 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74969257-34d0-4318-9717-a21f03ff9e37 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:46.174740 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74969257-34d0-4318-9717-a21f03ff9e37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:46.177106 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74969257-34d0-4318-9717-a21f03ff9e37 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:46.183109 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 428/854] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Mar 8 13:39:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:46.188773 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74969257-34d0-4318-9717-a21f03ff9e37 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:46.245135 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f54ec-ebec-4557-9046-ee0e9a0ab44f None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:46.285392 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064050b4-9f08-4638-b1e3-5ece9e9a8412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:46.286508 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064050b4-9f08-4638-b1e3-5ece9e9a8412 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:46.286872 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064050b4-9f08-4638-b1e3-5ece9e9a8412 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:46.287298 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064050b4-9f08-4638-b1e3-5ece9e9a8412 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:46.288560 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064050b4-9f08-4638-b1e3-5ece9e9a8412 None admin] RBAC: Adding query filter params (role.id=fc021ed5870a44f5a0f0b8fff994d6f0, scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e, user.id=5a0f442666d0459aa9a34fc2f91228e9) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:46.288995 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064050b4-9f08-4638-b1e3-5ece9e9a8412 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:46.290892 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064050b4-9f08-4638-b1e3-5ece9e9a8412 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:46.295841 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74969257-34d0-4318-9717-a21f03ff9e37 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:46.305898 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 427/855] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:39:46 2022] GET /identity/v3/role_assignments?user.id=5a0f442666d0459aa9a34fc2f91228e9&scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e&role.id=fc021ed5870a44f5a0f0b8fff994d6f0 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:46.333691 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732a371-59bd-477b-9bbd-824c066a8c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:46.334380 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732a371-59bd-477b-9bbd-824c066a8c3b None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:46.334656 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732a371-59bd-477b-9bbd-824c066a8c3b None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:46.334928 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732a371-59bd-477b-9bbd-824c066a8c3b None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:46.335650 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732a371-59bd-477b-9bbd-824c066a8c3b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:46.335951 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732a371-59bd-477b-9bbd-824c066a8c3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:46.337499 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732a371-59bd-477b-9bbd-824c066a8c3b None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:46.343152 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 429/856] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Mar 8 13:39:46 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:46.427664 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e309e-2c55-4f86-a80a-b73cab24c49e None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:46.428370 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e309e-2c55-4f86-a80a-b73cab24c49e None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:46.428855 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e309e-2c55-4f86-a80a-b73cab24c49e None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:46.431473 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 428/857] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:46.437818 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88470b-d816-4687-9b20-873e2950df38 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:46.438132 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88470b-d816-4687-9b20-873e2950df38 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:46.438372 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b88470b-d816-4687-9b20-873e2950df38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:46.460923 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-3b88470b-d816-4687-9b20-873e2950df38 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:46.462155 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-3b88470b-d816-4687-9b20-873e2950df38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:46.539142 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 430/858] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:39:46.562307 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e309e-2c55-4f86-a80a-b73cab24c49e None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:46.667720 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e309e-2c55-4f86-a80a-b73cab24c49e None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:46.701540 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e00ca7-c782-4bc5-afa6-bf92ec6bab39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:46.702393 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e00ca7-c782-4bc5-afa6-bf92ec6bab39 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:46.702672 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e00ca7-c782-4bc5-afa6-bf92ec6bab39 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:46.702946 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e00ca7-c782-4bc5-afa6-bf92ec6bab39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:46.714283 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e00ca7-c782-4bc5-afa6-bf92ec6bab39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:46.721497 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-44e00ca7-c782-4bc5-afa6-bf92ec6bab39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:39:46.723097 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 429/859] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Mar 8 13:39:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:46.728945 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88470b-d816-4687-9b20-873e2950df38 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:46.824392 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b88470b-d816-4687-9b20-873e2950df38 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:46.857317 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c3d98-d974-4a60-90b1-84e8f965cb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:46.858342 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c3d98-d974-4a60-90b1-84e8f965cb7c None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:46.858818 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c3d98-d974-4a60-90b1-84e8f965cb7c None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:46.859284 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c3d98-d974-4a60-90b1-84e8f965cb7c None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:46.860294 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c3d98-d974-4a60-90b1-84e8f965cb7c None admin] RBAC: Adding query filter params (name=service) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:46.860800 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c3d98-d974-4a60-90b1-84e8f965cb7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:46.862435 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c3d98-d974-4a60-90b1-84e8f965cb7c None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:46.870556 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 431/860] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Mar 8 13:39:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:46.876434 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e00ca7-c782-4bc5-afa6-bf92ec6bab39 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:46.973045 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e00ca7-c782-4bc5-afa6-bf92ec6bab39 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:47.005448 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71c302-251f-4830-8eb4-0cf7b0d00886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:47.006241 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71c302-251f-4830-8eb4-0cf7b0d00886 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:47.006526 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71c302-251f-4830-8eb4-0cf7b0d00886 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:47.006793 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71c302-251f-4830-8eb4-0cf7b0d00886 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:47.016684 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71c302-251f-4830-8eb4-0cf7b0d00886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:47.018151 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71c302-251f-4830-8eb4-0cf7b0d00886 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:47.034850 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-1e71c302-251f-4830-8eb4-0cf7b0d00886 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:47.036477 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 430/861] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:47.042266 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c3d98-d974-4a60-90b1-84e8f965cb7c None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:47.140553 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c3d98-d974-4a60-90b1-84e8f965cb7c None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:47.174618 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c42fc-cfe2-4eb5-8b2f-20bbe251c0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:47.175661 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c42fc-cfe2-4eb5-8b2f-20bbe251c0ca None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:47.176137 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c42fc-cfe2-4eb5-8b2f-20bbe251c0ca None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:47.176598 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c42fc-cfe2-4eb5-8b2f-20bbe251c0ca None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:47.177640 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c42fc-cfe2-4eb5-8b2f-20bbe251c0ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:47.178141 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c42fc-cfe2-4eb5-8b2f-20bbe251c0ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:47.179749 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c42fc-cfe2-4eb5-8b2f-20bbe251c0ca None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:47.194550 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 432/862] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:47.201577 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71c302-251f-4830-8eb4-0cf7b0d00886 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:47.302443 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71c302-251f-4830-8eb4-0cf7b0d00886 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:47.335136 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbebcd-e03a-4036-9fd6-2edd1fcf17c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:47.335949 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbebcd-e03a-4036-9fd6-2edd1fcf17c4 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:47.336227 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbebcd-e03a-4036-9fd6-2edd1fcf17c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:47.336499 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbebcd-e03a-4036-9fd6-2edd1fcf17c4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:47.344185 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbebcd-e03a-4036-9fd6-2edd1fcf17c4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:47.345659 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbebcd-e03a-4036-9fd6-2edd1fcf17c4 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:47.359464 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-49cbebcd-e03a-4036-9fd6-2edd1fcf17c4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 13:39:47.361029 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 431/863] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Mar 8 13:39:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:47.366531 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c42fc-cfe2-4eb5-8b2f-20bbe251c0ca None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:47.472135 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c42fc-cfe2-4eb5-8b2f-20bbe251c0ca None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:47.508817 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c34f80-1b87-48cc-93e3-edc0d1ecd1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:47.509803 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c34f80-1b87-48cc-93e3-edc0d1ecd1b7 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:47.510284 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c34f80-1b87-48cc-93e3-edc0d1ecd1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:47.510775 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c34f80-1b87-48cc-93e3-edc0d1ecd1b7 None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:47.511881 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c34f80-1b87-48cc-93e3-edc0d1ecd1b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:47.512400 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c34f80-1b87-48cc-93e3-edc0d1ecd1b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:47.514123 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c34f80-1b87-48cc-93e3-edc0d1ecd1b7 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:47.535520 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 433/864] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Mar 8 13:39:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:47.541384 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbebcd-e03a-4036-9fd6-2edd1fcf17c4 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:47.642111 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbebcd-e03a-4036-9fd6-2edd1fcf17c4 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:47.675534 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5690d-eae5-4040-a3e5-e37bece25a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:47.676181 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5690d-eae5-4040-a3e5-e37bece25a22 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:47.676461 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5690d-eae5-4040-a3e5-e37bece25a22 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:47.676729 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5690d-eae5-4040-a3e5-e37bece25a22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:47.741723 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5690d-eae5-4040-a3e5-e37bece25a22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:47.743176 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5690d-eae5-4040-a3e5-e37bece25a22 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:47.798985 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230bfac-6e98-42a1-b481-2cd752bcbfb1 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:47.799601 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230bfac-6e98-42a1-b481-2cd752bcbfb1 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:47.800098 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230bfac-6e98-42a1-b481-2cd752bcbfb1 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:47.802382 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 434/865] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:47.807074 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013592f-c680-49b7-8899-41714487566a None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:47.807354 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013592f-c680-49b7-8899-41714487566a None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:47.807632 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013592f-c680-49b7-8899-41714487566a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:47.825218 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-d013592f-c680-49b7-8899-41714487566a None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:47.826408 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-d013592f-c680-49b7-8899-41714487566a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:47.844161 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 432/866] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:39:47 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:39:47.849315 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5690d-eae5-4040-a3e5-e37bece25a22 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:47.917854 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 435/867] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:39:47.941433 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013592f-c680-49b7-8899-41714487566a None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:47.958598 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5690d-eae5-4040-a3e5-e37bece25a22 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:48.001446 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf5819-6bd5-4a6d-b3c6-2d614129d798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:48.002566 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf5819-6bd5-4a6d-b3c6-2d614129d798 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:48.002909 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf5819-6bd5-4a6d-b3c6-2d614129d798 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:48.003243 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf5819-6bd5-4a6d-b3c6-2d614129d798 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:48.014643 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf5819-6bd5-4a6d-b3c6-2d614129d798 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:48.016426 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf5819-6bd5-4a6d-b3c6-2d614129d798 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:48.034157 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-3fdf5819-6bd5-4a6d-b3c6-2d614129d798 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:48.036076 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 433/868] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:48.042029 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf5819-6bd5-4a6d-b3c6-2d614129d798 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:48.046742 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013592f-c680-49b7-8899-41714487566a None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:48.088450 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4ee40-868e-45c9-99fb-17b906c47536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:48.089166 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4ee40-868e-45c9-99fb-17b906c47536 None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:48.089497 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4ee40-868e-45c9-99fb-17b906c47536 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:48.089926 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4ee40-868e-45c9-99fb-17b906c47536 None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:48.091015 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4ee40-868e-45c9-99fb-17b906c47536 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:48.092720 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4ee40-868e-45c9-99fb-17b906c47536 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:48.110081 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 436/869] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Mar 8 13:39:47 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:39:48.157486 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf5819-6bd5-4a6d-b3c6-2d614129d798 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:48.203764 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff753c-c56e-4eca-9213-c87cc9e8710e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:48.204755 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff753c-c56e-4eca-9213-c87cc9e8710e None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:48.205226 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff753c-c56e-4eca-9213-c87cc9e8710e None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:48.205662 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff753c-c56e-4eca-9213-c87cc9e8710e None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:48.206583 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff753c-c56e-4eca-9213-c87cc9e8710e None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:48.207052 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff753c-c56e-4eca-9213-c87cc9e8710e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:48.208668 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff753c-c56e-4eca-9213-c87cc9e8710e None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:48.222248 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 434/870] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:48.229951 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4ee40-868e-45c9-99fb-17b906c47536 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:48.330446 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4ee40-868e-45c9-99fb-17b906c47536 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:48.366620 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cb63d-12c0-4d3d-ae54-6839cd1506ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:48.367417 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cb63d-12c0-4d3d-ae54-6839cd1506ff None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:48.367691 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cb63d-12c0-4d3d-ae54-6839cd1506ff None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:48.367953 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5cb63d-12c0-4d3d-ae54-6839cd1506ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:48.375020 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5cb63d-12c0-4d3d-ae54-6839cd1506ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:48.376482 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5cb63d-12c0-4d3d-ae54-6839cd1506ff None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:48.389908 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-ac5cb63d-12c0-4d3d-ae54-6839cd1506ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:48.391572 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 437/871] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:48.397167 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff753c-c56e-4eca-9213-c87cc9e8710e None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:48.502348 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff753c-c56e-4eca-9213-c87cc9e8710e None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:48.538361 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bc211-2b2e-423a-96b8-49fa7fa655f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:48.539333 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bc211-2b2e-423a-96b8-49fa7fa655f1 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:48.539784 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bc211-2b2e-423a-96b8-49fa7fa655f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:48.540273 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bc211-2b2e-423a-96b8-49fa7fa655f1 None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:48.541294 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21bc211-2b2e-423a-96b8-49fa7fa655f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:48.541798 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21bc211-2b2e-423a-96b8-49fa7fa655f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:48.543505 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21bc211-2b2e-423a-96b8-49fa7fa655f1 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:48.557509 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 435/872] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:39:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:48.569377 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cb63d-12c0-4d3d-ae54-6839cd1506ff None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:48.658085 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5cb63d-12c0-4d3d-ae54-6839cd1506ff None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:48.691079 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5a767-7dc0-4b26-a994-61176813408a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:48.691732 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5a767-7dc0-4b26-a994-61176813408a None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:48.692013 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5a767-7dc0-4b26-a994-61176813408a None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:48.692288 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5a767-7dc0-4b26-a994-61176813408a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:48.693121 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5a767-7dc0-4b26-a994-61176813408a None admin] RBAC: Adding query filter params (role.id=5189c0e028ff42908ca943fdb5ce1873, scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e, user.id=817bcd2c5f6e4bceb049eeb122d4e432) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:48.693532 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5a767-7dc0-4b26-a994-61176813408a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:48.694949 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5a767-7dc0-4b26-a994-61176813408a None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:48.701222 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 438/873] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:39:48 2022] GET /identity/v3/role_assignments?user.id=817bcd2c5f6e4bceb049eeb122d4e432&scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e&role.id=5189c0e028ff42908ca943fdb5ce1873 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:48.724669 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81aaeb5-d4d7-4cc7-a581-2d94dcd79b0f None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:48.725461 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81aaeb5-d4d7-4cc7-a581-2d94dcd79b0f None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:48.725931 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81aaeb5-d4d7-4cc7-a581-2d94dcd79b0f None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:48.729476 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 436/874] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:48.734796 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36598511-70a4-4c67-8a63-d417e5ec9d1c None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:48.735115 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36598511-70a4-4c67-8a63-d417e5ec9d1c None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:48.735346 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36598511-70a4-4c67-8a63-d417e5ec9d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:48.753131 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-36598511-70a4-4c67-8a63-d417e5ec9d1c None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:48.754305 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-36598511-70a4-4c67-8a63-d417e5ec9d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:48.825989 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 439/875] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:39:48.848411 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81aaeb5-d4d7-4cc7-a581-2d94dcd79b0f None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:48.864753 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569723c7-e8d1-47a4-88f3-b7f90da5ce3c None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:48.865086 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569723c7-e8d1-47a4-88f3-b7f90da5ce3c None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:48.865497 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569723c7-e8d1-47a4-88f3-b7f90da5ce3c None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:48.867438 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 440/876] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:48.873050 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191be162-b1ca-4eff-82b1-6da8f651bb7d None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:48.873337 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191be162-b1ca-4eff-82b1-6da8f651bb7d None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:48.873633 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191be162-b1ca-4eff-82b1-6da8f651bb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:48.891079 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-191be162-b1ca-4eff-82b1-6da8f651bb7d None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:48.892459 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-191be162-b1ca-4eff-82b1-6da8f651bb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:48.971367 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 441/877] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:39:48.980084 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81aaeb5-d4d7-4cc7-a581-2d94dcd79b0f None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:48.997087 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191be162-b1ca-4eff-82b1-6da8f651bb7d None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:49.018110 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00031441-ed77-4102-a000-695c06d2f7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:49.019252 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00031441-ed77-4102-a000-695c06d2f7f1 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:49.019722 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00031441-ed77-4102-a000-695c06d2f7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:49.020201 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00031441-ed77-4102-a000-695c06d2f7f1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:49.021093 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00031441-ed77-4102-a000-695c06d2f7f1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:49.022797 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00031441-ed77-4102-a000-695c06d2f7f1 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:49.035354 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-00031441-ed77-4102-a000-695c06d2f7f1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 08 13:39:49.041489 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 437/878] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Mar 8 13:39:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:49.043754 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00031441-ed77-4102-a000-695c06d2f7f1 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:49.108446 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191be162-b1ca-4eff-82b1-6da8f651bb7d None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:49.152353 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4df6e-608f-4033-b9c7-31d91e9f8918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:49.152938 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4df6e-608f-4033-b9c7-31d91e9f8918 None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:49.153214 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4df6e-608f-4033-b9c7-31d91e9f8918 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:49.153510 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f4df6e-608f-4033-b9c7-31d91e9f8918 None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:49.154326 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4df6e-608f-4033-b9c7-31d91e9f8918 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:49.155939 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f4df6e-608f-4033-b9c7-31d91e9f8918 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:49.164321 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00031441-ed77-4102-a000-695c06d2f7f1 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:49.172076 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 442/879] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Mar 8 13:39:48 2022] POST /identity/v3/services => generated 269 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:39:49.212716 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20deb8c5-323e-484e-bf98-61fd1f30d82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:49.213708 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20deb8c5-323e-484e-bf98-61fd1f30d82f None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:49.214186 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20deb8c5-323e-484e-bf98-61fd1f30d82f None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:49.214597 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20deb8c5-323e-484e-bf98-61fd1f30d82f None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:49.215570 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20deb8c5-323e-484e-bf98-61fd1f30d82f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:49.216042 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20deb8c5-323e-484e-bf98-61fd1f30d82f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:49.217664 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20deb8c5-323e-484e-bf98-61fd1f30d82f None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:49.228459 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 438/880] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Mar 8 13:39:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:49.230800 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4df6e-608f-4033-b9c7-31d91e9f8918 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:49.341850 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f4df6e-608f-4033-b9c7-31d91e9f8918 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:49.379949 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840da9e4-e408-4e7b-8af2-8bb97a083614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:49.380640 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840da9e4-e408-4e7b-8af2-8bb97a083614 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:49.380923 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840da9e4-e408-4e7b-8af2-8bb97a083614 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:49.381197 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840da9e4-e408-4e7b-8af2-8bb97a083614 None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:49.381970 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840da9e4-e408-4e7b-8af2-8bb97a083614 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:49.382285 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840da9e4-e408-4e7b-8af2-8bb97a083614 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:49.383630 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840da9e4-e408-4e7b-8af2-8bb97a083614 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:49.388690 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 443/881] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Mar 8 13:39:49 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:50.496036 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8916ae1-9652-42e8-bf62-d64f12880dbb None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:50.496672 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8916ae1-9652-42e8-bf62-d64f12880dbb None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:50.496672 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8916ae1-9652-42e8-bf62-d64f12880dbb None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:50.498830 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 439/882] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:50.504760 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b55cb0-7851-453d-b535-e219c5eb7ee6 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:50.505217 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b55cb0-7851-453d-b535-e219c5eb7ee6 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:50.505313 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b55cb0-7851-453d-b535-e219c5eb7ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:50.523394 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-85b55cb0-7851-453d-b535-e219c5eb7ee6 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:50.524588 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-85b55cb0-7851-453d-b535-e219c5eb7ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:50.590366 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 444/883] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:39:50.613124 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8916ae1-9652-42e8-bf62-d64f12880dbb None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:50.710208 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8916ae1-9652-42e8-bf62-d64f12880dbb None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:50.742361 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe36f0e-faba-4191-b3ad-74af56cb9bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:50.743159 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe36f0e-faba-4191-b3ad-74af56cb9bcb None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:50.743443 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe36f0e-faba-4191-b3ad-74af56cb9bcb None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:50.743717 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe36f0e-faba-4191-b3ad-74af56cb9bcb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:50.744372 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe36f0e-faba-4191-b3ad-74af56cb9bcb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:50.745864 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe36f0e-faba-4191-b3ad-74af56cb9bcb None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:50.756735 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-7fe36f0e-faba-4191-b3ad-74af56cb9bcb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 08 13:39:50.758228 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 440/884] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Mar 8 13:39:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:50.764214 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b55cb0-7851-453d-b535-e219c5eb7ee6 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:50.866343 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b55cb0-7851-453d-b535-e219c5eb7ee6 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:50.900324 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d2995-a2f6-4170-8118-0ce714e9a0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:50.900990 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d2995-a2f6-4170-8118-0ce714e9a0c7 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:50.901271 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d2995-a2f6-4170-8118-0ce714e9a0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:50.901580 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d2995-a2f6-4170-8118-0ce714e9a0c7 None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:50.902401 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d2995-a2f6-4170-8118-0ce714e9a0c7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:50.902705 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d2995-a2f6-4170-8118-0ce714e9a0c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:50.904073 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d2995-a2f6-4170-8118-0ce714e9a0c7 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:50.909361 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 445/885] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Mar 8 13:39:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:50.915019 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe36f0e-faba-4191-b3ad-74af56cb9bcb None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:51.012851 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe36f0e-faba-4191-b3ad-74af56cb9bcb None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:51.046433 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fe2e4-f6e8-46ea-aac0-d242502be845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:51.047457 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fe2e4-f6e8-46ea-aac0-d242502be845 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:51.047954 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fe2e4-f6e8-46ea-aac0-d242502be845 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:51.048447 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fe2e4-f6e8-46ea-aac0-d242502be845 None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:51.049380 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fe2e4-f6e8-46ea-aac0-d242502be845 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:51.049890 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fe2e4-f6e8-46ea-aac0-d242502be845 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:51.051469 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fe2e4-f6e8-46ea-aac0-d242502be845 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:51.057290 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 441/886] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Mar 8 13:39:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:51.063198 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d2995-a2f6-4170-8118-0ce714e9a0c7 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:51.163547 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d2995-a2f6-4170-8118-0ce714e9a0c7 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:51.200518 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b87cfb-04ce-4d36-9a76-62def594547d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:51.201194 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b87cfb-04ce-4d36-9a76-62def594547d None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:51.201510 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b87cfb-04ce-4d36-9a76-62def594547d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:51.201784 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b87cfb-04ce-4d36-9a76-62def594547d None admin] PATH_INFO: `/v3/endpoints` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:51.202585 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b87cfb-04ce-4d36-9a76-62def594547d None admin] RBAC: Adding query filter params (interface=public, service_id=d1707d5ae3f6438d8305ed6d4ec21fd0, region_id=RegionOne) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:51.202962 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b87cfb-04ce-4d36-9a76-62def594547d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:51.204398 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b87cfb-04ce-4d36-9a76-62def594547d None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:51.210529 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 446/887] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Mar 8 13:39:51 2022] GET /identity/v3/endpoints?service_id=d1707d5ae3f6438d8305ed6d4ec21fd0&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:51.213120 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec4be4-72d3-4878-8b82-f0ee2c56621e None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:51.213656 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec4be4-72d3-4878-8b82-f0ee2c56621e None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:51.214132 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec4be4-72d3-4878-8b82-f0ee2c56621e None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:51.215770 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b87cfb-04ce-4d36-9a76-62def594547d None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:51.220818 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 442/888] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:51.222765 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb1d6e-0af9-477e-be45-d498151d24e7 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:51.223274 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb1d6e-0af9-477e-be45-d498151d24e7 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:51.223736 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb1d6e-0af9-477e-be45-d498151d24e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:51.240922 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-04cb1d6e-0af9-477e-be45-d498151d24e7 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:51.242472 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-04cb1d6e-0af9-477e-be45-d498151d24e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:51.316923 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b87cfb-04ce-4d36-9a76-62def594547d None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:51.317370 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 443/889] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:39:51.337212 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb1d6e-0af9-477e-be45-d498151d24e7 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:51.351283 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4217dc6-e6b9-49e7-9257-c5eb00d0b686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:51.351953 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4217dc6-e6b9-49e7-9257-c5eb00d0b686 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:51.352232 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4217dc6-e6b9-49e7-9257-c5eb00d0b686 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:51.352502 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4217dc6-e6b9-49e7-9257-c5eb00d0b686 None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:51.353187 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4217dc6-e6b9-49e7-9257-c5eb00d0b686 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:51.354580 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4217dc6-e6b9-49e7-9257-c5eb00d0b686 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:51.360534 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 447/890] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Mar 8 13:39:51 2022] GET /identity/v3/services => generated 1268 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:39:51.445114 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb1d6e-0af9-477e-be45-d498151d24e7 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:51.488599 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0ff0d-f78c-497f-8ef0-033a5187dd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:51.489874 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0ff0d-f78c-497f-8ef0-033a5187dd8f None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:51.490367 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0ff0d-f78c-497f-8ef0-033a5187dd8f None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:51.490897 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0ff0d-f78c-497f-8ef0-033a5187dd8f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:51.509651 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0ff0d-f78c-497f-8ef0-033a5187dd8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:51.517969 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-86f0ff0d-f78c-497f-8ef0-033a5187dd8f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 13:39:51.519938 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 444/891] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Mar 8 13:39:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:39:51.526277 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4217dc6-e6b9-49e7-9257-c5eb00d0b686 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:51.583660 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae394fb4-7673-467b-af64-5cc3960079fb None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:51.583858 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae394fb4-7673-467b-af64-5cc3960079fb None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:51.584477 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae394fb4-7673-467b-af64-5cc3960079fb None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:51.586239 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 445/892] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:39:51.591231 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0f31a-f5f5-4b6c-a04f-4d6bfe6b2820 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:51.591526 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0f31a-f5f5-4b6c-a04f-4d6bfe6b2820 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:51.591804 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0f31a-f5f5-4b6c-a04f-4d6bfe6b2820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:51.613378 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-e0c0f31a-f5f5-4b6c-a04f-4d6bfe6b2820 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:51.615491 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-e0c0f31a-f5f5-4b6c-a04f-4d6bfe6b2820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:51.637084 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4217dc6-e6b9-49e7-9257-c5eb00d0b686 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:51.670430 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc1ca6b-9947-4f15-987e-280febce56aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:51.671096 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1ca6b-9947-4f15-987e-280febce56aa None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:51.671374 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1ca6b-9947-4f15-987e-280febce56aa None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:51.671646 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc1ca6b-9947-4f15-987e-280febce56aa None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:51.672394 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1ca6b-9947-4f15-987e-280febce56aa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:51.672695 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1ca6b-9947-4f15-987e-280febce56aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:51.674075 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc1ca6b-9947-4f15-987e-280febce56aa None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:51.681923 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 448/893] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Mar 8 13:39:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:51.683280 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df60cc6-9902-4ec4-9196-7166eb0c18fe None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:51.683565 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df60cc6-9902-4ec4-9196-7166eb0c18fe None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:51.683844 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df60cc6-9902-4ec4-9196-7166eb0c18fe None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:51.685833 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 449/894] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:51.688139 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df60cc6-9902-4ec4-9196-7166eb0c18fe None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:51.694548 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 446/895] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:39:51.696080 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d75c4e-b0af-43cc-866c-fa998b9c2cc8 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:51.696506 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d75c4e-b0af-43cc-866c-fa998b9c2cc8 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:51.696926 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d75c4e-b0af-43cc-866c-fa998b9c2cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:51.713900 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-64d75c4e-b0af-43cc-866c-fa998b9c2cc8 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:51.715337 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-64d75c4e-b0af-43cc-866c-fa998b9c2cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:51.788885 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 447/896] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:39:51.790078 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d75c4e-b0af-43cc-866c-fa998b9c2cc8 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:51.803066 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df60cc6-9902-4ec4-9196-7166eb0c18fe None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:51.838789 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115b0a8-bc57-46f8-aeb9-531bf202553b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:51.839548 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115b0a8-bc57-46f8-aeb9-531bf202553b None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:51.839823 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115b0a8-bc57-46f8-aeb9-531bf202553b None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:51.840096 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115b0a8-bc57-46f8-aeb9-531bf202553b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:51.850940 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115b0a8-bc57-46f8-aeb9-531bf202553b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:51.852369 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115b0a8-bc57-46f8-aeb9-531bf202553b None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:51.869104 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-3115b0a8-bc57-46f8-aeb9-531bf202553b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:51.870662 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 450/897] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:51.871544 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115b0a8-bc57-46f8-aeb9-531bf202553b None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:51.889791 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d75c4e-b0af-43cc-866c-fa998b9c2cc8 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:51.923187 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d63ad5-d63d-406f-bcf3-711af399f39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:51.924082 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d63ad5-d63d-406f-bcf3-711af399f39c None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:51.924424 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d63ad5-d63d-406f-bcf3-711af399f39c None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:51.924757 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d63ad5-d63d-406f-bcf3-711af399f39c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:51.925557 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d63ad5-d63d-406f-bcf3-711af399f39c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:51.926985 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d63ad5-d63d-406f-bcf3-711af399f39c None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:51.938966 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-b9d63ad5-d63d-406f-bcf3-711af399f39c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 08 13:39:51.945308 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 448/898] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Mar 8 13:39:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:51.945308 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d63ad5-d63d-406f-bcf3-711af399f39c None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:51.979117 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115b0a8-bc57-46f8-aeb9-531bf202553b None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:52.012340 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079156fe-468a-4d6d-85ef-cba5f310dd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:52.013032 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079156fe-468a-4d6d-85ef-cba5f310dd1c None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:52.013313 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079156fe-468a-4d6d-85ef-cba5f310dd1c None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:52.013616 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079156fe-468a-4d6d-85ef-cba5f310dd1c None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:52.014368 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079156fe-468a-4d6d-85ef-cba5f310dd1c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:52.015715 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079156fe-468a-4d6d-85ef-cba5f310dd1c None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:52.037382 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 451/899] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Mar 8 13:39:51 2022] POST /identity/v3/services => generated 241 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:39:52.037382 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079156fe-468a-4d6d-85ef-cba5f310dd1c None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:52.046024 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d63ad5-d63d-406f-bcf3-711af399f39c None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:52.104864 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd958a-a782-45a0-bcd6-a1727f340b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:52.105857 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd958a-a782-45a0-bcd6-a1727f340b42 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:52.106196 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd958a-a782-45a0-bcd6-a1727f340b42 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:52.106476 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd958a-a782-45a0-bcd6-a1727f340b42 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:52.107778 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd958a-a782-45a0-bcd6-a1727f340b42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:52.108099 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd958a-a782-45a0-bcd6-a1727f340b42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:52.109872 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd958a-a782-45a0-bcd6-a1727f340b42 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:52.128876 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 449/900] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:52.136114 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd958a-a782-45a0-bcd6-a1727f340b42 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:52.164077 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079156fe-468a-4d6d-85ef-cba5f310dd1c None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:52.209511 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d87fa-29e3-445e-a154-ee125ccfa028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:52.210797 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d87fa-29e3-445e-a154-ee125ccfa028 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:52.211268 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d87fa-29e3-445e-a154-ee125ccfa028 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:52.211892 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d87fa-29e3-445e-a154-ee125ccfa028 None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:52.213791 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d87fa-29e3-445e-a154-ee125ccfa028 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:52.214328 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d87fa-29e3-445e-a154-ee125ccfa028 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:52.215975 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d87fa-29e3-445e-a154-ee125ccfa028 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:52.227514 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 452/901] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Mar 8 13:39:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:52.229213 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d87fa-29e3-445e-a154-ee125ccfa028 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:52.252846 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd958a-a782-45a0-bcd6-a1727f340b42 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:52.291528 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88499a-06c1-4dc9-b144-dacec2d73616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:52.292233 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88499a-06c1-4dc9-b144-dacec2d73616 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:52.292536 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88499a-06c1-4dc9-b144-dacec2d73616 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:52.292812 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88499a-06c1-4dc9-b144-dacec2d73616 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:52.300863 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88499a-06c1-4dc9-b144-dacec2d73616 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:52.302994 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88499a-06c1-4dc9-b144-dacec2d73616 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:52.320607 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-ab88499a-06c1-4dc9-b144-dacec2d73616 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 13:39:52.322527 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 450/902] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Mar 8 13:39:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:39:52.328254 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88499a-06c1-4dc9-b144-dacec2d73616 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:52.342377 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d87fa-29e3-445e-a154-ee125ccfa028 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:52.383181 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960dcfa0-3fd1-42e8-b9ee-a041d63c1270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:52.384225 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dcfa0-3fd1-42e8-b9ee-a041d63c1270 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:52.384714 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dcfa0-3fd1-42e8-b9ee-a041d63c1270 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:52.385190 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960dcfa0-3fd1-42e8-b9ee-a041d63c1270 None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:52.386127 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960dcfa0-3fd1-42e8-b9ee-a041d63c1270 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:52.387105 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960dcfa0-3fd1-42e8-b9ee-a041d63c1270 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:52.388969 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960dcfa0-3fd1-42e8-b9ee-a041d63c1270 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:52.396487 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 453/903] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Mar 8 13:39:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:52.402298 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960dcfa0-3fd1-42e8-b9ee-a041d63c1270 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:52.433888 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88499a-06c1-4dc9-b144-dacec2d73616 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:52.480998 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338185f-0237-45ba-8444-9bdbd07c98d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:52.482564 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338185f-0237-45ba-8444-9bdbd07c98d4 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:52.482564 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338185f-0237-45ba-8444-9bdbd07c98d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:52.482564 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338185f-0237-45ba-8444-9bdbd07c98d4 None admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:52.483582 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338185f-0237-45ba-8444-9bdbd07c98d4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:52.483582 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338185f-0237-45ba-8444-9bdbd07c98d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:52.484678 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338185f-0237-45ba-8444-9bdbd07c98d4 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:52.512622 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 451/904] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Mar 8 13:39:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:52.525378 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338185f-0237-45ba-8444-9bdbd07c98d4 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:52.525578 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960dcfa0-3fd1-42e8-b9ee-a041d63c1270 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:52.557789 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf64f8-bd11-441f-9e15-c82cb2aa0458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:52.558502 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf64f8-bd11-441f-9e15-c82cb2aa0458 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:52.558798 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf64f8-bd11-441f-9e15-c82cb2aa0458 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:52.559071 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf64f8-bd11-441f-9e15-c82cb2aa0458 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:52.559914 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf64f8-bd11-441f-9e15-c82cb2aa0458 None admin] RBAC: Adding query filter params (interface=public, service_id=b8691bf236434eec83678006f0eb1857, region_id=RegionOne) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:52.560226 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf64f8-bd11-441f-9e15-c82cb2aa0458 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:52.561607 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf64f8-bd11-441f-9e15-c82cb2aa0458 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:52.567321 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 454/905] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Mar 8 13:39:52 2022] GET /identity/v3/endpoints?service_id=b8691bf236434eec83678006f0eb1857&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:52.573033 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf64f8-bd11-441f-9e15-c82cb2aa0458 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:52.620694 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338185f-0237-45ba-8444-9bdbd07c98d4 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:52.653733 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb4ea2-7d5a-4e1d-a1e8-9a2a0fef9db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:52.654303 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb4ea2-7d5a-4e1d-a1e8-9a2a0fef9db6 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:52.654600 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb4ea2-7d5a-4e1d-a1e8-9a2a0fef9db6 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:52.655173 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb4ea2-7d5a-4e1d-a1e8-9a2a0fef9db6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:52.675750 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf64f8-bd11-441f-9e15-c82cb2aa0458 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:52.708971 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16611ac-5f15-4ec5-a103-4e2292fa1a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:52.710093 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16611ac-5f15-4ec5-a103-4e2292fa1a71 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:52.710568 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16611ac-5f15-4ec5-a103-4e2292fa1a71 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:52.711193 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16611ac-5f15-4ec5-a103-4e2292fa1a71 None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:52.712093 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16611ac-5f15-4ec5-a103-4e2292fa1a71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:52.713753 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16611ac-5f15-4ec5-a103-4e2292fa1a71 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:52.719285 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb4ea2-7d5a-4e1d-a1e8-9a2a0fef9db6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:52.729386 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb4ea2-7d5a-4e1d-a1e8-9a2a0fef9db6 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:52.730199 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 455/906] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Mar 8 13:39:52 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:39:52.831792 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 452/907] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:39:52 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 08 13:39:52.834487 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16611ac-5f15-4ec5-a103-4e2292fa1a71 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:52.938416 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16611ac-5f15-4ec5-a103-4e2292fa1a71 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:52.971176 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7030c-1d57-4b85-b4e5-99b972d0fa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:52.971977 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7030c-1d57-4b85-b4e5-99b972d0fa74 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:52.972267 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7030c-1d57-4b85-b4e5-99b972d0fa74 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:52.972536 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7030c-1d57-4b85-b4e5-99b972d0fa74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:52.983491 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7030c-1d57-4b85-b4e5-99b972d0fa74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:52.984940 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7030c-1d57-4b85-b4e5-99b972d0fa74 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:53.001394 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-3ad7030c-1d57-4b85-b4e5-99b972d0fa74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:53.002922 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 456/908] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:53.008235 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb4ea2-7d5a-4e1d-a1e8-9a2a0fef9db6 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:53.108566 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb4ea2-7d5a-4e1d-a1e8-9a2a0fef9db6 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:53.141980 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c377e-611b-42d1-bdaa-bc05101a1736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:53.142652 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c377e-611b-42d1-bdaa-bc05101a1736 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:53.142920 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c377e-611b-42d1-bdaa-bc05101a1736 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:53.143201 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c377e-611b-42d1-bdaa-bc05101a1736 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:53.143932 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c377e-611b-42d1-bdaa-bc05101a1736 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:53.144236 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c377e-611b-42d1-bdaa-bc05101a1736 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:53.145830 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c377e-611b-42d1-bdaa-bc05101a1736 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:53.162364 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 453/909] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:53.163777 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7030c-1d57-4b85-b4e5-99b972d0fa74 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:53.264294 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7030c-1d57-4b85-b4e5-99b972d0fa74 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:53.297290 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5442b-6499-4d98-bebd-d7262b155904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:53.298446 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5442b-6499-4d98-bebd-d7262b155904 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:53.298934 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5442b-6499-4d98-bebd-d7262b155904 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:53.299423 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5442b-6499-4d98-bebd-d7262b155904 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:53.306227 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5442b-6499-4d98-bebd-d7262b155904 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:53.307989 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5442b-6499-4d98-bebd-d7262b155904 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:53.321620 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-a0b5442b-6499-4d98-bebd-d7262b155904 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:53.327849 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 457/910] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:53.329384 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c377e-611b-42d1-bdaa-bc05101a1736 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:53.434872 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c377e-611b-42d1-bdaa-bc05101a1736 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:53.467767 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d89b1-3ee9-43b4-bff6-1d77658a9bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:53.468842 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d89b1-3ee9-43b4-bff6-1d77658a9bea None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:53.469313 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d89b1-3ee9-43b4-bff6-1d77658a9bea None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:53.469801 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d89b1-3ee9-43b4-bff6-1d77658a9bea None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:53.470776 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d89b1-3ee9-43b4-bff6-1d77658a9bea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:53.471290 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d89b1-3ee9-43b4-bff6-1d77658a9bea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:53.472935 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d89b1-3ee9-43b4-bff6-1d77658a9bea None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:53.489467 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 454/911] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:39:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:53.492323 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5442b-6499-4d98-bebd-d7262b155904 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:53.595152 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5442b-6499-4d98-bebd-d7262b155904 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:53.629391 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a6f3b8-4695-482a-bf60-125066632351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:53.630071 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6f3b8-4695-482a-bf60-125066632351 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:53.630346 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6f3b8-4695-482a-bf60-125066632351 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:53.630613 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a6f3b8-4695-482a-bf60-125066632351 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:53.631444 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6f3b8-4695-482a-bf60-125066632351 None admin] RBAC: Adding query filter params (role.id=1ad7159416cf4d999f172e7806e1a652, scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e, user.id=817bcd2c5f6e4bceb049eeb122d4e432) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:53.631751 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6f3b8-4695-482a-bf60-125066632351 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:53.633187 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a6f3b8-4695-482a-bf60-125066632351 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:53.645507 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 458/912] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:39:53 2022] GET /identity/v3/role_assignments?user.id=817bcd2c5f6e4bceb049eeb122d4e432&scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e&role.id=1ad7159416cf4d999f172e7806e1a652 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:53.746190 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d5fbb-0bab-49ea-97c6-9c739c721e9f None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:53.747283 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d5fbb-0bab-49ea-97c6-9c739c721e9f None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:53.747778 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d5fbb-0bab-49ea-97c6-9c739c721e9f None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:53.750197 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 455/913] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:53.756185 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd1a50-4261-49aa-afd6-0b1c3a758197 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:53.756471 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd1a50-4261-49aa-afd6-0b1c3a758197 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:53.756749 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd1a50-4261-49aa-afd6-0b1c3a758197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:53.774480 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-8afd1a50-4261-49aa-afd6-0b1c3a758197 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:53.775674 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-8afd1a50-4261-49aa-afd6-0b1c3a758197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:53.845747 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 459/914] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:39:53.868495 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d5fbb-0bab-49ea-97c6-9c739c721e9f None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:53.974770 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d5fbb-0bab-49ea-97c6-9c739c721e9f None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:54.008788 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4993a7a-f8dd-44f9-ae9b-77ca018df7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:54.009617 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4993a7a-f8dd-44f9-ae9b-77ca018df7ca None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:54.009897 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4993a7a-f8dd-44f9-ae9b-77ca018df7ca None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:54.010165 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4993a7a-f8dd-44f9-ae9b-77ca018df7ca None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:54.010811 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4993a7a-f8dd-44f9-ae9b-77ca018df7ca None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:54.012212 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4993a7a-f8dd-44f9-ae9b-77ca018df7ca None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:54.023318 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-e4993a7a-f8dd-44f9-ae9b-77ca018df7ca None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Mar 08 13:39:54.024919 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 456/915] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Mar 8 13:39:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:54.031254 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd1a50-4261-49aa-afd6-0b1c3a758197 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:54.136800 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd1a50-4261-49aa-afd6-0b1c3a758197 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:54.169864 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4d8b9-9ac6-4891-bd40-519fe77fae56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:54.170532 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4d8b9-9ac6-4891-bd40-519fe77fae56 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:54.170811 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4d8b9-9ac6-4891-bd40-519fe77fae56 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:54.171084 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d4d8b9-9ac6-4891-bd40-519fe77fae56 None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:54.171789 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4d8b9-9ac6-4891-bd40-519fe77fae56 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:54.172090 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4d8b9-9ac6-4891-bd40-519fe77fae56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:54.173465 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d4d8b9-9ac6-4891-bd40-519fe77fae56 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:54.178623 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 460/916] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Mar 8 13:39:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:54.186442 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4993a7a-f8dd-44f9-ae9b-77ca018df7ca None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:54.287084 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4993a7a-f8dd-44f9-ae9b-77ca018df7ca None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:54.319575 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6697b-4aee-4868-83c9-2610091c8d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:54.320237 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6697b-4aee-4868-83c9-2610091c8d5c None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:54.320518 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6697b-4aee-4868-83c9-2610091c8d5c None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:54.320789 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6697b-4aee-4868-83c9-2610091c8d5c None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:54.321523 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6697b-4aee-4868-83c9-2610091c8d5c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:54.321827 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6697b-4aee-4868-83c9-2610091c8d5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:54.323201 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6697b-4aee-4868-83c9-2610091c8d5c None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:54.328662 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 457/917] 10.222.0.18 () {56 vars in 1114 bytes} [Tue Mar 8 13:39:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:54.334188 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4d8b9-9ac6-4891-bd40-519fe77fae56 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:54.396464 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801c508-696b-436a-beb0-f17b71d4d965 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:54.397067 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801c508-696b-436a-beb0-f17b71d4d965 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:54.397595 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801c508-696b-436a-beb0-f17b71d4d965 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:54.399823 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 458/918] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:39:54.406754 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942b0ce-0b67-4aac-8f41-5826149bcfa0 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:54.407266 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942b0ce-0b67-4aac-8f41-5826149bcfa0 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:54.407756 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942b0ce-0b67-4aac-8f41-5826149bcfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:54.425236 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-5942b0ce-0b67-4aac-8f41-5826149bcfa0 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:54.427264 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-5942b0ce-0b67-4aac-8f41-5826149bcfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:54.441169 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d4d8b9-9ac6-4891-bd40-519fe77fae56 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:54.486960 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfa1b6-94bb-4136-8159-6b186f83dfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:54.488020 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfa1b6-94bb-4136-8159-6b186f83dfee None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:54.488521 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfa1b6-94bb-4136-8159-6b186f83dfee None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:54.489441 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dfa1b6-94bb-4136-8159-6b186f83dfee None admin] PATH_INFO: `/v3/endpoints` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:54.490768 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfa1b6-94bb-4136-8159-6b186f83dfee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:54.493128 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dfa1b6-94bb-4136-8159-6b186f83dfee None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:54.509699 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 459/919] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:39:54.524962 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 461/920] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Mar 8 13:39:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:39:54.529477 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942b0ce-0b67-4aac-8f41-5826149bcfa0 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:54.641092 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942b0ce-0b67-4aac-8f41-5826149bcfa0 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:54.685123 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78b33f-8889-4004-9b05-7a2899561e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:54.686382 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78b33f-8889-4004-9b05-7a2899561e50 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:54.686888 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78b33f-8889-4004-9b05-7a2899561e50 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:54.687406 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78b33f-8889-4004-9b05-7a2899561e50 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:54.688346 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78b33f-8889-4004-9b05-7a2899561e50 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:54.689995 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b78b33f-8889-4004-9b05-7a2899561e50 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:54.702638 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-1b78b33f-8889-4004-9b05-7a2899561e50 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 08 13:39:54.704924 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 460/921] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Mar 8 13:39:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:54.710836 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfa1b6-94bb-4136-8159-6b186f83dfee None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:54.824568 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dfa1b6-94bb-4136-8159-6b186f83dfee None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:54.858626 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d11518-01b5-4bf3-8cd9-d22942cf2a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:54.859703 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d11518-01b5-4bf3-8cd9-d22942cf2a10 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:54.860237 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d11518-01b5-4bf3-8cd9-d22942cf2a10 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:54.860714 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d11518-01b5-4bf3-8cd9-d22942cf2a10 None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:54.861663 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d11518-01b5-4bf3-8cd9-d22942cf2a10 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:54.862162 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d11518-01b5-4bf3-8cd9-d22942cf2a10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:54.863821 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d11518-01b5-4bf3-8cd9-d22942cf2a10 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:54.869025 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 462/922] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Mar 8 13:39:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:54.874434 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78b33f-8889-4004-9b05-7a2899561e50 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:54.974527 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78b33f-8889-4004-9b05-7a2899561e50 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:55.007996 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265a4e9-fb94-4144-a667-fbc22308e8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:55.009033 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265a4e9-fb94-4144-a667-fbc22308e8c9 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:55.009540 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265a4e9-fb94-4144-a667-fbc22308e8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:55.010007 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265a4e9-fb94-4144-a667-fbc22308e8c9 None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:55.010907 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265a4e9-fb94-4144-a667-fbc22308e8c9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:55.011488 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265a4e9-fb94-4144-a667-fbc22308e8c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:55.013089 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265a4e9-fb94-4144-a667-fbc22308e8c9 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:55.018774 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 461/923] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Mar 8 13:39:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:55.029376 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d11518-01b5-4bf3-8cd9-d22942cf2a10 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:55.120243 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34763b-e425-4e36-b6fc-142cd4d7b079 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:55.120920 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34763b-e425-4e36-b6fc-142cd4d7b079 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:55.121446 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34763b-e425-4e36-b6fc-142cd4d7b079 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:55.123638 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d11518-01b5-4bf3-8cd9-d22942cf2a10 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:55.123859 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 462/924] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:39:55.129854 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef470d1f-f913-484c-a982-dbd0adf9a9a2 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:55.130139 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef470d1f-f913-484c-a982-dbd0adf9a9a2 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:55.130417 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef470d1f-f913-484c-a982-dbd0adf9a9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:55.152279 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-ef470d1f-f913-484c-a982-dbd0adf9a9a2 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:55.153489 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-ef470d1f-f913-484c-a982-dbd0adf9a9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:55.160233 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258a527-f547-4246-a269-2c5ec0b63f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:55.160886 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258a527-f547-4246-a269-2c5ec0b63f6f None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:55.161622 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258a527-f547-4246-a269-2c5ec0b63f6f None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:55.161903 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258a527-f547-4246-a269-2c5ec0b63f6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:55.162742 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258a527-f547-4246-a269-2c5ec0b63f6f None admin] RBAC: Adding query filter params (interface=public, service_id=eab2774071f747639c1185f97d33d10d, region_id=RegionOne) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:55.163406 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258a527-f547-4246-a269-2c5ec0b63f6f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:55.165119 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258a527-f547-4246-a269-2c5ec0b63f6f None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:55.171970 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 463/925] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Mar 8 13:39:55 2022] GET /identity/v3/endpoints?service_id=eab2774071f747639c1185f97d33d10d&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:55.179506 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258a527-f547-4246-a269-2c5ec0b63f6f None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:55.234976 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 463/926] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:39:55.258497 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef470d1f-f913-484c-a982-dbd0adf9a9a2 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:55.296333 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258a527-f547-4246-a269-2c5ec0b63f6f None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:55.331059 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6b5da-bbfd-4981-9899-f09c3ec38f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:55.331731 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6b5da-bbfd-4981-9899-f09c3ec38f9f None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:55.332011 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6b5da-bbfd-4981-9899-f09c3ec38f9f None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:55.332290 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6b5da-bbfd-4981-9899-f09c3ec38f9f None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:55.333370 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6b5da-bbfd-4981-9899-f09c3ec38f9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:55.335341 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6b5da-bbfd-4981-9899-f09c3ec38f9f None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:55.343024 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 464/927] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Mar 8 13:39:55 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:39:55.360201 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef470d1f-f913-484c-a982-dbd0adf9a9a2 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:55.397758 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cfc23-5cbe-4de1-9e7e-36d3d40e6d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:55.398654 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cfc23-5cbe-4de1-9e7e-36d3d40e6d2c None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:55.398937 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cfc23-5cbe-4de1-9e7e-36d3d40e6d2c None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:55.399198 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cfc23-5cbe-4de1-9e7e-36d3d40e6d2c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:55.399940 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9cfc23-5cbe-4de1-9e7e-36d3d40e6d2c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:55.401391 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9cfc23-5cbe-4de1-9e7e-36d3d40e6d2c None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:55.414381 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-9b9cfc23-5cbe-4de1-9e7e-36d3d40e6d2c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Mar 08 13:39:55.416078 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 464/928] 10.222.0.18 () {56 vars in 1132 bytes} [Tue Mar 8 13:39:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:55.421834 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6b5da-bbfd-4981-9899-f09c3ec38f9f None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:55.543922 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6b5da-bbfd-4981-9899-f09c3ec38f9f None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:55.576867 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f63c6d-ef64-4b57-a388-387225a70152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:55.577606 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f63c6d-ef64-4b57-a388-387225a70152 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:55.577886 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f63c6d-ef64-4b57-a388-387225a70152 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:55.578152 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f63c6d-ef64-4b57-a388-387225a70152 None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:55.578857 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f63c6d-ef64-4b57-a388-387225a70152 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:55.579162 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f63c6d-ef64-4b57-a388-387225a70152 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:55.580508 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f63c6d-ef64-4b57-a388-387225a70152 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:55.585735 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 465/929] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Mar 8 13:39:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:55.592987 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cfc23-5cbe-4de1-9e7e-36d3d40e6d2c None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:55.698579 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cfc23-5cbe-4de1-9e7e-36d3d40e6d2c None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:55.732091 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2135d-4c6b-4fc4-880a-157a68532961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:55.732763 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2135d-4c6b-4fc4-880a-157a68532961 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:55.733090 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2135d-4c6b-4fc4-880a-157a68532961 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:55.733377 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2135d-4c6b-4fc4-880a-157a68532961 None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:55.734100 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd2135d-4c6b-4fc4-880a-157a68532961 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:55.734400 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd2135d-4c6b-4fc4-880a-157a68532961 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:55.735832 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd2135d-4c6b-4fc4-880a-157a68532961 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:55.750112 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 465/930] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Mar 8 13:39:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:55.755345 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f63c6d-ef64-4b57-a388-387225a70152 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:55.854965 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f63c6d-ef64-4b57-a388-387225a70152 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:55.888306 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90881fd-6c27-4559-8b2f-cfd7bed479a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:55.888965 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90881fd-6c27-4559-8b2f-cfd7bed479a0 None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:55.889242 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90881fd-6c27-4559-8b2f-cfd7bed479a0 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:55.889546 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90881fd-6c27-4559-8b2f-cfd7bed479a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:55.890295 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90881fd-6c27-4559-8b2f-cfd7bed479a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:55.891654 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90881fd-6c27-4559-8b2f-cfd7bed479a0 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:55.911335 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 466/931] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Mar 8 13:39:55 2022] POST /identity/v3/endpoints => generated 347 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:39:56.030261 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79d4d4-9567-475b-93fd-7d84d6e8894c None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:56.030759 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79d4d4-9567-475b-93fd-7d84d6e8894c None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:56.030759 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79d4d4-9567-475b-93fd-7d84d6e8894c None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:56.032814 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 466/932] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:56.038487 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de79524-2524-4928-af4c-3831db9fc6e8 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:56.038784 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de79524-2524-4928-af4c-3831db9fc6e8 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:56.039057 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de79524-2524-4928-af4c-3831db9fc6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:56.056692 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-8de79524-2524-4928-af4c-3831db9fc6e8 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:56.057986 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-8de79524-2524-4928-af4c-3831db9fc6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:56.136601 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 467/933] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:39:56.162231 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79d4d4-9567-475b-93fd-7d84d6e8894c None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:56.266483 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79d4d4-9567-475b-93fd-7d84d6e8894c None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:56.300629 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19de472-cb51-4e9e-9079-ef3ec9d89077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:56.301756 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19de472-cb51-4e9e-9079-ef3ec9d89077 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:56.302228 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19de472-cb51-4e9e-9079-ef3ec9d89077 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:56.302673 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19de472-cb51-4e9e-9079-ef3ec9d89077 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:56.313866 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19de472-cb51-4e9e-9079-ef3ec9d89077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:39:56.321378 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-f19de472-cb51-4e9e-9079-ef3ec9d89077 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 13:39:56.323066 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 467/934] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Mar 8 13:39:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:56.329166 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de79524-2524-4928-af4c-3831db9fc6e8 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:56.424174 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de79524-2524-4928-af4c-3831db9fc6e8 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:56.461378 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60311a1-947a-4f02-b165-75379751a995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:56.461378 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60311a1-947a-4f02-b165-75379751a995 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:56.461378 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60311a1-947a-4f02-b165-75379751a995 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:56.461378 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60311a1-947a-4f02-b165-75379751a995 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:56.461791 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60311a1-947a-4f02-b165-75379751a995 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:56.461791 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60311a1-947a-4f02-b165-75379751a995 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:56.461791 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60311a1-947a-4f02-b165-75379751a995 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:56.475564 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 468/935] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Mar 8 13:39:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:56.481436 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19de472-cb51-4e9e-9079-ef3ec9d89077 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:56.582103 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19de472-cb51-4e9e-9079-ef3ec9d89077 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:56.619354 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faa32f-756a-42dc-9ba9-52e23d88ca15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:56.620614 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faa32f-756a-42dc-9ba9-52e23d88ca15 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:56.621111 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faa32f-756a-42dc-9ba9-52e23d88ca15 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:56.621614 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08faa32f-756a-42dc-9ba9-52e23d88ca15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:56.632308 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08faa32f-756a-42dc-9ba9-52e23d88ca15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:56.634094 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08faa32f-756a-42dc-9ba9-52e23d88ca15 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:56.652175 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-08faa32f-756a-42dc-9ba9-52e23d88ca15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:56.654037 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 468/936] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:56.660100 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60311a1-947a-4f02-b165-75379751a995 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:56.760761 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60311a1-947a-4f02-b165-75379751a995 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:56.793405 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1abed-9d0d-4c08-89a2-753857256fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:56.794075 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1abed-9d0d-4c08-89a2-753857256fdc None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:56.794346 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1abed-9d0d-4c08-89a2-753857256fdc None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:56.794613 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1abed-9d0d-4c08-89a2-753857256fdc None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:56.795329 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1abed-9d0d-4c08-89a2-753857256fdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:56.795632 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1abed-9d0d-4c08-89a2-753857256fdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:56.796974 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1abed-9d0d-4c08-89a2-753857256fdc None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:56.811033 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 469/937] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:56.816299 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faa32f-756a-42dc-9ba9-52e23d88ca15 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:56.915597 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08faa32f-756a-42dc-9ba9-52e23d88ca15 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:56.949153 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5f691-a612-4cc9-b7d0-2bca34d3bb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:56.950422 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5f691-a612-4cc9-b7d0-2bca34d3bb7d None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:56.950919 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5f691-a612-4cc9-b7d0-2bca34d3bb7d None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:56.951391 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5f691-a612-4cc9-b7d0-2bca34d3bb7d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:56.951797 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05e2ff-0aa6-42cb-a9a0-6277d6f7ce24 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:56.952088 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05e2ff-0aa6-42cb-a9a0-6277d6f7ce24 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:56.952361 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05e2ff-0aa6-42cb-a9a0-6277d6f7ce24 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:56.957471 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 470/938] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:39:56.959714 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdd8b8-2036-4408-96dd-1f1d6917780b None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:56.960000 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdd8b8-2036-4408-96dd-1f1d6917780b None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:56.960273 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdd8b8-2036-4408-96dd-1f1d6917780b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:56.960973 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5f691-a612-4cc9-b7d0-2bca34d3bb7d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:56.962728 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5f691-a612-4cc9-b7d0-2bca34d3bb7d None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:56.976857 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-76bdd8b8-2036-4408-96dd-1f1d6917780b None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:56.978051 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-89a5f691-a612-4cc9-b7d0-2bca34d3bb7d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 13:39:56.978177 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-76bdd8b8-2036-4408-96dd-1f1d6917780b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:56.980010 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 469/939] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Mar 8 13:39:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:56.985822 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5f691-a612-4cc9-b7d0-2bca34d3bb7d None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:57.065459 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 471/940] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:39:57.085861 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdd8b8-2036-4408-96dd-1f1d6917780b None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:57.091918 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5f691-a612-4cc9-b7d0-2bca34d3bb7d None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:57.138589 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56edf9f2-b552-4409-8064-0d35635a9c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:57.139294 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edf9f2-b552-4409-8064-0d35635a9c1f None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:57.139571 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edf9f2-b552-4409-8064-0d35635a9c1f None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:57.139838 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edf9f2-b552-4409-8064-0d35635a9c1f None admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:57.140702 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56edf9f2-b552-4409-8064-0d35635a9c1f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:57.141022 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56edf9f2-b552-4409-8064-0d35635a9c1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:57.142547 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56edf9f2-b552-4409-8064-0d35635a9c1f None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:57.161451 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 470/941] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Mar 8 13:39:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:57.167077 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56edf9f2-b552-4409-8064-0d35635a9c1f None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:57.199804 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdd8b8-2036-4408-96dd-1f1d6917780b None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:57.233401 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba3715-4f03-4d8e-8ed9-e9d21a5669d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:57.234505 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba3715-4f03-4d8e-8ed9-e9d21a5669d8 None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:57.235019 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba3715-4f03-4d8e-8ed9-e9d21a5669d8 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:57.235514 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba3715-4f03-4d8e-8ed9-e9d21a5669d8 None admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:57.236446 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba3715-4f03-4d8e-8ed9-e9d21a5669d8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:57.238084 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba3715-4f03-4d8e-8ed9-e9d21a5669d8 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:57.239652 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.common [None req-53ba3715-4f03-4d8e-8ed9-e9d21a5669d8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Mar 08 13:39:57.258351 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.sql.core [None req-53ba3715-4f03-4d8e-8ed9-e9d21a5669d8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Mar 08 13:39:57.258351 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Mar 08 13:39:57.258351 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [parameters: {'id': 'e79f49104cbe4f0585083d46b086e3f2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Mar 08 13:39:57.258351 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91154) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 08 13:39:57.266484 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56edf9f2-b552-4409-8064-0d35635a9c1f None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:57.279140 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-53ba3715-4f03-4d8e-8ed9-e9d21a5669d8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e79f49104cbe4f0585083d46b086e3f2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e79f49104cbe4f0585083d46b086e3f2. Mar 08 13:39:57.286727 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 472/942] 10.222.0.18 () {60 vars in 1140 bytes} [Tue Mar 8 13:39:57 2022] POST /identity/v3/projects => generated 262 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:39:57.289294 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba3715-4f03-4d8e-8ed9-e9d21a5669d8 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:57.307937 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94673141-4d00-4084-9e4b-d8e03145017a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:57.308739 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94673141-4d00-4084-9e4b-d8e03145017a None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:57.309335 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94673141-4d00-4084-9e4b-d8e03145017a None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:57.309335 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94673141-4d00-4084-9e4b-d8e03145017a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:57.319892 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94673141-4d00-4084-9e4b-d8e03145017a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:57.321367 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94673141-4d00-4084-9e4b-d8e03145017a None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:57.339684 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-94673141-4d00-4084-9e4b-d8e03145017a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:39:57.346095 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 471/943] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:39:57.347498 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94673141-4d00-4084-9e4b-d8e03145017a None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:57.413566 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba3715-4f03-4d8e-8ed9-e9d21a5669d8 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:57.445280 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94673141-4d00-4084-9e4b-d8e03145017a None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:57.446672 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde8ec2-2dd5-4495-a836-2821257e4272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:57.447696 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde8ec2-2dd5-4495-a836-2821257e4272 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:57.448173 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde8ec2-2dd5-4495-a836-2821257e4272 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:57.448673 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde8ec2-2dd5-4495-a836-2821257e4272 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:57.455855 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde8ec2-2dd5-4495-a836-2821257e4272 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:57.457821 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde8ec2-2dd5-4495-a836-2821257e4272 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:57.480537 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-ebde8ec2-2dd5-4495-a836-2821257e4272 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:57.481758 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f1fbe-45c3-43fd-9262-cd5efa01c8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:57.483649 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f1fbe-45c3-43fd-9262-cd5efa01c8bb None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:57.483649 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f1fbe-45c3-43fd-9262-cd5efa01c8bb None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:57.483649 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f1fbe-45c3-43fd-9262-cd5efa01c8bb None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:57.483913 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f1fbe-45c3-43fd-9262-cd5efa01c8bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:57.487831 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f1fbe-45c3-43fd-9262-cd5efa01c8bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:57.487831 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f1fbe-45c3-43fd-9262-cd5efa01c8bb None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:57.488154 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 473/944] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:39:57.489645 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde8ec2-2dd5-4495-a836-2821257e4272 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:57.501585 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 472/945] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:57.503616 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f1fbe-45c3-43fd-9262-cd5efa01c8bb None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:57.590796 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde8ec2-2dd5-4495-a836-2821257e4272 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:57.603740 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f1fbe-45c3-43fd-9262-cd5efa01c8bb None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:57.625229 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1989f-479b-495b-8234-561fd7e0742e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:57.626254 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1989f-479b-495b-8234-561fd7e0742e None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:57.626807 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1989f-479b-495b-8234-561fd7e0742e None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:57.627276 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1989f-479b-495b-8234-561fd7e0742e None admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:57.628272 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1989f-479b-495b-8234-561fd7e0742e None admin] RBAC: Adding query filter params (name=service) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:57.628786 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1989f-479b-495b-8234-561fd7e0742e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:57.630430 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1989f-479b-495b-8234-561fd7e0742e None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:57.636794 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f939e6-e3d1-4c68-9099-fd6a07d9868a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:57.637615 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f939e6-e3d1-4c68-9099-fd6a07d9868a None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:57.637897 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f939e6-e3d1-4c68-9099-fd6a07d9868a None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:57.638171 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f939e6-e3d1-4c68-9099-fd6a07d9868a None admin] PATH_INFO: `/v3/projects/service` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:57.644992 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f939e6-e3d1-4c68-9099-fd6a07d9868a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:57.646491 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f939e6-e3d1-4c68-9099-fd6a07d9868a None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:57.661489 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 474/946] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Mar 8 13:39:57 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:39:57.661953 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-a8f939e6-e3d1-4c68-9099-fd6a07d9868a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:39:57.663523 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 473/947] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:39:57.669664 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1989f-479b-495b-8234-561fd7e0742e None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:57.699801 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5a679-38c2-4ab8-bb96-d4e88c3f38aa None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:57.700106 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5a679-38c2-4ab8-bb96-d4e88c3f38aa None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:57.700286 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e5a679-38c2-4ab8-bb96-d4e88c3f38aa None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:57.702852 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 474/948] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:57.709176 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c7ecb-7cfa-498a-b8c2-7570cced8234 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:57.709506 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c7ecb-7cfa-498a-b8c2-7570cced8234 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:57.709791 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c7ecb-7cfa-498a-b8c2-7570cced8234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:57.731761 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-b25c7ecb-7cfa-498a-b8c2-7570cced8234 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:57.733441 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-b25c7ecb-7cfa-498a-b8c2-7570cced8234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:57.785945 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1989f-479b-495b-8234-561fd7e0742e None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:57.821729 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 475/949] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:39:57.824868 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7b3dd-db6e-462b-b2fd-f4bee6adc6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:57.825844 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7b3dd-db6e-462b-b2fd-f4bee6adc6c4 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:57.826366 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7b3dd-db6e-462b-b2fd-f4bee6adc6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:57.826834 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7b3dd-db6e-462b-b2fd-f4bee6adc6c4 None admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:57.827890 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb7b3dd-db6e-462b-b2fd-f4bee6adc6c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:57.828397 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb7b3dd-db6e-462b-b2fd-f4bee6adc6c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:57.830071 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb7b3dd-db6e-462b-b2fd-f4bee6adc6c4 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:57.841244 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c7ecb-7cfa-498a-b8c2-7570cced8234 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:57.844159 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 475/950] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:39:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:57.852406 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7b3dd-db6e-462b-b2fd-f4bee6adc6c4 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:57.957289 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c7ecb-7cfa-498a-b8c2-7570cced8234 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:57.958292 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7b3dd-db6e-462b-b2fd-f4bee6adc6c4 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:58.003978 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a1a03-f244-4ca4-a857-7dfd11a879cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:58.005236 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a1a03-f244-4ca4-a857-7dfd11a879cd None admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:58.005625 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045be048-b328-41c7-8974-5e93dee22d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:58.005990 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a1a03-f244-4ca4-a857-7dfd11a879cd None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:58.006444 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045be048-b328-41c7-8974-5e93dee22d30 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:58.006672 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a1a03-f244-4ca4-a857-7dfd11a879cd None admin] PATH_INFO: `/v3/projects/7d693fb3e9fc4d82a0ed054f31f1e56e/users/817bcd2c5f6e4bceb049eeb122d4e432/roles/1ad7159416cf4d999f172e7806e1a652` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:58.006771 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045be048-b328-41c7-8974-5e93dee22d30 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:58.006978 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045be048-b328-41c7-8974-5e93dee22d30 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:58.007645 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045be048-b328-41c7-8974-5e93dee22d30 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:58.009325 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045be048-b328-41c7-8974-5e93dee22d30 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:58.010013 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a1a03-f244-4ca4-a857-7dfd11a879cd None admin] RBAC: Authorizing `identity:create_grant(project_id=7d693fb3e9fc4d82a0ed054f31f1e56e, user_id=817bcd2c5f6e4bceb049eeb122d4e432, role_id=1ad7159416cf4d999f172e7806e1a652)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:58.012478 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a1a03-f244-4ca4-a857-7dfd11a879cd None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:58.024183 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-045be048-b328-41c7-8974-5e93dee22d30 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 08 13:39:58.029727 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 476/951] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Mar 8 13:39:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:39:58.033193 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045be048-b328-41c7-8974-5e93dee22d30 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:58.034611 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 476/952] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Mar 8 13:39:57 2022] PUT /identity/v3/projects/7d693fb3e9fc4d82a0ed054f31f1e56e/users/817bcd2c5f6e4bceb049eeb122d4e432/roles/1ad7159416cf4d999f172e7806e1a652 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:39:58.143976 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045be048-b328-41c7-8974-5e93dee22d30 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:58.180633 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b518b-8cac-453b-873d-cbec26927af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:58.181588 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b518b-8cac-453b-873d-cbec26927af8 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:58.182043 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b518b-8cac-453b-873d-cbec26927af8 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:58.182473 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b518b-8cac-453b-873d-cbec26927af8 None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:58.183397 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b518b-8cac-453b-873d-cbec26927af8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:58.183855 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b518b-8cac-453b-873d-cbec26927af8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:58.185418 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b518b-8cac-453b-873d-cbec26927af8 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:58.191436 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 477/953] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Mar 8 13:39:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:58.200689 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a1a03-f244-4ca4-a857-7dfd11a879cd None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:58.302825 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a1a03-f244-4ca4-a857-7dfd11a879cd None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:58.335970 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3e05e-ab93-494a-bb5e-4db6d9e70d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:58.336982 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3e05e-ab93-494a-bb5e-4db6d9e70d1f None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:58.337513 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3e05e-ab93-494a-bb5e-4db6d9e70d1f None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:58.337982 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3e05e-ab93-494a-bb5e-4db6d9e70d1f None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:58.338955 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3e05e-ab93-494a-bb5e-4db6d9e70d1f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:58.339456 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3e05e-ab93-494a-bb5e-4db6d9e70d1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:58.341020 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3e05e-ab93-494a-bb5e-4db6d9e70d1f None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:58.346460 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 477/954] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Mar 8 13:39:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:58.350452 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cef0a1-075f-4776-8ad2-69837437a742 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:58.350721 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cef0a1-075f-4776-8ad2-69837437a742 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:58.350999 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cef0a1-075f-4776-8ad2-69837437a742 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:58.352780 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3e05e-ab93-494a-bb5e-4db6d9e70d1f None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:58.353404 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 478/955] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:39:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:39:58.359591 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9c855-2cde-499c-8d39-48d773c03eea None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:58.359882 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9c855-2cde-499c-8d39-48d773c03eea None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:58.360144 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9c855-2cde-499c-8d39-48d773c03eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:58.380767 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-63c9c855-2cde-499c-8d39-48d773c03eea None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:39:58.382422 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-63c9c855-2cde-499c-8d39-48d773c03eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:39:58.454418 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3e05e-ab93-494a-bb5e-4db6d9e70d1f None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:58.469490 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 479/956] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:39:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:39:58.493723 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9c855-2cde-499c-8d39-48d773c03eea None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:58.496001 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ba0fd-25ed-4df8-9214-3c47af0d52a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:58.496857 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ba0fd-25ed-4df8-9214-3c47af0d52a2 None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:58.497138 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ba0fd-25ed-4df8-9214-3c47af0d52a2 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:58.497489 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ba0fd-25ed-4df8-9214-3c47af0d52a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:58.499099 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ba0fd-25ed-4df8-9214-3c47af0d52a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:58.500506 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ba0fd-25ed-4df8-9214-3c47af0d52a2 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:58.523781 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 478/957] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Mar 8 13:39:58 2022] POST /identity/v3/endpoints => generated 349 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:39:58.622316 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9c855-2cde-499c-8d39-48d773c03eea None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:58.666222 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db95fc-4bea-4014-acee-26b612bb19bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:58.667332 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db95fc-4bea-4014-acee-26b612bb19bc None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:58.667778 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db95fc-4bea-4014-acee-26b612bb19bc None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:58.668195 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db95fc-4bea-4014-acee-26b612bb19bc None admin] PATH_INFO: `/v3/services/compute` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:58.669085 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db95fc-4bea-4014-acee-26b612bb19bc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:58.670705 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db95fc-4bea-4014-acee-26b612bb19bc None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:58.682741 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-62db95fc-4bea-4014-acee-26b612bb19bc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 08 13:39:58.684720 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 480/958] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:39:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:39:58.690883 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ba0fd-25ed-4df8-9214-3c47af0d52a2 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:58.792774 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ba0fd-25ed-4df8-9214-3c47af0d52a2 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:58.825946 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd5950-5fed-4efb-8ac8-5f7476f886ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:58.826848 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd5950-5fed-4efb-8ac8-5f7476f886ea None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:58.827293 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd5950-5fed-4efb-8ac8-5f7476f886ea None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:58.827710 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd5950-5fed-4efb-8ac8-5f7476f886ea None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:58.828550 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd5950-5fed-4efb-8ac8-5f7476f886ea None admin] RBAC: Adding query filter params (name=compute) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:58.829000 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd5950-5fed-4efb-8ac8-5f7476f886ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:58.830522 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd5950-5fed-4efb-8ac8-5f7476f886ea None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:58.835789 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 479/959] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Mar 8 13:39:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:39:58.841866 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db95fc-4bea-4014-acee-26b612bb19bc None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:39:58.944855 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db95fc-4bea-4014-acee-26b612bb19bc None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:39:58.978307 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68139b9-864f-41f7-81f1-55009ce8df63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:39:58.979206 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68139b9-864f-41f7-81f1-55009ce8df63 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:39:58.979670 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68139b9-864f-41f7-81f1-55009ce8df63 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:39:58.980079 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68139b9-864f-41f7-81f1-55009ce8df63 None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:39:58.980921 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68139b9-864f-41f7-81f1-55009ce8df63 None admin] RBAC: Adding query filter params (type=compute) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:39:58.981398 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68139b9-864f-41f7-81f1-55009ce8df63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:39:58.982914 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68139b9-864f-41f7-81f1-55009ce8df63 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:39:58.987884 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 481/960] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Mar 8 13:39:58 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:00.104628 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37696fea-3eb6-4e48-8229-cf3a21b0e3be None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:00.105160 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37696fea-3eb6-4e48-8229-cf3a21b0e3be None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:00.105160 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37696fea-3eb6-4e48-8229-cf3a21b0e3be None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:00.107418 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 480/961] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:00.113583 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa8552-fa42-4be3-bbe2-044a27caf436 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:00.114550 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa8552-fa42-4be3-bbe2-044a27caf436 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:00.115029 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa8552-fa42-4be3-bbe2-044a27caf436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:00.132215 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-05aa8552-fa42-4be3-bbe2-044a27caf436 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:00.133754 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-05aa8552-fa42-4be3-bbe2-044a27caf436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:00.200028 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 482/962] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:40:00.224685 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37696fea-3eb6-4e48-8229-cf3a21b0e3be None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:00.325221 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37696fea-3eb6-4e48-8229-cf3a21b0e3be None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:00.338644 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed600517-723a-409d-88a0-c60e9132d93c None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:00.338937 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed600517-723a-409d-88a0-c60e9132d93c None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:00.339199 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed600517-723a-409d-88a0-c60e9132d93c None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:00.340980 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 483/963] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:40:00.346906 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6c2ae-c5b5-4ccf-9895-c3db7624d5ee None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:00.347190 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6c2ae-c5b5-4ccf-9895-c3db7624d5ee None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:00.347463 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6c2ae-c5b5-4ccf-9895-c3db7624d5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:00.364420 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290eac3d-f375-4706-9715-284d05864d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:00.364694 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-e1c6c2ae-c5b5-4ccf-9895-c3db7624d5ee None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:00.365023 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290eac3d-f375-4706-9715-284d05864d1b None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:00.365306 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290eac3d-f375-4706-9715-284d05864d1b None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:00.365628 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290eac3d-f375-4706-9715-284d05864d1b None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:00.365853 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-e1c6c2ae-c5b5-4ccf-9895-c3db7624d5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:00.366340 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290eac3d-f375-4706-9715-284d05864d1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:00.367960 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290eac3d-f375-4706-9715-284d05864d1b None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:00.385180 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.sql.core [None req-290eac3d-f375-4706-9715-284d05864d1b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Mar 08 13:40:00.385180 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Mar 08 13:40:00.385180 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [parameters: {'user_id': '6ffad8890bbe45c19821d769413be41f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Mar 08 13:40:00.385180 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=91154) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Mar 08 13:40:00.392181 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-290eac3d-f375-4706-9715-284d05864d1b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Mar 08 13:40:00.398203 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 481/964] 10.222.0.18 () {60 vars in 1131 bytes} [Tue Mar 8 13:40:00 2022] POST /identity/v3/users => generated 160 bytes in 169 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:40:00.400464 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290eac3d-f375-4706-9715-284d05864d1b None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:00.445644 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 484/965] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:40:00.470444 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6c2ae-c5b5-4ccf-9895-c3db7624d5ee None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:00.517092 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290eac3d-f375-4706-9715-284d05864d1b None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:00.553933 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cee35-2072-444a-8574-61b7d25a69a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:00.555086 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cee35-2072-444a-8574-61b7d25a69a3 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:00.555597 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cee35-2072-444a-8574-61b7d25a69a3 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:00.556063 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cee35-2072-444a-8574-61b7d25a69a3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:00.564557 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cee35-2072-444a-8574-61b7d25a69a3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:00.566567 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cee35-2072-444a-8574-61b7d25a69a3 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:00.576699 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6c2ae-c5b5-4ccf-9895-c3db7624d5ee None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:00.580954 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-e31cee35-2072-444a-8574-61b7d25a69a3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Mar 08 13:40:00.587633 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 482/966] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:40:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:40:00.589267 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cee35-2072-444a-8574-61b7d25a69a3 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:00.610995 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c931a5d-e25a-4d2e-add2-b8c9aa327347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:00.611801 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c931a5d-e25a-4d2e-add2-b8c9aa327347 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:00.612077 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c931a5d-e25a-4d2e-add2-b8c9aa327347 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:00.612345 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c931a5d-e25a-4d2e-add2-b8c9aa327347 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:00.622649 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c931a5d-e25a-4d2e-add2-b8c9aa327347 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:40:00.629962 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-0c931a5d-e25a-4d2e-add2-b8c9aa327347 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 13:40:00.636523 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 485/967] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Mar 8 13:40:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:40:00.637458 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c931a5d-e25a-4d2e-add2-b8c9aa327347 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:00.701774 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cee35-2072-444a-8574-61b7d25a69a3 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:00.736260 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a883b-7904-459e-8fee-87fd9dd89c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:00.736927 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a883b-7904-459e-8fee-87fd9dd89c6d None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:00.737205 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a883b-7904-459e-8fee-87fd9dd89c6d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:00.737533 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a883b-7904-459e-8fee-87fd9dd89c6d None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:00.738335 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a883b-7904-459e-8fee-87fd9dd89c6d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:00.738635 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a883b-7904-459e-8fee-87fd9dd89c6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:00.740037 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5a883b-7904-459e-8fee-87fd9dd89c6d None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:00.756964 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c931a5d-e25a-4d2e-add2-b8c9aa327347 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:00.785398 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 483/968] 10.222.0.18 () {56 vars in 1101 bytes} [Tue Mar 8 13:40:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:40:00.801378 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a433e-1d7a-4894-8ecd-e6346057266b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:00.802124 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a433e-1d7a-4894-8ecd-e6346057266b None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:00.802402 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a433e-1d7a-4894-8ecd-e6346057266b None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:00.802668 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a433e-1d7a-4894-8ecd-e6346057266b None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:00.803436 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a433e-1d7a-4894-8ecd-e6346057266b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:00.803738 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a433e-1d7a-4894-8ecd-e6346057266b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:00.805138 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a433e-1d7a-4894-8ecd-e6346057266b None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:00.814853 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 486/969] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Mar 8 13:40:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:40:00.820696 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a883b-7904-459e-8fee-87fd9dd89c6d None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:00.883852 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f29f7-a2be-451c-9d5e-6771d9d53804 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:00.884048 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f29f7-a2be-451c-9d5e-6771d9d53804 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:00.884302 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6f29f7-a2be-451c-9d5e-6771d9d53804 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:00.886595 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 487/970] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:00.897653 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e731a2d-2a0c-4193-961b-5506b209e782 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:00.898175 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e731a2d-2a0c-4193-961b-5506b209e782 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:00.898625 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e731a2d-2a0c-4193-961b-5506b209e782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:00.919699 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-3e731a2d-2a0c-4193-961b-5506b209e782 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:00.921313 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-3e731a2d-2a0c-4193-961b-5506b209e782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:00.936855 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5a883b-7904-459e-8fee-87fd9dd89c6d None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:00.975284 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e1391-7cf1-4858-990b-6b283d77f736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:00.976247 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e1391-7cf1-4858-990b-6b283d77f736 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:00.976638 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e1391-7cf1-4858-990b-6b283d77f736 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:00.977002 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e1391-7cf1-4858-990b-6b283d77f736 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:00.989200 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e1391-7cf1-4858-990b-6b283d77f736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:00.991015 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e1391-7cf1-4858-990b-6b283d77f736 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:01.017377 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 488/971] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:40:01.017592 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-d62e1391-7cf1-4858-990b-6b283d77f736 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:40:01.017742 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 484/972] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:40:01.023253 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e731a2d-2a0c-4193-961b-5506b209e782 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:01.033385 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e1391-7cf1-4858-990b-6b283d77f736 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:01.137602 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e731a2d-2a0c-4193-961b-5506b209e782 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:01.151320 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e1391-7cf1-4858-990b-6b283d77f736 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:01.175375 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e02db-3afc-4228-9172-493921673f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:01.176137 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e02db-3afc-4228-9172-493921673f7a None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:01.176484 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e02db-3afc-4228-9172-493921673f7a None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:01.176821 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e02db-3afc-4228-9172-493921673f7a None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:01.177646 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e02db-3afc-4228-9172-493921673f7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:01.177955 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e02db-3afc-4228-9172-493921673f7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:01.179349 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e02db-3afc-4228-9172-493921673f7a None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:01.185097 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138d996-0d41-4e5a-a29e-ccb686445672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:01.186094 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138d996-0d41-4e5a-a29e-ccb686445672 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:01.186211 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138d996-0d41-4e5a-a29e-ccb686445672 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:01.186462 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138d996-0d41-4e5a-a29e-ccb686445672 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:01.187108 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138d996-0d41-4e5a-a29e-ccb686445672 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:01.188437 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138d996-0d41-4e5a-a29e-ccb686445672 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:01.190906 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 489/973] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:01.196272 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e02db-3afc-4228-9172-493921673f7a None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:01.200695 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-b138d996-0d41-4e5a-a29e-ccb686445672 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 08 13:40:01.206727 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 485/974] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Mar 8 13:40:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:40:01.208039 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138d996-0d41-4e5a-a29e-ccb686445672 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:01.291713 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e02db-3afc-4228-9172-493921673f7a None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:01.316012 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138d996-0d41-4e5a-a29e-ccb686445672 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:01.324174 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17906467-185f-4ff9-8a7e-2df4c62ab62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:01.324980 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17906467-185f-4ff9-8a7e-2df4c62ab62b None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:01.325258 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17906467-185f-4ff9-8a7e-2df4c62ab62b None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:01.325557 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17906467-185f-4ff9-8a7e-2df4c62ab62b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:01.332885 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17906467-185f-4ff9-8a7e-2df4c62ab62b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:01.334346 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17906467-185f-4ff9-8a7e-2df4c62ab62b None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:01.347470 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-17906467-185f-4ff9-8a7e-2df4c62ab62b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Mar 08 13:40:01.347716 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac481a-60ee-4d96-bbd1-2d650a02cee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:01.348368 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac481a-60ee-4d96-bbd1-2d650a02cee7 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:01.348623 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 490/975] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Mar 8 13:40:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:40:01.348712 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac481a-60ee-4d96-bbd1-2d650a02cee7 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:01.348898 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac481a-60ee-4d96-bbd1-2d650a02cee7 None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:01.349623 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac481a-60ee-4d96-bbd1-2d650a02cee7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:01.349923 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac481a-60ee-4d96-bbd1-2d650a02cee7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:01.350664 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234a083-3761-4cb4-a8cf-71fc54f27593 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:01.350949 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234a083-3761-4cb4-a8cf-71fc54f27593 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:01.351217 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234a083-3761-4cb4-a8cf-71fc54f27593 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:01.351310 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac481a-60ee-4d96-bbd1-2d650a02cee7 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:01.353147 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 491/976] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:01.354274 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234a083-3761-4cb4-a8cf-71fc54f27593 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:01.361115 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 486/977] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Mar 8 13:40:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:01.361115 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617305c-6b1e-43f3-bc96-98c3911a39b8 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:01.361115 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617305c-6b1e-43f3-bc96-98c3911a39b8 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:01.361115 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617305c-6b1e-43f3-bc96-98c3911a39b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:01.375963 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-c617305c-6b1e-43f3-bc96-98c3911a39b8 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:01.377591 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-c617305c-6b1e-43f3-bc96-98c3911a39b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:01.441811 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 487/978] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:40:01.442663 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617305c-6b1e-43f3-bc96-98c3911a39b8 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:01.455018 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234a083-3761-4cb4-a8cf-71fc54f27593 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:01.488973 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842f436-2d1e-4556-8a88-f8781f59555f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:01.489670 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842f436-2d1e-4556-8a88-f8781f59555f None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:01.489951 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842f436-2d1e-4556-8a88-f8781f59555f None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:01.490228 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842f436-2d1e-4556-8a88-f8781f59555f None admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:01.491056 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842f436-2d1e-4556-8a88-f8781f59555f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:01.491355 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842f436-2d1e-4556-8a88-f8781f59555f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:01.492774 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842f436-2d1e-4556-8a88-f8781f59555f None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:01.509640 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 492/979] 10.222.0.18 () {56 vars in 1149 bytes} [Tue Mar 8 13:40:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:40:01.510274 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842f436-2d1e-4556-8a88-f8781f59555f None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:01.552414 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617305c-6b1e-43f3-bc96-98c3911a39b8 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:01.584858 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9ba35-6ee5-4bb0-adb8-2bc9439e77e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:01.585548 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9ba35-6ee5-4bb0-adb8-2bc9439e77e7 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:01.585824 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9ba35-6ee5-4bb0-adb8-2bc9439e77e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:01.586094 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9ba35-6ee5-4bb0-adb8-2bc9439e77e7 None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:01.586797 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9ba35-6ee5-4bb0-adb8-2bc9439e77e7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:01.587096 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9ba35-6ee5-4bb0-adb8-2bc9439e77e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:01.588467 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa9ba35-6ee5-4bb0-adb8-2bc9439e77e7 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:01.593219 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 488/980] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Mar 8 13:40:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:01.594023 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9ba35-6ee5-4bb0-adb8-2bc9439e77e7 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:01.603152 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842f436-2d1e-4556-8a88-f8781f59555f None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:01.635501 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad552af-3115-4ed2-bf24-1d537baa6bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:01.636555 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad552af-3115-4ed2-bf24-1d537baa6bd5 None admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:01.636878 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad552af-3115-4ed2-bf24-1d537baa6bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:01.637142 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad552af-3115-4ed2-bf24-1d537baa6bd5 None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:01.637947 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad552af-3115-4ed2-bf24-1d537baa6bd5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:01.639346 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad552af-3115-4ed2-bf24-1d537baa6bd5 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:01.652460 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 493/981] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Mar 8 13:40:01 2022] POST /identity/v3/services => generated 242 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:40:01.653221 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad552af-3115-4ed2-bf24-1d537baa6bd5 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:01.695025 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9ba35-6ee5-4bb0-adb8-2bc9439e77e7 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:01.738622 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f010a4d-8e6d-4006-84a1-e1fe18f89cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:01.739240 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f010a4d-8e6d-4006-84a1-e1fe18f89cd5 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:01.739520 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f010a4d-8e6d-4006-84a1-e1fe18f89cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:01.739790 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f010a4d-8e6d-4006-84a1-e1fe18f89cd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:01.764519 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad552af-3115-4ed2-bf24-1d537baa6bd5 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:01.799219 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef5917-1fd6-4e3c-a438-f5c1251654ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:01.799888 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef5917-1fd6-4e3c-a438-f5c1251654ab None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:01.800172 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef5917-1fd6-4e3c-a438-f5c1251654ab None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:01.800446 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef5917-1fd6-4e3c-a438-f5c1251654ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:01.801252 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef5917-1fd6-4e3c-a438-f5c1251654ab None admin] RBAC: Adding query filter params (interface=admin, service_id=eab2774071f747639c1185f97d33d10d, region_id=RegionOne) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:01.801595 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef5917-1fd6-4e3c-a438-f5c1251654ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:01.803007 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef5917-1fd6-4e3c-a438-f5c1251654ab None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:01.808583 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 494/982] 10.222.0.18 () {56 vars in 1249 bytes} [Tue Mar 8 13:40:01 2022] GET /identity/v3/endpoints?service_id=eab2774071f747639c1185f97d33d10d&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:01.810906 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f010a4d-8e6d-4006-84a1-e1fe18f89cd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:01.812364 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f010a4d-8e6d-4006-84a1-e1fe18f89cd5 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:01.814160 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef5917-1fd6-4e3c-a438-f5c1251654ab None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:01.913803 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 489/983] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:40:01 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:40:01.919164 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f010a4d-8e6d-4006-84a1-e1fe18f89cd5 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:01.923843 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef5917-1fd6-4e3c-a438-f5c1251654ab None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:01.959165 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de997f39-2786-4eb9-aad4-e7e9323230a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:01.959754 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de997f39-2786-4eb9-aad4-e7e9323230a9 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:01.960032 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de997f39-2786-4eb9-aad4-e7e9323230a9 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:01.960300 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de997f39-2786-4eb9-aad4-e7e9323230a9 None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:01.960976 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de997f39-2786-4eb9-aad4-e7e9323230a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:01.962385 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de997f39-2786-4eb9-aad4-e7e9323230a9 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:01.968653 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 495/984] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Mar 8 13:40:01 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:40:02.016199 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f010a4d-8e6d-4006-84a1-e1fe18f89cd5 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:02.053608 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d52b70-8cae-4f05-bea7-2d508db2f497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:02.054422 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d52b70-8cae-4f05-bea7-2d508db2f497 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:02.054677 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d52b70-8cae-4f05-bea7-2d508db2f497 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:02.054963 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d52b70-8cae-4f05-bea7-2d508db2f497 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:02.066436 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d52b70-8cae-4f05-bea7-2d508db2f497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:02.067899 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d52b70-8cae-4f05-bea7-2d508db2f497 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:02.085959 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-62d52b70-8cae-4f05-bea7-2d508db2f497 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:40:02.087468 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 490/985] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:40:02.093040 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de997f39-2786-4eb9-aad4-e7e9323230a9 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:02.195725 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de997f39-2786-4eb9-aad4-e7e9323230a9 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:02.227154 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc6969-64f8-41c3-890a-e986cd36b935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:02.227746 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc6969-64f8-41c3-890a-e986cd36b935 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:02.228026 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc6969-64f8-41c3-890a-e986cd36b935 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:02.228295 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc6969-64f8-41c3-890a-e986cd36b935 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:02.229020 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc6969-64f8-41c3-890a-e986cd36b935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:02.229328 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc6969-64f8-41c3-890a-e986cd36b935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:02.230785 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc6969-64f8-41c3-890a-e986cd36b935 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:02.242492 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 496/986] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:02.247956 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d52b70-8cae-4f05-bea7-2d508db2f497 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:02.348162 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d52b70-8cae-4f05-bea7-2d508db2f497 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:02.382386 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473942ec-091c-4be6-b2a6-dc322db58c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:02.383187 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473942ec-091c-4be6-b2a6-dc322db58c54 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:02.383462 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473942ec-091c-4be6-b2a6-dc322db58c54 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:02.383733 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473942ec-091c-4be6-b2a6-dc322db58c54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:02.390768 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473942ec-091c-4be6-b2a6-dc322db58c54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:02.392189 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473942ec-091c-4be6-b2a6-dc322db58c54 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:02.405292 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-473942ec-091c-4be6-b2a6-dc322db58c54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:40:02.411147 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 491/987] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:40:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:40:02.412373 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc6969-64f8-41c3-890a-e986cd36b935 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:02.508842 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc6969-64f8-41c3-890a-e986cd36b935 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:02.542489 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f9630-a1ba-4ca8-a72e-c9e11bda0b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:02.543143 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f9630-a1ba-4ca8-a72e-c9e11bda0b36 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:02.543427 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f9630-a1ba-4ca8-a72e-c9e11bda0b36 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:02.543678 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f9630-a1ba-4ca8-a72e-c9e11bda0b36 None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:02.544483 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f9630-a1ba-4ca8-a72e-c9e11bda0b36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:02.544794 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f9630-a1ba-4ca8-a72e-c9e11bda0b36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:02.546242 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f9630-a1ba-4ca8-a72e-c9e11bda0b36 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:02.562581 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 497/988] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:40:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:02.564470 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473942ec-091c-4be6-b2a6-dc322db58c54 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:02.662015 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473942ec-091c-4be6-b2a6-dc322db58c54 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:02.695509 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c057447-73df-4070-ad8e-e43cd2aa3425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:02.696158 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c057447-73df-4070-ad8e-e43cd2aa3425 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:02.696433 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c057447-73df-4070-ad8e-e43cd2aa3425 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:02.696713 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c057447-73df-4070-ad8e-e43cd2aa3425 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:02.697553 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c057447-73df-4070-ad8e-e43cd2aa3425 None admin] RBAC: Adding query filter params (role.id=1ad7159416cf4d999f172e7806e1a652, scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e, user.id=817bcd2c5f6e4bceb049eeb122d4e432) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:02.697888 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c057447-73df-4070-ad8e-e43cd2aa3425 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:02.699316 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c057447-73df-4070-ad8e-e43cd2aa3425 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:02.705743 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 492/989] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:40:02 2022] GET /identity/v3/role_assignments?user.id=817bcd2c5f6e4bceb049eeb122d4e432&scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e&role.id=1ad7159416cf4d999f172e7806e1a652 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:03.940594 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5275cc-bc35-4ebb-b5c8-b580d61a6ae8 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:03.941135 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5275cc-bc35-4ebb-b5c8-b580d61a6ae8 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:03.941135 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5275cc-bc35-4ebb-b5c8-b580d61a6ae8 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:03.943125 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 498/990] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:03.948251 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b86a15-000d-4983-8615-03a220b675ad None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:03.948687 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b86a15-000d-4983-8615-03a220b675ad None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:03.948770 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b86a15-000d-4983-8615-03a220b675ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:03.965754 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-70b86a15-000d-4983-8615-03a220b675ad None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:03.966906 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-70b86a15-000d-4983-8615-03a220b675ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:04.032154 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 493/991] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:40:04.054463 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5275cc-bc35-4ebb-b5c8-b580d61a6ae8 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:04.155945 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5275cc-bc35-4ebb-b5c8-b580d61a6ae8 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:04.189103 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a06c2-de73-4cac-8875-10e6d1a29991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:04.189939 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a06c2-de73-4cac-8875-10e6d1a29991 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:04.190220 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a06c2-de73-4cac-8875-10e6d1a29991 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:04.190491 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a06c2-de73-4cac-8875-10e6d1a29991 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:04.191185 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a06c2-de73-4cac-8875-10e6d1a29991 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:04.192503 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a06c2-de73-4cac-8875-10e6d1a29991 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:04.203287 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-4a9a06c2-de73-4cac-8875-10e6d1a29991 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 08 13:40:04.204683 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 499/992] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:40:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:40:04.210627 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b86a15-000d-4983-8615-03a220b675ad None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:04.243709 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38221bd-8044-426f-874f-461375dce6b1 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:04.244015 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38221bd-8044-426f-874f-461375dce6b1 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:04.244456 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38221bd-8044-426f-874f-461375dce6b1 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:04.247328 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 500/993] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:40:04.252340 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed480aa9-9d11-4a17-9f99-c910ca299e58 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:04.252781 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed480aa9-9d11-4a17-9f99-c910ca299e58 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:04.253136 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed480aa9-9d11-4a17-9f99-c910ca299e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:04.269790 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-ed480aa9-9d11-4a17-9f99-c910ca299e58 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:04.270953 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-ed480aa9-9d11-4a17-9f99-c910ca299e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:04.311149 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b86a15-000d-4983-8615-03a220b675ad None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:04.337416 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 501/994] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:40:04.345745 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce846a-4d24-4865-8886-2664edc3c356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:04.346415 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce846a-4d24-4865-8886-2664edc3c356 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:04.346692 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce846a-4d24-4865-8886-2664edc3c356 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:04.346962 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce846a-4d24-4865-8886-2664edc3c356 None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:04.347683 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce846a-4d24-4865-8886-2664edc3c356 None admin] RBAC: Adding query filter params (name=compute) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:04.347988 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce846a-4d24-4865-8886-2664edc3c356 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:04.349347 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce846a-4d24-4865-8886-2664edc3c356 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:04.354189 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 494/995] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Mar 8 13:40:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:04.359704 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed480aa9-9d11-4a17-9f99-c910ca299e58 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:04.362178 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce846a-4d24-4865-8886-2664edc3c356 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:04.456485 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce846a-4d24-4865-8886-2664edc3c356 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:04.463234 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed480aa9-9d11-4a17-9f99-c910ca299e58 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:04.492698 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f6f28-1457-40d5-bec8-2e79972a88d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:04.493553 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f6f28-1457-40d5-bec8-2e79972a88d4 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:04.493838 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f6f28-1457-40d5-bec8-2e79972a88d4 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:04.494100 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f6f28-1457-40d5-bec8-2e79972a88d4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:04.494812 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f6f28-1457-40d5-bec8-2e79972a88d4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:04.496164 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f6f28-1457-40d5-bec8-2e79972a88d4 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:04.500840 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbd2b4-0b75-43db-b1a5-e03d05ae9b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:04.500840 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbd2b4-0b75-43db-b1a5-e03d05ae9b6c None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:04.500840 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbd2b4-0b75-43db-b1a5-e03d05ae9b6c None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:04.500840 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbd2b4-0b75-43db-b1a5-e03d05ae9b6c None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:04.501176 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbd2b4-0b75-43db-b1a5-e03d05ae9b6c None admin] RBAC: Adding query filter params (type=compute) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:04.501176 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbd2b4-0b75-43db-b1a5-e03d05ae9b6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:04.501489 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbd2b4-0b75-43db-b1a5-e03d05ae9b6c None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:04.506661 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 502/996] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Mar 8 13:40:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:04.510708 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-835f6f28-1457-40d5-bec8-2e79972a88d4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Mar 08 13:40:04.511994 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 495/997] 10.222.0.18 () {56 vars in 1126 bytes} [Tue Mar 8 13:40:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:40:04.512160 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbd2b4-0b75-43db-b1a5-e03d05ae9b6c None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:04.517576 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f6f28-1457-40d5-bec8-2e79972a88d4 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:04.612482 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbd2b4-0b75-43db-b1a5-e03d05ae9b6c None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:04.614874 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f6f28-1457-40d5-bec8-2e79972a88d4 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:04.646344 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeadba5-ba7e-4e39-bd23-25da2f5ea81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:04.647036 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeadba5-ba7e-4e39-bd23-25da2f5ea81a None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:04.647338 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeadba5-ba7e-4e39-bd23-25da2f5ea81a None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:04.647616 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeadba5-ba7e-4e39-bd23-25da2f5ea81a None admin] PATH_INFO: `/v3/endpoints` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:04.648413 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeadba5-ba7e-4e39-bd23-25da2f5ea81a None admin] RBAC: Adding query filter params (interface=public, service_id=7ac45663e42a41f88b263cc3ca88c429, region_id=RegionOne) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:04.648526 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b853f-73eb-4816-8c43-14ba484a9dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:04.648704 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeadba5-ba7e-4e39-bd23-25da2f5ea81a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:04.649171 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b853f-73eb-4816-8c43-14ba484a9dbf None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:04.649479 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b853f-73eb-4816-8c43-14ba484a9dbf None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:04.649752 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b853f-73eb-4816-8c43-14ba484a9dbf None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:04.650150 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeadba5-ba7e-4e39-bd23-25da2f5ea81a None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:04.650471 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b853f-73eb-4816-8c43-14ba484a9dbf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:04.650812 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b853f-73eb-4816-8c43-14ba484a9dbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:04.652187 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b853f-73eb-4816-8c43-14ba484a9dbf None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:04.657157 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 503/998] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Mar 8 13:40:04 2022] GET /identity/v3/endpoints?service_id=7ac45663e42a41f88b263cc3ca88c429&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:40:04.662496 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 496/999] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Mar 8 13:40:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:40:04.662679 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeadba5-ba7e-4e39-bd23-25da2f5ea81a None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:04.663384 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b853f-73eb-4816-8c43-14ba484a9dbf None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:04.758840 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b853f-73eb-4816-8c43-14ba484a9dbf None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:04.759145 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeadba5-ba7e-4e39-bd23-25da2f5ea81a None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:04.792013 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e922e93-2f42-4cc3-b85b-e698a62b706b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:04.792673 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e922e93-2f42-4cc3-b85b-e698a62b706b None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:04.792953 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e922e93-2f42-4cc3-b85b-e698a62b706b None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:04.793220 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e922e93-2f42-4cc3-b85b-e698a62b706b None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:04.793952 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e922e93-2f42-4cc3-b85b-e698a62b706b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:04.794139 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26716476-93bf-455f-b2ab-94a940a72480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:04.794258 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e922e93-2f42-4cc3-b85b-e698a62b706b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:04.794785 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26716476-93bf-455f-b2ab-94a940a72480 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:04.795062 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26716476-93bf-455f-b2ab-94a940a72480 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:04.795337 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26716476-93bf-455f-b2ab-94a940a72480 None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:04.795575 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e922e93-2f42-4cc3-b85b-e698a62b706b None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:04.795996 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26716476-93bf-455f-b2ab-94a940a72480 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:04.797382 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26716476-93bf-455f-b2ab-94a940a72480 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:04.800574 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 497/1000] 10.222.0.18 () {56 vars in 1122 bytes} [Tue Mar 8 13:40:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:04.805556 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 504/1001] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Mar 8 13:40:04 2022] GET /identity/v3/services => generated 1727 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:40:04.805864 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e922e93-2f42-4cc3-b85b-e698a62b706b None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:04.914467 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e922e93-2f42-4cc3-b85b-e698a62b706b None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:04.950426 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2a975-4809-421c-ab18-ce0dd51d54c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:04.951099 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2a975-4809-421c-ab18-ce0dd51d54c4 None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:04.951406 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2a975-4809-421c-ab18-ce0dd51d54c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:04.951631 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2a975-4809-421c-ab18-ce0dd51d54c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:04.952373 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2a975-4809-421c-ab18-ce0dd51d54c4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:04.953779 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2a975-4809-421c-ab18-ce0dd51d54c4 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:04.970399 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 498/1002] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Mar 8 13:40:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:40:05.005913 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920086a7-69be-49c6-bcd3-8d435e67c4c1 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:05.006499 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920086a7-69be-49c6-bcd3-8d435e67c4c1 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:05.006499 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920086a7-69be-49c6-bcd3-8d435e67c4c1 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:05.008258 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 505/1003] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:05.014705 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6ba03-21e2-4384-9460-2dcf6c7a4b68 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:05.015024 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6ba03-21e2-4384-9460-2dcf6c7a4b68 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:05.015203 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6ba03-21e2-4384-9460-2dcf6c7a4b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:05.033858 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-aca6ba03-21e2-4384-9460-2dcf6c7a4b68 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:05.035071 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-aca6ba03-21e2-4384-9460-2dcf6c7a4b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:05.113786 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 499/1004] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:05 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:40:05.136069 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920086a7-69be-49c6-bcd3-8d435e67c4c1 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:05.238231 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920086a7-69be-49c6-bcd3-8d435e67c4c1 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:05.269949 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f2789-4e70-492d-9c81-df6f3ad86c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:05.270652 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f2789-4e70-492d-9c81-df6f3ad86c26 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:05.270925 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f2789-4e70-492d-9c81-df6f3ad86c26 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:05.271188 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f2789-4e70-492d-9c81-df6f3ad86c26 None admin] PATH_INFO: `/v3/services/image` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:05.271826 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f2789-4e70-492d-9c81-df6f3ad86c26 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:05.273182 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f2789-4e70-492d-9c81-df6f3ad86c26 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:05.283834 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-861f2789-4e70-492d-9c81-df6f3ad86c26 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 08 13:40:05.285220 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 506/1005] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Mar 8 13:40:05 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:40:05.290901 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6ba03-21e2-4384-9460-2dcf6c7a4b68 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:05.391897 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6ba03-21e2-4384-9460-2dcf6c7a4b68 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:05.425841 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de172b67-3e60-4bb7-b531-77d0383e3d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:05.426507 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de172b67-3e60-4bb7-b531-77d0383e3d60 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:05.426781 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de172b67-3e60-4bb7-b531-77d0383e3d60 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:05.427045 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de172b67-3e60-4bb7-b531-77d0383e3d60 None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:05.427790 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de172b67-3e60-4bb7-b531-77d0383e3d60 None admin] RBAC: Adding query filter params (name=image) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:05.428096 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de172b67-3e60-4bb7-b531-77d0383e3d60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:05.429459 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de172b67-3e60-4bb7-b531-77d0383e3d60 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:05.434282 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 500/1006] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:40:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:05.440091 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f2789-4e70-492d-9c81-df6f3ad86c26 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:05.546301 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f2789-4e70-492d-9c81-df6f3ad86c26 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:05.579189 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55a9818-6dcb-40b0-b3a6-38ce3063a258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:05.579855 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a9818-6dcb-40b0-b3a6-38ce3063a258 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:05.580132 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a9818-6dcb-40b0-b3a6-38ce3063a258 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:05.580402 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55a9818-6dcb-40b0-b3a6-38ce3063a258 None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:05.581102 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a9818-6dcb-40b0-b3a6-38ce3063a258 None admin] RBAC: Adding query filter params (type=image) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:05.581439 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a9818-6dcb-40b0-b3a6-38ce3063a258 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:05.582860 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55a9818-6dcb-40b0-b3a6-38ce3063a258 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:05.587311 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 507/1007] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:40:05 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:07.103395 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f946b-c270-4510-aed7-8ad9cb2d6d86 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:07.103973 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f946b-c270-4510-aed7-8ad9cb2d6d86 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:07.103973 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f946b-c270-4510-aed7-8ad9cb2d6d86 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:07.106012 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 501/1008] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:07.111413 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278da9c2-87ef-4236-ada3-4ffdb6395969 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:07.111838 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278da9c2-87ef-4236-ada3-4ffdb6395969 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:07.111914 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278da9c2-87ef-4236-ada3-4ffdb6395969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:07.129111 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-278da9c2-87ef-4236-ada3-4ffdb6395969 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:07.130339 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-278da9c2-87ef-4236-ada3-4ffdb6395969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:07.196931 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 508/1009] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:07 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:40:07.219539 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f946b-c270-4510-aed7-8ad9cb2d6d86 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:07.251534 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d79272-0c63-4a46-bb75-1b57f382c784 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:07.252203 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d79272-0c63-4a46-bb75-1b57f382c784 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:07.252537 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d79272-0c63-4a46-bb75-1b57f382c784 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:07.254472 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 509/1010] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:07.259506 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4993f-084d-49b6-93b3-0380a639aa83 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:07.259969 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4993f-084d-49b6-93b3-0380a639aa83 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:07.260241 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4993f-084d-49b6-93b3-0380a639aa83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:07.279543 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-52e4993f-084d-49b6-93b3-0380a639aa83 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:07.280830 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-52e4993f-084d-49b6-93b3-0380a639aa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:07.323826 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f946b-c270-4510-aed7-8ad9cb2d6d86 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:07.349483 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 510/1011] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:07 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:40:07.357217 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91a397-3763-4c3b-8690-6c911d3c9044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:07.358224 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91a397-3763-4c3b-8690-6c911d3c9044 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:07.358665 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91a397-3763-4c3b-8690-6c911d3c9044 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:07.359074 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa91a397-3763-4c3b-8690-6c911d3c9044 None admin] PATH_INFO: `/v3/services/compute` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:07.359861 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91a397-3763-4c3b-8690-6c911d3c9044 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:07.361343 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa91a397-3763-4c3b-8690-6c911d3c9044 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:07.372265 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-fa91a397-3763-4c3b-8690-6c911d3c9044 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Mar 08 13:40:07.372438 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4993f-084d-49b6-93b3-0380a639aa83 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:07.374039 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 502/1012] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:40:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:40:07.379651 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91a397-3763-4c3b-8690-6c911d3c9044 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:07.466818 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4993f-084d-49b6-93b3-0380a639aa83 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:07.485219 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa91a397-3763-4c3b-8690-6c911d3c9044 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:07.506670 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7736bec-0fe7-429c-987f-f0ef4ee428b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:07.507841 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7736bec-0fe7-429c-987f-f0ef4ee428b8 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:07.507841 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7736bec-0fe7-429c-987f-f0ef4ee428b8 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:07.508012 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7736bec-0fe7-429c-987f-f0ef4ee428b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:07.509210 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7736bec-0fe7-429c-987f-f0ef4ee428b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:07.510756 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7736bec-0fe7-429c-987f-f0ef4ee428b8 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:07.512556 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 511/1013] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:40:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:40:07.518107 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7736bec-0fe7-429c-987f-f0ef4ee428b8 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:07.521281 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c022b8-5127-49af-89e3-3f6360eba03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:07.522788 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c022b8-5127-49af-89e3-3f6360eba03b None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:07.523069 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c022b8-5127-49af-89e3-3f6360eba03b None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:07.523340 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c022b8-5127-49af-89e3-3f6360eba03b None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:07.524047 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c022b8-5127-49af-89e3-3f6360eba03b None admin] RBAC: Adding query filter params (name=compute) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:07.524347 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c022b8-5127-49af-89e3-3f6360eba03b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:07.525760 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c022b8-5127-49af-89e3-3f6360eba03b None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:07.536142 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 503/1014] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Mar 8 13:40:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:40:07.537262 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c022b8-5127-49af-89e3-3f6360eba03b None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:07.616743 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7736bec-0fe7-429c-987f-f0ef4ee428b8 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:07.645294 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c022b8-5127-49af-89e3-3f6360eba03b None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:07.651011 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5b542-5af9-43f9-807a-b8e88bfee3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:07.651673 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5b542-5af9-43f9-807a-b8e88bfee3d2 None admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:07.651949 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5b542-5af9-43f9-807a-b8e88bfee3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:07.652237 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5b542-5af9-43f9-807a-b8e88bfee3d2 None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:07.652930 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c5b542-5af9-43f9-807a-b8e88bfee3d2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:07.654707 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c5b542-5af9-43f9-807a-b8e88bfee3d2 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:07.679139 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd516d-7456-48d4-9209-ed55bc4534aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:07.679853 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd516d-7456-48d4-9209-ed55bc4534aa None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:07.680140 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd516d-7456-48d4-9209-ed55bc4534aa None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:07.680421 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd516d-7456-48d4-9209-ed55bc4534aa None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:07.681745 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd516d-7456-48d4-9209-ed55bc4534aa None admin] RBAC: Adding query filter params (type=compute) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:07.682040 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd516d-7456-48d4-9209-ed55bc4534aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:07.683424 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd516d-7456-48d4-9209-ed55bc4534aa None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:07.685182 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 512/1015] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Mar 8 13:40:07 2022] POST /identity/v3/projects => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:40:07.697463 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 504/1016] 10.222.0.18 () {56 vars in 1112 bytes} [Tue Mar 8 13:40:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:07.706611 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5b542-5af9-43f9-807a-b8e88bfee3d2 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:07.813088 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5b542-5af9-43f9-807a-b8e88bfee3d2 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:07.847945 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276b2a1-a970-4b36-9a60-e76a93db8ea9 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:07.848306 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276b2a1-a970-4b36-9a60-e76a93db8ea9 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:07.848497 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3276b2a1-a970-4b36-9a60-e76a93db8ea9 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:07.849369 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e089898-d6a6-4090-957c-36d4fc0dc596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:07.850047 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e089898-d6a6-4090-957c-36d4fc0dc596 None admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:07.850514 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e089898-d6a6-4090-957c-36d4fc0dc596 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:07.850615 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 505/1017] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:40:07.850688 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e089898-d6a6-4090-957c-36d4fc0dc596 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:07.851340 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e089898-d6a6-4090-957c-36d4fc0dc596 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:07.852739 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e089898-d6a6-4090-957c-36d4fc0dc596 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:07.856126 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ef14c-5e77-4629-9750-eda71e218c1e None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:07.856413 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ef14c-5e77-4629-9750-eda71e218c1e None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:07.856682 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ef14c-5e77-4629-9750-eda71e218c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:07.873489 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 513/1018] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Mar 8 13:40:07 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:40:07.882490 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-321ef14c-5e77-4629-9750-eda71e218c1e None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:07.884017 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-321ef14c-5e77-4629-9750-eda71e218c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:07.963521 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 506/1019] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:07 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:40:07.986628 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e089898-d6a6-4090-957c-36d4fc0dc596 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:08.092419 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e089898-d6a6-4090-957c-36d4fc0dc596 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:08.126523 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5e40bd-b219-4e9a-b6a4-04c4f6e7e222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:08.127126 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e40bd-b219-4e9a-b6a4-04c4f6e7e222 None admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:08.127378 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e40bd-b219-4e9a-b6a4-04c4f6e7e222 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:08.127657 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e40bd-b219-4e9a-b6a4-04c4f6e7e222 None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:08.128432 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e40bd-b219-4e9a-b6a4-04c4f6e7e222 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:08.129848 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5e40bd-b219-4e9a-b6a4-04c4f6e7e222 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:08.143900 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 514/1020] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Mar 8 13:40:07 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:40:10.012736 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072d872-84e8-461f-b323-0b9b0905165b None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:10.013318 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072d872-84e8-461f-b323-0b9b0905165b None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:10.013318 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072d872-84e8-461f-b323-0b9b0905165b None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:10.015330 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 507/1021] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:10.020709 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ad72d-b901-4dcc-844e-70c87a30b6ec None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:10.021146 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ad72d-b901-4dcc-844e-70c87a30b6ec None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:10.021324 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ad72d-b901-4dcc-844e-70c87a30b6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:10.039225 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-735ad72d-b901-4dcc-844e-70c87a30b6ec None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:10.040428 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-735ad72d-b901-4dcc-844e-70c87a30b6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:10.120309 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 515/1022] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:40:10.145126 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072d872-84e8-461f-b323-0b9b0905165b None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:10.247448 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072d872-84e8-461f-b323-0b9b0905165b None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:10.281964 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bbe1d-eb4a-42d3-bae1-93477d4baaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:10.282767 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bbe1d-eb4a-42d3-bae1-93477d4baaa7 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:10.283050 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bbe1d-eb4a-42d3-bae1-93477d4baaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:10.283319 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bbe1d-eb4a-42d3-bae1-93477d4baaa7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:10.283447 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d580964-f8c3-4d53-a392-ce67ced032cc None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:10.283696 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d580964-f8c3-4d53-a392-ce67ced032cc None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:10.283974 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d580964-f8c3-4d53-a392-ce67ced032cc None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:10.284575 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bbe1d-eb4a-42d3-bae1-93477d4baaa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:10.285920 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 516/1023] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:40:10.286044 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bbe1d-eb4a-42d3-bae1-93477d4baaa7 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:10.292294 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 508/1024] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:40:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:10.293557 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bbe1d-eb4a-42d3-bae1-93477d4baaa7 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:10.293685 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59a561-e05b-4148-9322-bb5ddf262de3 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:10.293973 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59a561-e05b-4148-9322-bb5ddf262de3 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:10.294248 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59a561-e05b-4148-9322-bb5ddf262de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:10.310519 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-ce59a561-e05b-4148-9322-bb5ddf262de3 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:10.311711 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-ce59a561-e05b-4148-9322-bb5ddf262de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:10.382613 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 517/1025] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:40:10.392477 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bbe1d-eb4a-42d3-bae1-93477d4baaa7 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:10.405781 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59a561-e05b-4148-9322-bb5ddf262de3 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:10.426434 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134ee3b-293a-47c3-b32a-bb7547f70f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:10.427104 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134ee3b-293a-47c3-b32a-bb7547f70f21 None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:10.427384 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134ee3b-293a-47c3-b32a-bb7547f70f21 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:10.427653 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134ee3b-293a-47c3-b32a-bb7547f70f21 None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:10.428373 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134ee3b-293a-47c3-b32a-bb7547f70f21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:10.429849 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134ee3b-293a-47c3-b32a-bb7547f70f21 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:10.449726 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 509/1026] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Mar 8 13:40:10 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:40:10.450975 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439881e0-4af8-4487-a881-de60a1ecb35a None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:10.451255 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439881e0-4af8-4487-a881-de60a1ecb35a None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:10.451524 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439881e0-4af8-4487-a881-de60a1ecb35a None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:10.453453 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 510/1027] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:10.460111 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3350c1-ad11-4d6b-8466-ab16974fa9a7 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:10.460111 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3350c1-ad11-4d6b-8466-ab16974fa9a7 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:10.460386 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3350c1-ad11-4d6b-8466-ab16974fa9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:10.481187 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-1e3350c1-ad11-4d6b-8466-ab16974fa9a7 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:10.482435 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-1e3350c1-ad11-4d6b-8466-ab16974fa9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:10.509877 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59a561-e05b-4148-9322-bb5ddf262de3 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:10.546035 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6383ef7-a530-4237-9f6d-0dc6191051b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:10.546891 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6383ef7-a530-4237-9f6d-0dc6191051b4 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:10.547222 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6383ef7-a530-4237-9f6d-0dc6191051b4 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:10.547491 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6383ef7-a530-4237-9f6d-0dc6191051b4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:10.558692 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6383ef7-a530-4237-9f6d-0dc6191051b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:40:10.564589 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 511/1028] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:40:10.566996 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-c6383ef7-a530-4237-9f6d-0dc6191051b4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 13:40:10.568454 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 518/1029] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Mar 8 13:40:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:40:10.574593 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3350c1-ad11-4d6b-8466-ab16974fa9a7 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:10.591493 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6383ef7-a530-4237-9f6d-0dc6191051b4 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:10.680809 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3350c1-ad11-4d6b-8466-ab16974fa9a7 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:10.700745 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6383ef7-a530-4237-9f6d-0dc6191051b4 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:10.725243 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567b604-6ac5-4dff-b6b6-7f55a629ea7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:10.726034 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567b604-6ac5-4dff-b6b6-7f55a629ea7d None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:10.726428 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567b604-6ac5-4dff-b6b6-7f55a629ea7d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:10.726853 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567b604-6ac5-4dff-b6b6-7f55a629ea7d None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:10.727878 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567b604-6ac5-4dff-b6b6-7f55a629ea7d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:10.728420 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567b604-6ac5-4dff-b6b6-7f55a629ea7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:10.730362 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5567b604-6ac5-4dff-b6b6-7f55a629ea7d None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:10.740178 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 512/1030] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Mar 8 13:40:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:10.744704 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da791c47-c052-42fe-b363-3221fc6ab372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:10.745488 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567b604-6ac5-4dff-b6b6-7f55a629ea7d None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:10.745592 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da791c47-c052-42fe-b363-3221fc6ab372 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:10.745871 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da791c47-c052-42fe-b363-3221fc6ab372 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:10.746081 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da791c47-c052-42fe-b363-3221fc6ab372 None admin] PATH_INFO: `/v3/services/image` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:10.746742 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da791c47-c052-42fe-b363-3221fc6ab372 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:10.748131 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da791c47-c052-42fe-b363-3221fc6ab372 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:10.759164 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-da791c47-c052-42fe-b363-3221fc6ab372 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 08 13:40:10.760675 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 519/1031] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Mar 8 13:40:10 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:40:10.766135 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da791c47-c052-42fe-b363-3221fc6ab372 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:10.841083 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567b604-6ac5-4dff-b6b6-7f55a629ea7d None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:10.859684 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da791c47-c052-42fe-b363-3221fc6ab372 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:10.872959 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81597a-5dfa-48f4-af99-85d1c69f85d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:10.873787 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81597a-5dfa-48f4-af99-85d1c69f85d5 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:10.874069 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81597a-5dfa-48f4-af99-85d1c69f85d5 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:10.874340 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81597a-5dfa-48f4-af99-85d1c69f85d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:10.885107 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81597a-5dfa-48f4-af99-85d1c69f85d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:10.886571 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81597a-5dfa-48f4-af99-85d1c69f85d5 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:10.893334 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fa7b7-c9a1-4468-b644-0ee5d3803205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:10.894224 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fa7b7-c9a1-4468-b644-0ee5d3803205 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:10.894685 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fa7b7-c9a1-4468-b644-0ee5d3803205 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:10.895030 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fa7b7-c9a1-4468-b644-0ee5d3803205 None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:10.895750 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fa7b7-c9a1-4468-b644-0ee5d3803205 None admin] RBAC: Adding query filter params (name=image) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:10.896049 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fa7b7-c9a1-4468-b644-0ee5d3803205 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:10.897435 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fa7b7-c9a1-4468-b644-0ee5d3803205 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:10.902531 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 520/1032] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:40:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:40:10.903268 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-5a81597a-5dfa-48f4-af99-85d1c69f85d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:40:10.904928 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 513/1033] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:40:10.909621 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fa7b7-c9a1-4468-b644-0ee5d3803205 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:10.910552 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81597a-5dfa-48f4-af99-85d1c69f85d5 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:11.005574 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fa7b7-c9a1-4468-b644-0ee5d3803205 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:11.008711 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81597a-5dfa-48f4-af99-85d1c69f85d5 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:11.038603 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb583079-5660-40f6-a1e7-c7003495b640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:11.039265 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb583079-5660-40f6-a1e7-c7003495b640 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:11.039536 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb583079-5660-40f6-a1e7-c7003495b640 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:11.039805 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb583079-5660-40f6-a1e7-c7003495b640 None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:11.040500 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb583079-5660-40f6-a1e7-c7003495b640 None admin] RBAC: Adding query filter params (type=image) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:11.040842 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb583079-5660-40f6-a1e7-c7003495b640 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:11.042224 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb583079-5660-40f6-a1e7-c7003495b640 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:11.042722 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9d6cd-2294-40d0-9f16-f5a1a9bf2bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:11.043378 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9d6cd-2294-40d0-9f16-f5a1a9bf2bdd None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:11.043656 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9d6cd-2294-40d0-9f16-f5a1a9bf2bdd None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:11.043928 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9d6cd-2294-40d0-9f16-f5a1a9bf2bdd None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:11.044643 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9d6cd-2294-40d0-9f16-f5a1a9bf2bdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:11.044942 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9d6cd-2294-40d0-9f16-f5a1a9bf2bdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:11.046299 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9d6cd-2294-40d0-9f16-f5a1a9bf2bdd None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:11.051817 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 521/1034] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:40:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:40:11.052447 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb583079-5660-40f6-a1e7-c7003495b640 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:11.062602 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 514/1035] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:40:11.063595 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9d6cd-2294-40d0-9f16-f5a1a9bf2bdd None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:11.148658 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb583079-5660-40f6-a1e7-c7003495b640 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:11.158057 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9d6cd-2294-40d0-9f16-f5a1a9bf2bdd None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:11.181630 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25492c-a4b6-41d9-bc4f-441576bde799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:11.182288 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25492c-a4b6-41d9-bc4f-441576bde799 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:11.182567 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25492c-a4b6-41d9-bc4f-441576bde799 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:11.182839 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25492c-a4b6-41d9-bc4f-441576bde799 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:11.183627 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25492c-a4b6-41d9-bc4f-441576bde799 None admin] RBAC: Adding query filter params (interface=public, service_id=9d47c1201e6848b890bc0b19fe241f35, region_id=RegionOne) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:11.183931 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25492c-a4b6-41d9-bc4f-441576bde799 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:11.185420 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25492c-a4b6-41d9-bc4f-441576bde799 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:11.194837 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 522/1036] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Mar 8 13:40:11 2022] GET /identity/v3/endpoints?service_id=9d47c1201e6848b890bc0b19fe241f35&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:40:11.194988 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8cc1e-531a-4de3-a240-ac67ad665b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:11.194988 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8cc1e-531a-4de3-a240-ac67ad665b71 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:11.194988 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8cc1e-531a-4de3-a240-ac67ad665b71 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:11.194988 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8cc1e-531a-4de3-a240-ac67ad665b71 None admin] PATH_INFO: `/v3/users/nova` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:11.195676 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25492c-a4b6-41d9-bc4f-441576bde799 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:11.201063 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8cc1e-531a-4de3-a240-ac67ad665b71 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:11.202517 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8cc1e-531a-4de3-a240-ac67ad665b71 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:11.216306 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-cfc8cc1e-531a-4de3-a240-ac67ad665b71 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 13:40:11.217875 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 515/1037] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Mar 8 13:40:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:40:11.223114 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8cc1e-531a-4de3-a240-ac67ad665b71 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:11.296314 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25492c-a4b6-41d9-bc4f-441576bde799 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:11.320094 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8cc1e-531a-4de3-a240-ac67ad665b71 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:11.328947 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099906c0-1c2b-423c-8b74-962d2bd2eab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:11.329653 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099906c0-1c2b-423c-8b74-962d2bd2eab9 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:11.329929 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099906c0-1c2b-423c-8b74-962d2bd2eab9 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:11.330197 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099906c0-1c2b-423c-8b74-962d2bd2eab9 None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:11.330848 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099906c0-1c2b-423c-8b74-962d2bd2eab9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:11.332211 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099906c0-1c2b-423c-8b74-962d2bd2eab9 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:11.338741 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 523/1038] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Mar 8 13:40:11 2022] GET /identity/v3/services => generated 1957 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:40:11.353743 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1af06e-c25e-4369-99d8-5cc923983a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:11.354685 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1af06e-c25e-4369-99d8-5cc923983a6a None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:11.355132 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1af06e-c25e-4369-99d8-5cc923983a6a None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:11.355544 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1af06e-c25e-4369-99d8-5cc923983a6a None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:11.356559 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1af06e-c25e-4369-99d8-5cc923983a6a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:11.357018 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1af06e-c25e-4369-99d8-5cc923983a6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:11.358688 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1af06e-c25e-4369-99d8-5cc923983a6a None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:11.383039 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 516/1039] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Mar 8 13:40:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:40:11.384738 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099906c0-1c2b-423c-8b74-962d2bd2eab9 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:11.492137 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099906c0-1c2b-423c-8b74-962d2bd2eab9 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:11.528144 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effec286-eaa7-465a-a342-aa64d0483093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:11.529099 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effec286-eaa7-465a-a342-aa64d0483093 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:11.529442 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effec286-eaa7-465a-a342-aa64d0483093 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:11.530254 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effec286-eaa7-465a-a342-aa64d0483093 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:11.594917 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effec286-eaa7-465a-a342-aa64d0483093 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:11.596357 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effec286-eaa7-465a-a342-aa64d0483093 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:11.693592 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 524/1040] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:40:11 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:40:11.699417 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1af06e-c25e-4369-99d8-5cc923983a6a None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:11.796293 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1af06e-c25e-4369-99d8-5cc923983a6a None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:11.827354 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e1bcf-6af6-4375-b9a3-16e45d55dc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:11.828240 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e1bcf-6af6-4375-b9a3-16e45d55dc16 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:11.828521 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e1bcf-6af6-4375-b9a3-16e45d55dc16 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:11.828791 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e1bcf-6af6-4375-b9a3-16e45d55dc16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:11.838362 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e1bcf-6af6-4375-b9a3-16e45d55dc16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:11.839771 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e1bcf-6af6-4375-b9a3-16e45d55dc16 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:11.860554 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-5d8e1bcf-6af6-4375-b9a3-16e45d55dc16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:40:11.862016 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 517/1041] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:40:11.867416 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effec286-eaa7-465a-a342-aa64d0483093 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:11.963267 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effec286-eaa7-465a-a342-aa64d0483093 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:11.995651 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284bd6b-2e47-4837-8b53-5f32045c3ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:11.996291 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284bd6b-2e47-4837-8b53-5f32045c3ab2 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:11.996570 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284bd6b-2e47-4837-8b53-5f32045c3ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:11.996834 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284bd6b-2e47-4837-8b53-5f32045c3ab2 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:11.997575 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284bd6b-2e47-4837-8b53-5f32045c3ab2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:11.997870 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284bd6b-2e47-4837-8b53-5f32045c3ab2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:11.999413 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f284bd6b-2e47-4837-8b53-5f32045c3ab2 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:12.010674 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 525/1042] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:12.016114 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e1bcf-6af6-4375-b9a3-16e45d55dc16 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:12.110235 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e1bcf-6af6-4375-b9a3-16e45d55dc16 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:12.147468 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af57fbd-2767-4056-ab89-9b72ef8f1c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:12.148261 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af57fbd-2767-4056-ab89-9b72ef8f1c2e None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:12.148535 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af57fbd-2767-4056-ab89-9b72ef8f1c2e None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:12.148800 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af57fbd-2767-4056-ab89-9b72ef8f1c2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:12.155570 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af57fbd-2767-4056-ab89-9b72ef8f1c2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:12.156985 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af57fbd-2767-4056-ab89-9b72ef8f1c2e None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:12.169547 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-2af57fbd-2767-4056-ab89-9b72ef8f1c2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:40:12.170947 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 518/1043] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:40:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:40:12.176517 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284bd6b-2e47-4837-8b53-5f32045c3ab2 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:12.274329 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284bd6b-2e47-4837-8b53-5f32045c3ab2 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:12.307608 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb09091-16f3-4f39-a3d6-c18e9c01f94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:12.308309 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb09091-16f3-4f39-a3d6-c18e9c01f94f None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:12.308588 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb09091-16f3-4f39-a3d6-c18e9c01f94f None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:12.308853 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb09091-16f3-4f39-a3d6-c18e9c01f94f None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:12.309657 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb09091-16f3-4f39-a3d6-c18e9c01f94f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:12.309962 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb09091-16f3-4f39-a3d6-c18e9c01f94f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:12.311377 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb09091-16f3-4f39-a3d6-c18e9c01f94f None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:12.323385 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 526/1044] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:40:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:12.329140 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af57fbd-2767-4056-ab89-9b72ef8f1c2e None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:12.427267 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af57fbd-2767-4056-ab89-9b72ef8f1c2e None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:12.469399 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab9709-6e6f-475f-a50a-559225061a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:12.471189 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab9709-6e6f-475f-a50a-559225061a6d None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:12.471189 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab9709-6e6f-475f-a50a-559225061a6d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:12.471189 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab9709-6e6f-475f-a50a-559225061a6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:12.471412 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab9709-6e6f-475f-a50a-559225061a6d None admin] RBAC: Adding query filter params (role.id=1ad7159416cf4d999f172e7806e1a652, scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e, user.id=21ec894123044d4382995791c74c587b) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:12.471724 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab9709-6e6f-475f-a50a-559225061a6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:12.473147 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab9709-6e6f-475f-a50a-559225061a6d None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:12.479362 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 519/1045] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:40:12 2022] GET /identity/v3/role_assignments?user.id=21ec894123044d4382995791c74c587b&scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e&role.id=1ad7159416cf4d999f172e7806e1a652 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:12.801296 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff719880-ff0a-4602-84c5-14097e197814 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:12.801508 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff719880-ff0a-4602-84c5-14097e197814 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:12.801803 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff719880-ff0a-4602-84c5-14097e197814 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:12.803734 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 527/1046] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:12.809018 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14424050-25e5-45c9-ab8a-8422fd1682db None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:12.809315 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14424050-25e5-45c9-ab8a-8422fd1682db None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:12.809618 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14424050-25e5-45c9-ab8a-8422fd1682db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:12.826675 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-14424050-25e5-45c9-ab8a-8422fd1682db None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:12.827872 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-14424050-25e5-45c9-ab8a-8422fd1682db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:12.894936 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 520/1047] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:40:12.918571 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff719880-ff0a-4602-84c5-14097e197814 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:13.017519 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff719880-ff0a-4602-84c5-14097e197814 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:13.051940 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b14e4-e47a-4968-8cfe-3cad5ad725f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:13.052652 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b14e4-e47a-4968-8cfe-3cad5ad725f5 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:13.052931 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b14e4-e47a-4968-8cfe-3cad5ad725f5 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:13.053201 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b14e4-e47a-4968-8cfe-3cad5ad725f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:13.063539 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b14e4-e47a-4968-8cfe-3cad5ad725f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:40:13.070279 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-c63b14e4-e47a-4968-8cfe-3cad5ad725f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:40:13.071646 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 528/1048] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:40:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:40:13.077866 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14424050-25e5-45c9-ab8a-8422fd1682db None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:13.175854 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14424050-25e5-45c9-ab8a-8422fd1682db None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:13.208665 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd0e65-df9d-4457-a1fd-12fd3df08bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:13.209328 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd0e65-df9d-4457-a1fd-12fd3df08bcb None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:13.209630 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd0e65-df9d-4457-a1fd-12fd3df08bcb None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:13.209896 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd0e65-df9d-4457-a1fd-12fd3df08bcb None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:13.210662 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd0e65-df9d-4457-a1fd-12fd3df08bcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:13.210959 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd0e65-df9d-4457-a1fd-12fd3df08bcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:13.212688 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dd0e65-df9d-4457-a1fd-12fd3df08bcb None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:13.220849 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 521/1049] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:40:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:13.226505 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b14e4-e47a-4968-8cfe-3cad5ad725f5 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:13.343671 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b14e4-e47a-4968-8cfe-3cad5ad725f5 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:13.377330 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fdefe1-50a8-421e-9ca1-85b19693ea4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:13.378213 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdefe1-50a8-421e-9ca1-85b19693ea4b None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:13.378490 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdefe1-50a8-421e-9ca1-85b19693ea4b None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:13.378719 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fdefe1-50a8-421e-9ca1-85b19693ea4b None admin] PATH_INFO: `/v3/users/2569990b5b48493daa92cd7affc7cd4c` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:13.392274 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fdefe1-50a8-421e-9ca1-85b19693ea4b None admin] RBAC: Authorizing `identity:get_user(user_id=2569990b5b48493daa92cd7affc7cd4c)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:13.393760 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fdefe1-50a8-421e-9ca1-85b19693ea4b None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:13.400163 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 529/1050] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:40:13 2022] GET /identity/v3/users/2569990b5b48493daa92cd7affc7cd4c => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:13.401309 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd0e65-df9d-4457-a1fd-12fd3df08bcb None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:13.508622 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd0e65-df9d-4457-a1fd-12fd3df08bcb None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:13.542454 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bbd1c-1206-485f-8389-0d51fe825914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:13.543096 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bbd1c-1206-485f-8389-0d51fe825914 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:13.543371 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bbd1c-1206-485f-8389-0d51fe825914 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:13.543636 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bbd1c-1206-485f-8389-0d51fe825914 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:13.607537 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6bce4-6e94-40c8-b663-9e6137092469 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:13.607723 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6bce4-6e94-40c8-b663-9e6137092469 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:13.607981 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6bce4-6e94-40c8-b663-9e6137092469 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:13.609776 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 530/1051] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:40:13.611574 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bbd1c-1206-485f-8389-0d51fe825914 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:13.612993 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bbd1c-1206-485f-8389-0d51fe825914 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:13.614581 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09daef09-1549-4ae1-86d5-e94578ba8bff None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:13.614869 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09daef09-1549-4ae1-86d5-e94578ba8bff None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:13.615157 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09daef09-1549-4ae1-86d5-e94578ba8bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:13.631523 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-09daef09-1549-4ae1-86d5-e94578ba8bff None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:13.632721 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-09daef09-1549-4ae1-86d5-e94578ba8bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:13.699171 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 531/1052] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:40:13.720025 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 522/1053] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:40:13 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:40:13.721430 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bbd1c-1206-485f-8389-0d51fe825914 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:13.721560 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09daef09-1549-4ae1-86d5-e94578ba8bff None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:13.812436 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bbd1c-1206-485f-8389-0d51fe825914 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:13.812992 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09daef09-1549-4ae1-86d5-e94578ba8bff None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:13.844047 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8f9bd-f5ec-4126-8339-72a53a76dd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:13.844337 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f63cbb-be11-4a7a-835a-7a5aacb75c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:13.844837 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f63cbb-be11-4a7a-835a-7a5aacb75c40 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:13.844939 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8f9bd-f5ec-4126-8339-72a53a76dd49 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:13.845113 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f63cbb-be11-4a7a-835a-7a5aacb75c40 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:13.845219 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8f9bd-f5ec-4126-8339-72a53a76dd49 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:13.845396 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f63cbb-be11-4a7a-835a-7a5aacb75c40 None admin] PATH_INFO: `/v3/services/image` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:13.845508 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8f9bd-f5ec-4126-8339-72a53a76dd49 None admin] PATH_INFO: `/v3/projects/caeef8c113754b0383f596605eb89e0f` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:13.846146 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f63cbb-be11-4a7a-835a-7a5aacb75c40 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:13.846612 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8f9bd-f5ec-4126-8339-72a53a76dd49 None admin] RBAC: Authorizing `identity:get_project(project_id=caeef8c113754b0383f596605eb89e0f)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:13.847485 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f63cbb-be11-4a7a-835a-7a5aacb75c40 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:13.848023 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8f9bd-f5ec-4126-8339-72a53a76dd49 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:13.849735 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 532/1054] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:40:13 2022] GET /identity/v3/projects/caeef8c113754b0383f596605eb89e0f => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:40:13.855730 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8f9bd-f5ec-4126-8339-72a53a76dd49 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:13.858389 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-c3f63cbb-be11-4a7a-835a-7a5aacb75c40 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Mar 08 13:40:13.859636 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 523/1055] 10.222.0.18 () {56 vars in 1105 bytes} [Tue Mar 8 13:40:13 2022] GET /identity/v3/services/image => generated 86 bytes in 138 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:40:13.865119 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f63cbb-be11-4a7a-835a-7a5aacb75c40 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:13.953010 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8f9bd-f5ec-4126-8339-72a53a76dd49 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:13.959687 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f63cbb-be11-4a7a-835a-7a5aacb75c40 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:13.987089 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1996127-7785-435a-a9ee-75c3881bcc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:13.987803 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1996127-7785-435a-a9ee-75c3881bcc3f None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:13.988078 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1996127-7785-435a-a9ee-75c3881bcc3f None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:13.988352 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1996127-7785-435a-a9ee-75c3881bcc3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:13.989170 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1996127-7785-435a-a9ee-75c3881bcc3f None admin] RBAC: Adding query filter params (role.id=fc021ed5870a44f5a0f0b8fff994d6f0, scope.project.id=caeef8c113754b0383f596605eb89e0f, user.id=2569990b5b48493daa92cd7affc7cd4c) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:13.989509 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1996127-7785-435a-a9ee-75c3881bcc3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:13.990935 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1996127-7785-435a-a9ee-75c3881bcc3f None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:13.996221 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 533/1056] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:40:13 2022] GET /identity/v3/role_assignments?user.id=2569990b5b48493daa92cd7affc7cd4c&scope.project.id=caeef8c113754b0383f596605eb89e0f&role.id=fc021ed5870a44f5a0f0b8fff994d6f0 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:40:13.996988 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1ddc8-8678-4f00-9cb5-453f2c9e3f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:13.997677 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1ddc8-8678-4f00-9cb5-453f2c9e3f26 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:13.997954 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1ddc8-8678-4f00-9cb5-453f2c9e3f26 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:13.998232 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1ddc8-8678-4f00-9cb5-453f2c9e3f26 None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:13.998926 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1ddc8-8678-4f00-9cb5-453f2c9e3f26 None admin] RBAC: Adding query filter params (name=image) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:13.999226 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1ddc8-8678-4f00-9cb5-453f2c9e3f26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:14.000594 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1ddc8-8678-4f00-9cb5-453f2c9e3f26 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:14.006188 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 524/1057] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:40:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:40:14.012182 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1996127-7785-435a-a9ee-75c3881bcc3f None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:14.116712 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1996127-7785-435a-a9ee-75c3881bcc3f None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:14.154135 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c23280-730f-495f-bf9d-7e39cf8b934a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:14.154813 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c23280-730f-495f-bf9d-7e39cf8b934a None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:14.155087 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c23280-730f-495f-bf9d-7e39cf8b934a None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:14.155356 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c23280-730f-495f-bf9d-7e39cf8b934a None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:14.156071 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c23280-730f-495f-bf9d-7e39cf8b934a None admin] RBAC: Adding query filter params (type=image) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:14.156369 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c23280-730f-495f-bf9d-7e39cf8b934a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:14.157805 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c23280-730f-495f-bf9d-7e39cf8b934a None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:14.163462 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 534/1058] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:40:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:14.169128 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1ddc8-8678-4f00-9cb5-453f2c9e3f26 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:14.270007 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1ddc8-8678-4f00-9cb5-453f2c9e3f26 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:14.304457 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535db199-7831-49fc-8aa8-5a2c3634e90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:14.305107 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535db199-7831-49fc-8aa8-5a2c3634e90c None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:14.305401 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535db199-7831-49fc-8aa8-5a2c3634e90c None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:14.305684 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535db199-7831-49fc-8aa8-5a2c3634e90c None admin] PATH_INFO: `/v3/endpoints` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:14.306455 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535db199-7831-49fc-8aa8-5a2c3634e90c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:14.307798 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535db199-7831-49fc-8aa8-5a2c3634e90c None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:14.326888 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 525/1059] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Mar 8 13:40:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:40:14.748481 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aae63-f30c-4825-9fd2-3b97476b1c34 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:14.749032 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aae63-f30c-4825-9fd2-3b97476b1c34 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:14.749032 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5aae63-f30c-4825-9fd2-3b97476b1c34 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:14.750857 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 535/1060] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:14.756671 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66ce19-f099-43f9-af23-07f6337f9274 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:14.757007 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66ce19-f099-43f9-af23-07f6337f9274 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:14.757271 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66ce19-f099-43f9-af23-07f6337f9274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:14.775328 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-5c66ce19-f099-43f9-af23-07f6337f9274 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:14.776511 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-5c66ce19-f099-43f9-af23-07f6337f9274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:14.852054 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 526/1061] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:40:14.875085 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5aae63-f30c-4825-9fd2-3b97476b1c34 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:14.981558 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5aae63-f30c-4825-9fd2-3b97476b1c34 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:15.016089 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7380d-4ab8-4e1a-81a6-db1c56a03e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:15.016816 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7380d-4ab8-4e1a-81a6-db1c56a03e66 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:15.017093 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7380d-4ab8-4e1a-81a6-db1c56a03e66 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:15.017388 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf7380d-4ab8-4e1a-81a6-db1c56a03e66 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:15.027631 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf7380d-4ab8-4e1a-81a6-db1c56a03e66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:40:15.035620 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-fcf7380d-4ab8-4e1a-81a6-db1c56a03e66 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 13:40:15.041429 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 536/1062] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Mar 8 13:40:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:40:15.043423 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66ce19-f099-43f9-af23-07f6337f9274 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:15.148619 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66ce19-f099-43f9-af23-07f6337f9274 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:15.183097 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42d6d3-7399-47a6-a199-cc8826e36f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:15.183758 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42d6d3-7399-47a6-a199-cc8826e36f0e None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:15.184034 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42d6d3-7399-47a6-a199-cc8826e36f0e None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:15.184282 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42d6d3-7399-47a6-a199-cc8826e36f0e None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:15.185033 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42d6d3-7399-47a6-a199-cc8826e36f0e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:15.185326 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42d6d3-7399-47a6-a199-cc8826e36f0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:15.186801 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42d6d3-7399-47a6-a199-cc8826e36f0e None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:15.194730 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 527/1063] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Mar 8 13:40:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:15.200741 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7380d-4ab8-4e1a-81a6-db1c56a03e66 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:15.306864 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf7380d-4ab8-4e1a-81a6-db1c56a03e66 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:15.344796 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fce4ee-9e2c-421a-a276-568e3b5576e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:15.345624 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fce4ee-9e2c-421a-a276-568e3b5576e7 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:15.345891 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fce4ee-9e2c-421a-a276-568e3b5576e7 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:15.346152 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fce4ee-9e2c-421a-a276-568e3b5576e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:15.356822 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fce4ee-9e2c-421a-a276-568e3b5576e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:15.358287 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fce4ee-9e2c-421a-a276-568e3b5576e7 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:15.374293 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-03fce4ee-9e2c-421a-a276-568e3b5576e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:40:15.375663 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 537/1064] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:40:15.381311 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42d6d3-7399-47a6-a199-cc8826e36f0e None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:15.484127 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42d6d3-7399-47a6-a199-cc8826e36f0e None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:15.520159 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8b4de-e595-46b6-8d03-c47c2054902d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:15.520813 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8b4de-e595-46b6-8d03-c47c2054902d None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:15.521087 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8b4de-e595-46b6-8d03-c47c2054902d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:15.521372 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8b4de-e595-46b6-8d03-c47c2054902d None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:15.522088 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8b4de-e595-46b6-8d03-c47c2054902d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:15.522385 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8b4de-e595-46b6-8d03-c47c2054902d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:15.523739 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8b4de-e595-46b6-8d03-c47c2054902d None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:15.535754 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 528/1065] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:15.541260 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fce4ee-9e2c-421a-a276-568e3b5576e7 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:15.644014 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fce4ee-9e2c-421a-a276-568e3b5576e7 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:15.679157 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19deb707-0965-465d-9bf4-6c551419c3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:15.679949 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19deb707-0965-465d-9bf4-6c551419c3cf None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:15.680223 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19deb707-0965-465d-9bf4-6c551419c3cf None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:15.680493 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19deb707-0965-465d-9bf4-6c551419c3cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:15.688033 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19deb707-0965-465d-9bf4-6c551419c3cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:15.689558 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19deb707-0965-465d-9bf4-6c551419c3cf None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:15.702976 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-19deb707-0965-465d-9bf4-6c551419c3cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 13:40:15.708657 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 538/1066] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Mar 8 13:40:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:40:15.709983 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8b4de-e595-46b6-8d03-c47c2054902d None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:15.811184 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8b4de-e595-46b6-8d03-c47c2054902d None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:15.845879 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40abdcd-a8ad-4320-ac9e-565224517feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:15.846548 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40abdcd-a8ad-4320-ac9e-565224517feb None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:15.846824 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40abdcd-a8ad-4320-ac9e-565224517feb None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:15.847100 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40abdcd-a8ad-4320-ac9e-565224517feb None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:15.847935 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40abdcd-a8ad-4320-ac9e-565224517feb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:15.848236 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40abdcd-a8ad-4320-ac9e-565224517feb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:15.849670 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40abdcd-a8ad-4320-ac9e-565224517feb None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:15.871379 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 529/1067] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Mar 8 13:40:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:15.872939 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19deb707-0965-465d-9bf4-6c551419c3cf None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:15.977426 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19deb707-0965-465d-9bf4-6c551419c3cf None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:16.012526 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d72b34-60bc-4427-b975-1d5474fd7df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:16.013796 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d72b34-60bc-4427-b975-1d5474fd7df8 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:16.014295 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d72b34-60bc-4427-b975-1d5474fd7df8 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:16.014763 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d72b34-60bc-4427-b975-1d5474fd7df8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:16.025606 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d72b34-60bc-4427-b975-1d5474fd7df8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:16.027254 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d72b34-60bc-4427-b975-1d5474fd7df8 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:16.044524 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-57d72b34-60bc-4427-b975-1d5474fd7df8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:40:16.045972 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 539/1068] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:40:16.052114 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40abdcd-a8ad-4320-ac9e-565224517feb None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:16.152423 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40abdcd-a8ad-4320-ac9e-565224517feb None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:16.187542 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285ac12-dbbf-4b5e-b48c-79646a011a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:16.188529 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285ac12-dbbf-4b5e-b48c-79646a011a63 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:16.188985 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285ac12-dbbf-4b5e-b48c-79646a011a63 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:16.189475 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285ac12-dbbf-4b5e-b48c-79646a011a63 None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:16.190400 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285ac12-dbbf-4b5e-b48c-79646a011a63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:16.190917 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285ac12-dbbf-4b5e-b48c-79646a011a63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:16.192438 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285ac12-dbbf-4b5e-b48c-79646a011a63 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:16.203915 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 530/1069] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:40:16.209783 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d72b34-60bc-4427-b975-1d5474fd7df8 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:16.306044 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ebfe8-27db-4557-b19a-08be4f201c9a None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:16.306227 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ebfe8-27db-4557-b19a-08be4f201c9a None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:16.306485 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ebfe8-27db-4557-b19a-08be4f201c9a None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:16.308573 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 531/1070] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:40:16.313210 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243f8e7-f006-40eb-bb2a-0d09e1cb0ab2 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:16.313539 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243f8e7-f006-40eb-bb2a-0d09e1cb0ab2 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:16.313809 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243f8e7-f006-40eb-bb2a-0d09e1cb0ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:16.314703 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d72b34-60bc-4427-b975-1d5474fd7df8 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:16.330283 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-3243f8e7-f006-40eb-bb2a-0d09e1cb0ab2 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:16.331440 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-3243f8e7-f006-40eb-bb2a-0d09e1cb0ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:16.347358 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee528b-90da-4038-94aa-bbff7811f08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:16.348148 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee528b-90da-4038-94aa-bbff7811f08e None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:16.348424 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee528b-90da-4038-94aa-bbff7811f08e None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:16.348689 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee528b-90da-4038-94aa-bbff7811f08e None admin] PATH_INFO: `/v3/projects/service` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:16.355252 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee528b-90da-4038-94aa-bbff7811f08e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:16.356704 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee528b-90da-4038-94aa-bbff7811f08e None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:16.370035 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-4dee528b-90da-4038-94aa-bbff7811f08e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:40:16.371395 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 540/1071] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:40:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:40:16.376854 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee528b-90da-4038-94aa-bbff7811f08e None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:16.401399 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 532/1072] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:40:16.421895 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243f8e7-f006-40eb-bb2a-0d09e1cb0ab2 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:16.478615 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee528b-90da-4038-94aa-bbff7811f08e None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:16.516268 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bebca2-cf99-45a9-b43b-09adb5025726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:16.516932 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bebca2-cf99-45a9-b43b-09adb5025726 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:16.517263 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bebca2-cf99-45a9-b43b-09adb5025726 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:16.517570 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bebca2-cf99-45a9-b43b-09adb5025726 None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:16.518384 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bebca2-cf99-45a9-b43b-09adb5025726 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:16.518695 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bebca2-cf99-45a9-b43b-09adb5025726 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:16.520126 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bebca2-cf99-45a9-b43b-09adb5025726 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:16.520901 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243f8e7-f006-40eb-bb2a-0d09e1cb0ab2 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:16.532053 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 541/1073] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:40:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:16.538099 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bebca2-cf99-45a9-b43b-09adb5025726 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:16.555426 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565610b7-b2bc-4394-b23a-62f5a2495712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:16.556293 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565610b7-b2bc-4394-b23a-62f5a2495712 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:16.556531 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565610b7-b2bc-4394-b23a-62f5a2495712 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:16.556791 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565610b7-b2bc-4394-b23a-62f5a2495712 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:16.566659 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565610b7-b2bc-4394-b23a-62f5a2495712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:40:16.573570 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-565610b7-b2bc-4394-b23a-62f5a2495712 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:40:16.574994 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 533/1074] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:40:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:40:16.580720 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565610b7-b2bc-4394-b23a-62f5a2495712 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:16.631369 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bebca2-cf99-45a9-b43b-09adb5025726 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:16.662483 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bef2a3-7773-434c-a9e9-d4f868bc2f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:16.663360 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bef2a3-7773-434c-a9e9-d4f868bc2f8c None admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:16.663633 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bef2a3-7773-434c-a9e9-d4f868bc2f8c None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:16.663893 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bef2a3-7773-434c-a9e9-d4f868bc2f8c None admin] PATH_INFO: `/v3/projects/7d693fb3e9fc4d82a0ed054f31f1e56e/users/21ec894123044d4382995791c74c587b/roles/1ad7159416cf4d999f172e7806e1a652` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:16.666406 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bef2a3-7773-434c-a9e9-d4f868bc2f8c None admin] RBAC: Authorizing `identity:create_grant(project_id=7d693fb3e9fc4d82a0ed054f31f1e56e, user_id=21ec894123044d4382995791c74c587b, role_id=1ad7159416cf4d999f172e7806e1a652)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:16.667824 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bef2a3-7773-434c-a9e9-d4f868bc2f8c None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:16.682923 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565610b7-b2bc-4394-b23a-62f5a2495712 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:16.683720 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 542/1075] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Mar 8 13:40:16 2022] PUT /identity/v3/projects/7d693fb3e9fc4d82a0ed054f31f1e56e/users/21ec894123044d4382995791c74c587b/roles/1ad7159416cf4d999f172e7806e1a652 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:40:16.684997 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d25084-52a6-416b-9305-23d3a2073dd8 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:16.685275 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d25084-52a6-416b-9305-23d3a2073dd8 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:16.685643 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d25084-52a6-416b-9305-23d3a2073dd8 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:16.687301 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 543/1076] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:16.693242 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4768e-bd9e-4aa2-970e-7f017ded9969 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:16.693620 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4768e-bd9e-4aa2-970e-7f017ded9969 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:16.693841 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4768e-bd9e-4aa2-970e-7f017ded9969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:16.711865 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-e2d4768e-bd9e-4aa2-970e-7f017ded9969 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:16.713121 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-e2d4768e-bd9e-4aa2-970e-7f017ded9969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:16.727216 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111b339-b5bb-411e-84ed-1b775206f93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:16.727992 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111b339-b5bb-411e-84ed-1b775206f93d None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:16.728268 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111b339-b5bb-411e-84ed-1b775206f93d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:16.728538 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111b339-b5bb-411e-84ed-1b775206f93d None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:16.729298 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111b339-b5bb-411e-84ed-1b775206f93d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:16.729642 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111b339-b5bb-411e-84ed-1b775206f93d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:16.731021 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111b339-b5bb-411e-84ed-1b775206f93d None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:16.739739 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 534/1077] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:40:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:40:16.746019 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111b339-b5bb-411e-84ed-1b775206f93d None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:16.793409 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 544/1078] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:40:16.813038 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4768e-bd9e-4aa2-970e-7f017ded9969 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:16.851378 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111b339-b5bb-411e-84ed-1b775206f93d None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:16.890984 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422de45-d636-4678-b2c7-ccb2c9d12a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:16.891864 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422de45-d636-4678-b2c7-ccb2c9d12a28 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:16.892147 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422de45-d636-4678-b2c7-ccb2c9d12a28 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:16.892417 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a422de45-d636-4678-b2c7-ccb2c9d12a28 None admin] PATH_INFO: `/v3/users/2569990b5b48493daa92cd7affc7cd4c` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:16.893630 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a422de45-d636-4678-b2c7-ccb2c9d12a28 None admin] RBAC: Authorizing `identity:get_user(user_id=2569990b5b48493daa92cd7affc7cd4c)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:16.895043 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a422de45-d636-4678-b2c7-ccb2c9d12a28 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:16.896827 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 535/1079] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:40:16 2022] GET /identity/v3/users/2569990b5b48493daa92cd7affc7cd4c => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:16.902462 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422de45-d636-4678-b2c7-ccb2c9d12a28 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:16.916614 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4768e-bd9e-4aa2-970e-7f017ded9969 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:16.949889 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a5ae0-456f-4505-aa8e-77feb7401eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:16.950836 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a5ae0-456f-4505-aa8e-77feb7401eee None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:16.951292 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a5ae0-456f-4505-aa8e-77feb7401eee None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:16.951738 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a5ae0-456f-4505-aa8e-77feb7401eee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:17.000250 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a422de45-d636-4678-b2c7-ccb2c9d12a28 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:17.025564 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a5ae0-456f-4505-aa8e-77feb7401eee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:17.027021 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a5ae0-456f-4505-aa8e-77feb7401eee None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:17.033674 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92d804-3644-4451-8d24-6963e438f726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:17.034536 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92d804-3644-4451-8d24-6963e438f726 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:17.034816 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92d804-3644-4451-8d24-6963e438f726 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:17.035106 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92d804-3644-4451-8d24-6963e438f726 None admin] PATH_INFO: `/v3/projects/caeef8c113754b0383f596605eb89e0f` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:17.036300 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92d804-3644-4451-8d24-6963e438f726 None admin] RBAC: Authorizing `identity:get_project(project_id=caeef8c113754b0383f596605eb89e0f)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:17.037798 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92d804-3644-4451-8d24-6963e438f726 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:17.044416 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 536/1080] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:40:16 2022] GET /identity/v3/projects/caeef8c113754b0383f596605eb89e0f => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:40:17.045497 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92d804-3644-4451-8d24-6963e438f726 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:17.129821 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 545/1081] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:40:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 08 13:40:17.130754 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a5ae0-456f-4505-aa8e-77feb7401eee None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:17.146266 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92d804-3644-4451-8d24-6963e438f726 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:17.178512 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdc9c7-2dda-4f23-96b7-70e0822be330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:17.179397 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdc9c7-2dda-4f23-96b7-70e0822be330 None admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:17.179675 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdc9c7-2dda-4f23-96b7-70e0822be330 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:17.179947 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdc9c7-2dda-4f23-96b7-70e0822be330 None admin] PATH_INFO: `/v3/projects/caeef8c113754b0383f596605eb89e0f/users/2569990b5b48493daa92cd7affc7cd4c/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:17.181996 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bdc9c7-2dda-4f23-96b7-70e0822be330 None admin] RBAC: Authorizing `identity:create_grant(project_id=caeef8c113754b0383f596605eb89e0f, user_id=2569990b5b48493daa92cd7affc7cd4c, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:17.183482 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bdc9c7-2dda-4f23-96b7-70e0822be330 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:17.197594 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 537/1082] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Mar 8 13:40:17 2022] PUT /identity/v3/projects/caeef8c113754b0383f596605eb89e0f/users/2569990b5b48493daa92cd7affc7cd4c/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:40:17.229416 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a5ae0-456f-4505-aa8e-77feb7401eee None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:17.265502 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455846c-50ff-4597-a109-fc18ca576ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:17.266311 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455846c-50ff-4597-a109-fc18ca576ab7 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:17.266555 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455846c-50ff-4597-a109-fc18ca576ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:17.266846 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455846c-50ff-4597-a109-fc18ca576ab7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:17.278549 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455846c-50ff-4597-a109-fc18ca576ab7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:17.280054 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455846c-50ff-4597-a109-fc18ca576ab7 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:17.298304 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-c455846c-50ff-4597-a109-fc18ca576ab7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:40:17.304861 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 546/1083] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:40:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:40:17.305952 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdc9c7-2dda-4f23-96b7-70e0822be330 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:17.409725 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bdc9c7-2dda-4f23-96b7-70e0822be330 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:17.440795 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2248584-53f7-435e-84d7-d14c39292df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:17.441461 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2248584-53f7-435e-84d7-d14c39292df4 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:17.441735 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2248584-53f7-435e-84d7-d14c39292df4 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:17.442000 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2248584-53f7-435e-84d7-d14c39292df4 None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:17.442709 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2248584-53f7-435e-84d7-d14c39292df4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:17.443004 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2248584-53f7-435e-84d7-d14c39292df4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:17.444338 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2248584-53f7-435e-84d7-d14c39292df4 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:17.461442 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 538/1084] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:40:18.940698 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dc54f-d1df-438d-ad8c-444201c724e2 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:18.941261 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dc54f-d1df-438d-ad8c-444201c724e2 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:18.941261 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dc54f-d1df-438d-ad8c-444201c724e2 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:18.943049 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 547/1085] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:18.948751 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a8bce-f642-49e9-8919-ddbfde9b3620 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:18.949146 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a8bce-f642-49e9-8919-ddbfde9b3620 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:18.949322 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a8bce-f642-49e9-8919-ddbfde9b3620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:18.966717 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-b89a8bce-f642-49e9-8919-ddbfde9b3620 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:18.967900 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-b89a8bce-f642-49e9-8919-ddbfde9b3620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:19.035401 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 539/1086] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:40:19.059210 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dc54f-d1df-438d-ad8c-444201c724e2 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:19.168685 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dc54f-d1df-438d-ad8c-444201c724e2 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:19.202468 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86b38d-cf99-4249-810e-4ee83d3a1dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:19.203205 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86b38d-cf99-4249-810e-4ee83d3a1dfe None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:19.203485 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86b38d-cf99-4249-810e-4ee83d3a1dfe None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:19.203754 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86b38d-cf99-4249-810e-4ee83d3a1dfe None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:19.213895 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f86b38d-cf99-4249-810e-4ee83d3a1dfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:40:19.221284 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-7f86b38d-cf99-4249-810e-4ee83d3a1dfe None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Mar 08 13:40:19.222518 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 548/1087] 10.222.0.18 () {56 vars in 1120 bytes} [Tue Mar 8 13:40:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:40:19.228926 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a8bce-f642-49e9-8919-ddbfde9b3620 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:19.326662 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a8bce-f642-49e9-8919-ddbfde9b3620 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:19.359815 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f525e5-8eac-460b-ba3e-c87b9eaf942d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:19.360490 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f525e5-8eac-460b-ba3e-c87b9eaf942d None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:19.360765 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f525e5-8eac-460b-ba3e-c87b9eaf942d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:19.361030 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f525e5-8eac-460b-ba3e-c87b9eaf942d None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:19.361798 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f525e5-8eac-460b-ba3e-c87b9eaf942d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:19.362097 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f525e5-8eac-460b-ba3e-c87b9eaf942d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:19.363446 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f525e5-8eac-460b-ba3e-c87b9eaf942d None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:19.371923 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 540/1088] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Mar 8 13:40:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:19.377768 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86b38d-cf99-4249-810e-4ee83d3a1dfe None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:19.465216 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ebb9e-6ec6-4667-bd51-2bb4fdcad4bf None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:19.465440 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ebb9e-6ec6-4667-bd51-2bb4fdcad4bf None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:19.465706 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ebb9e-6ec6-4667-bd51-2bb4fdcad4bf None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:19.467471 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 541/1089] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:19.472660 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c0832-e6f5-4cf6-9067-f2c9525f99eb None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:19.472943 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c0832-e6f5-4cf6-9067-f2c9525f99eb None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:19.473223 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c0832-e6f5-4cf6-9067-f2c9525f99eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:19.477894 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86b38d-cf99-4249-810e-4ee83d3a1dfe None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:19.489894 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-559c0832-e6f5-4cf6-9067-f2c9525f99eb None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:19.491043 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-559c0832-e6f5-4cf6-9067-f2c9525f99eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:19.511200 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8857a2-40a4-4aa6-9532-ae5b8a963f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:19.511982 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8857a2-40a4-4aa6-9532-ae5b8a963f95 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:19.512255 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8857a2-40a4-4aa6-9532-ae5b8a963f95 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:19.512522 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8857a2-40a4-4aa6-9532-ae5b8a963f95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:19.522877 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8857a2-40a4-4aa6-9532-ae5b8a963f95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:19.524386 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8857a2-40a4-4aa6-9532-ae5b8a963f95 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:19.540157 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-ed8857a2-40a4-4aa6-9532-ae5b8a963f95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:40:19.541315 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 549/1090] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:40:19.546842 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8857a2-40a4-4aa6-9532-ae5b8a963f95 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:19.559209 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 542/1091] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:40:19.582419 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c0832-e6f5-4cf6-9067-f2c9525f99eb None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:19.644492 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8857a2-40a4-4aa6-9532-ae5b8a963f95 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:19.675049 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c0832-e6f5-4cf6-9067-f2c9525f99eb None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:19.676938 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e719027-4672-4790-b7ee-f86e8833ab3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:19.677622 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e719027-4672-4790-b7ee-f86e8833ab3d None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:19.677899 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e719027-4672-4790-b7ee-f86e8833ab3d None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:19.678169 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e719027-4672-4790-b7ee-f86e8833ab3d None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:19.678868 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e719027-4672-4790-b7ee-f86e8833ab3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:19.679164 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e719027-4672-4790-b7ee-f86e8833ab3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:19.680558 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e719027-4672-4790-b7ee-f86e8833ab3d None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:19.691849 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 550/1092] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:40:19.697401 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e719027-4672-4790-b7ee-f86e8833ab3d None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:19.712386 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b54b46-fca7-4fd3-acaf-6ca8d0739795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:19.713176 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b54b46-fca7-4fd3-acaf-6ca8d0739795 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:19.713478 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b54b46-fca7-4fd3-acaf-6ca8d0739795 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:19.713747 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b54b46-fca7-4fd3-acaf-6ca8d0739795 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:19.723757 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b54b46-fca7-4fd3-acaf-6ca8d0739795 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:40:19.730511 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-87b54b46-fca7-4fd3-acaf-6ca8d0739795 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:40:19.731712 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 543/1093] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:40:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:40:19.737925 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b54b46-fca7-4fd3-acaf-6ca8d0739795 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:19.788399 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e719027-4672-4790-b7ee-f86e8833ab3d None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:19.821439 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aca28a-7600-46a0-9912-586a6553c98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:19.822210 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aca28a-7600-46a0-9912-586a6553c98d None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:19.822466 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aca28a-7600-46a0-9912-586a6553c98d None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:19.822766 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aca28a-7600-46a0-9912-586a6553c98d None admin] PATH_INFO: `/v3/users/nova` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:19.829569 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aca28a-7600-46a0-9912-586a6553c98d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:19.831015 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aca28a-7600-46a0-9912-586a6553c98d None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:19.833975 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b54b46-fca7-4fd3-acaf-6ca8d0739795 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:19.844138 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-86aca28a-7600-46a0-9912-586a6553c98d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Mar 08 13:40:19.845324 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 551/1094] 10.222.0.18 () {56 vars in 1093 bytes} [Tue Mar 8 13:40:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:40:19.851071 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aca28a-7600-46a0-9912-586a6553c98d None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:19.868437 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca1a5f-895d-4608-b9e6-37d9edbe985d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:19.869089 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca1a5f-895d-4608-b9e6-37d9edbe985d None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:19.869388 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca1a5f-895d-4608-b9e6-37d9edbe985d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:19.869658 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca1a5f-895d-4608-b9e6-37d9edbe985d None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:19.870417 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca1a5f-895d-4608-b9e6-37d9edbe985d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:19.870710 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca1a5f-895d-4608-b9e6-37d9edbe985d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:19.872056 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca1a5f-895d-4608-b9e6-37d9edbe985d None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:19.880395 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 544/1095] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:40:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:40:19.886138 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca1a5f-895d-4608-b9e6-37d9edbe985d None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:19.943358 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aca28a-7600-46a0-9912-586a6553c98d None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:19.976869 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747778ef-95a2-4603-8fde-d8073a1d09ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:19.977496 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747778ef-95a2-4603-8fde-d8073a1d09ab None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:19.977776 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747778ef-95a2-4603-8fde-d8073a1d09ab None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:19.978038 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747778ef-95a2-4603-8fde-d8073a1d09ab None admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:19.978857 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747778ef-95a2-4603-8fde-d8073a1d09ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:19.979158 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747778ef-95a2-4603-8fde-d8073a1d09ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:19.980572 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747778ef-95a2-4603-8fde-d8073a1d09ab None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:19.981668 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca1a5f-895d-4608-b9e6-37d9edbe985d None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:19.997614 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 552/1096] 10.222.0.18 () {56 vars in 1133 bytes} [Tue Mar 8 13:40:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:40:20.003217 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747778ef-95a2-4603-8fde-d8073a1d09ab None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:20.013608 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3095424-cb9c-4b65-9176-9e5c7eee7e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:20.014474 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3095424-cb9c-4b65-9176-9e5c7eee7e6c None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:20.014751 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3095424-cb9c-4b65-9176-9e5c7eee7e6c None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:20.015018 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3095424-cb9c-4b65-9176-9e5c7eee7e6c None admin] PATH_INFO: `/v3/users/2569990b5b48493daa92cd7affc7cd4c` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:20.016201 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3095424-cb9c-4b65-9176-9e5c7eee7e6c None admin] RBAC: Authorizing `identity:get_user(user_id=2569990b5b48493daa92cd7affc7cd4c)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:20.017636 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3095424-cb9c-4b65-9176-9e5c7eee7e6c None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:20.019239 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 545/1097] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:40:19 2022] GET /identity/v3/users/2569990b5b48493daa92cd7affc7cd4c => generated 285 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:20.024948 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3095424-cb9c-4b65-9176-9e5c7eee7e6c None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:20.102073 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747778ef-95a2-4603-8fde-d8073a1d09ab None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:20.116116 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3095424-cb9c-4b65-9176-9e5c7eee7e6c None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:20.134531 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4673ea-03bb-4509-864b-f4c408e80534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:20.135178 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4673ea-03bb-4509-864b-f4c408e80534 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:20.135456 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4673ea-03bb-4509-864b-f4c408e80534 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:20.135725 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4673ea-03bb-4509-864b-f4c408e80534 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:20.146703 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3b77d-3fe6-4cb6-be36-b8b8469a2c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:20.147333 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3b77d-3fe6-4cb6-be36-b8b8469a2c93 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:20.147606 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3b77d-3fe6-4cb6-be36-b8b8469a2c93 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:20.147879 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3b77d-3fe6-4cb6-be36-b8b8469a2c93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:20.200390 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4673ea-03bb-4509-864b-f4c408e80534 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:20.201869 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4673ea-03bb-4509-864b-f4c408e80534 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:20.218481 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3b77d-3fe6-4cb6-be36-b8b8469a2c93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:20.219895 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3b77d-3fe6-4cb6-be36-b8b8469a2c93 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:20.292787 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 553/1098] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:40:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 08 13:40:20.298719 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4673ea-03bb-4509-864b-f4c408e80534 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:20.314696 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 546/1099] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:40:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 08 13:40:20.320575 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3b77d-3fe6-4cb6-be36-b8b8469a2c93 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:20.403099 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4673ea-03bb-4509-864b-f4c408e80534 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:20.419507 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3b77d-3fe6-4cb6-be36-b8b8469a2c93 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:20.437819 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf22ac-2286-4dc1-a7fa-4629d65b9dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:20.438609 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf22ac-2286-4dc1-a7fa-4629d65b9dd5 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:20.438861 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf22ac-2286-4dc1-a7fa-4629d65b9dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:20.439130 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf22ac-2286-4dc1-a7fa-4629d65b9dd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:20.449092 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf22ac-2286-4dc1-a7fa-4629d65b9dd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:20.450591 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbf22ac-2286-4dc1-a7fa-4629d65b9dd5 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:20.451705 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10750cd-3bcc-441d-b4d7-f81a0b613db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:20.452554 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10750cd-3bcc-441d-b4d7-f81a0b613db4 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:20.452828 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10750cd-3bcc-441d-b4d7-f81a0b613db4 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:20.453093 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10750cd-3bcc-441d-b4d7-f81a0b613db4 None admin] PATH_INFO: `/v3/projects/caeef8c113754b0383f596605eb89e0f` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:20.454258 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10750cd-3bcc-441d-b4d7-f81a0b613db4 None admin] RBAC: Authorizing `identity:get_project(project_id=caeef8c113754b0383f596605eb89e0f)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:20.455643 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10750cd-3bcc-441d-b4d7-f81a0b613db4 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:20.457306 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 547/1100] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:40:20 2022] GET /identity/v3/projects/caeef8c113754b0383f596605eb89e0f => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:20.463953 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10750cd-3bcc-441d-b4d7-f81a0b613db4 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:20.469470 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-5dbf22ac-2286-4dc1-a7fa-4629d65b9dd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:40:20.469470 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 554/1101] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:40:20.473938 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf22ac-2286-4dc1-a7fa-4629d65b9dd5 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:20.559539 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10750cd-3bcc-441d-b4d7-f81a0b613db4 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:20.569081 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf22ac-2286-4dc1-a7fa-4629d65b9dd5 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:20.590912 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af4af4-7224-448c-9211-7679faee2a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:20.591556 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af4af4-7224-448c-9211-7679faee2a4d None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:20.591874 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af4af4-7224-448c-9211-7679faee2a4d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:20.592139 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af4af4-7224-448c-9211-7679faee2a4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:20.592965 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af4af4-7224-448c-9211-7679faee2a4d None admin] RBAC: Adding query filter params (role.id=fc021ed5870a44f5a0f0b8fff994d6f0, scope.project.id=caeef8c113754b0383f596605eb89e0f, user.id=2569990b5b48493daa92cd7affc7cd4c) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:20.593266 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af4af4-7224-448c-9211-7679faee2a4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:20.594725 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06af4af4-7224-448c-9211-7679faee2a4d None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:20.600500 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 548/1102] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:40:20 2022] GET /identity/v3/role_assignments?user.id=2569990b5b48493daa92cd7affc7cd4c&scope.project.id=caeef8c113754b0383f596605eb89e0f&role.id=fc021ed5870a44f5a0f0b8fff994d6f0 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:40:20.603489 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551c2f2-6b85-46a4-8568-7a517925a252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:20.604151 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551c2f2-6b85-46a4-8568-7a517925a252 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:20.604428 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551c2f2-6b85-46a4-8568-7a517925a252 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:20.604701 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551c2f2-6b85-46a4-8568-7a517925a252 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:20.605460 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551c2f2-6b85-46a4-8568-7a517925a252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:20.605765 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551c2f2-6b85-46a4-8568-7a517925a252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:20.607171 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0551c2f2-6b85-46a4-8568-7a517925a252 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:20.620468 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 555/1103] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:20.626599 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af4af4-7224-448c-9211-7679faee2a4d None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:20.734475 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af4af4-7224-448c-9211-7679faee2a4d None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:20.770333 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bffc7b-37d8-42ad-85c2-4dfc483fefbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:20.771135 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bffc7b-37d8-42ad-85c2-4dfc483fefbe None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:20.771411 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bffc7b-37d8-42ad-85c2-4dfc483fefbe None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:20.771676 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bffc7b-37d8-42ad-85c2-4dfc483fefbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:20.779152 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bffc7b-37d8-42ad-85c2-4dfc483fefbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:20.780570 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bffc7b-37d8-42ad-85c2-4dfc483fefbe None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:20.793420 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-31bffc7b-37d8-42ad-85c2-4dfc483fefbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:40:20.794586 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 549/1104] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:40:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:40:20.800791 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551c2f2-6b85-46a4-8568-7a517925a252 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:20.897672 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551c2f2-6b85-46a4-8568-7a517925a252 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:20.932030 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd6659-9a81-4108-bbf9-8464eaf45f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:20.932683 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd6659-9a81-4108-bbf9-8464eaf45f9f None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:20.933037 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd6659-9a81-4108-bbf9-8464eaf45f9f None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:20.933302 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd6659-9a81-4108-bbf9-8464eaf45f9f None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:20.934117 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd6659-9a81-4108-bbf9-8464eaf45f9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:20.934420 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd6659-9a81-4108-bbf9-8464eaf45f9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:20.935846 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd6659-9a81-4108-bbf9-8464eaf45f9f None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:20.947596 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 556/1105] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:40:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:20.953915 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bffc7b-37d8-42ad-85c2-4dfc483fefbe None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:21.056466 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bffc7b-37d8-42ad-85c2-4dfc483fefbe None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:21.089308 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff023a8a-376e-4dd6-a828-f3da1055205d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:21.089974 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff023a8a-376e-4dd6-a828-f3da1055205d None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:21.090253 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff023a8a-376e-4dd6-a828-f3da1055205d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:21.090520 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff023a8a-376e-4dd6-a828-f3da1055205d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:21.091348 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff023a8a-376e-4dd6-a828-f3da1055205d None admin] RBAC: Adding query filter params (role.id=1ad7159416cf4d999f172e7806e1a652, scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e, user.id=21ec894123044d4382995791c74c587b) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:21.091652 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff023a8a-376e-4dd6-a828-f3da1055205d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:21.093060 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff023a8a-376e-4dd6-a828-f3da1055205d None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:21.098749 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 550/1106] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:40:20 2022] GET /identity/v3/role_assignments?user.id=21ec894123044d4382995791c74c587b&scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e&role.id=1ad7159416cf4d999f172e7806e1a652 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:22.887522 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a2eee-4014-4288-81b7-4ec83b1a7633 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:22.888059 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a2eee-4014-4288-81b7-4ec83b1a7633 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:22.888059 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a2eee-4014-4288-81b7-4ec83b1a7633 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:22.889816 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 557/1107] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:22.895310 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814e090-dce1-436d-a402-7a32e872a0c9 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:22.895751 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814e090-dce1-436d-a402-7a32e872a0c9 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:22.895849 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814e090-dce1-436d-a402-7a32e872a0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:22.914704 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-3814e090-dce1-436d-a402-7a32e872a0c9 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:22.915879 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-3814e090-dce1-436d-a402-7a32e872a0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:22.983492 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 551/1108] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:40:23.008593 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a2eee-4014-4288-81b7-4ec83b1a7633 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:23.124485 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a2eee-4014-4288-81b7-4ec83b1a7633 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:23.157889 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73093f-1c33-41db-b294-f67093317654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:23.158602 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73093f-1c33-41db-b294-f67093317654 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:23.158890 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73093f-1c33-41db-b294-f67093317654 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:23.159156 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73093f-1c33-41db-b294-f67093317654 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:23.160345 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73093f-1c33-41db-b294-f67093317654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:23.161817 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73093f-1c33-41db-b294-f67093317654 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:23.163404 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 558/1109] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:40:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:23.170159 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814e090-dce1-436d-a402-7a32e872a0c9 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:23.277989 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814e090-dce1-436d-a402-7a32e872a0c9 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:23.317762 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d181de4-4a79-44fd-a60e-5f6aebcc0025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:23.318420 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d181de4-4a79-44fd-a60e-5f6aebcc0025 None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:23.318697 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d181de4-4a79-44fd-a60e-5f6aebcc0025 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:23.318967 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d181de4-4a79-44fd-a60e-5f6aebcc0025 None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:23.319673 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d181de4-4a79-44fd-a60e-5f6aebcc0025 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:23.321098 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d181de4-4a79-44fd-a60e-5f6aebcc0025 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:23.346713 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 552/1110] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Mar 8 13:40:23 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:40:25.642198 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c66225-f805-4f5a-80f5-d527ba14a10b None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:25.643017 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c66225-f805-4f5a-80f5-d527ba14a10b None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:25.643017 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c66225-f805-4f5a-80f5-d527ba14a10b None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:25.645914 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 559/1111] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:25.654206 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7f285-e936-44bf-aa21-7cfabded321a None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:25.654658 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7f285-e936-44bf-aa21-7cfabded321a None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:25.654749 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7f285-e936-44bf-aa21-7cfabded321a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:25.673186 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-afb7f285-e936-44bf-aa21-7cfabded321a None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:25.674374 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-afb7f285-e936-44bf-aa21-7cfabded321a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:25.868908 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 553/1112] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:40:25.892478 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c66225-f805-4f5a-80f5-d527ba14a10b None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:25.995055 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c66225-f805-4f5a-80f5-d527ba14a10b None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:26.030820 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840b98d-ba9e-41dc-b993-e9190d2f75e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:26.031665 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840b98d-ba9e-41dc-b993-e9190d2f75e3 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:26.031943 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840b98d-ba9e-41dc-b993-e9190d2f75e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:26.032213 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840b98d-ba9e-41dc-b993-e9190d2f75e3 None admin] PATH_INFO: `/v3/roles/cbd629eb0cbe4cc7b69cc790228cdfc8` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:26.033735 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840b98d-ba9e-41dc-b993-e9190d2f75e3 None admin] RBAC: Authorizing `identity:get_role(role_id=cbd629eb0cbe4cc7b69cc790228cdfc8)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:26.035100 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840b98d-ba9e-41dc-b993-e9190d2f75e3 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:26.036462 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 560/1113] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:40:25 2022] GET /identity/v3/roles/cbd629eb0cbe4cc7b69cc790228cdfc8 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:26.042515 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7f285-e936-44bf-aa21-7cfabded321a None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:26.137515 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7f285-e936-44bf-aa21-7cfabded321a None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:26.171940 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65f257-30db-4b3b-bce5-9d8cccc5a65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:26.173029 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65f257-30db-4b3b-bce5-9d8cccc5a65f None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:26.173308 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65f257-30db-4b3b-bce5-9d8cccc5a65f None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:26.173602 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d65f257-30db-4b3b-bce5-9d8cccc5a65f None admin] PATH_INFO: `/v3/users/9b3622b713f64b15a3a158ff765c1274` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:26.186283 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65f257-30db-4b3b-bce5-9d8cccc5a65f None admin] RBAC: Authorizing `identity:get_user(user_id=9b3622b713f64b15a3a158ff765c1274)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:26.187692 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d65f257-30db-4b3b-bce5-9d8cccc5a65f None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:26.189282 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 554/1114] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:40:26 2022] GET /identity/v3/users/9b3622b713f64b15a3a158ff765c1274 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:26.195825 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840b98d-ba9e-41dc-b993-e9190d2f75e3 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:26.311251 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840b98d-ba9e-41dc-b993-e9190d2f75e3 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:26.349093 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e03f68-e54f-4f93-afaf-966b92f31930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:26.349771 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e03f68-e54f-4f93-afaf-966b92f31930 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:26.350044 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e03f68-e54f-4f93-afaf-966b92f31930 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:26.350295 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e03f68-e54f-4f93-afaf-966b92f31930 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:26.419573 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e03f68-e54f-4f93-afaf-966b92f31930 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:26.421026 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e03f68-e54f-4f93-afaf-966b92f31930 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:26.518732 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 561/1115] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:40:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:40:26.524968 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65f257-30db-4b3b-bce5-9d8cccc5a65f None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:26.617564 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d65f257-30db-4b3b-bce5-9d8cccc5a65f None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:26.648168 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e07b1-3f85-4355-823c-0b8a5f9169d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:26.648998 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e07b1-3f85-4355-823c-0b8a5f9169d9 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:26.649272 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e07b1-3f85-4355-823c-0b8a5f9169d9 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:26.649570 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e07b1-3f85-4355-823c-0b8a5f9169d9 None admin] PATH_INFO: `/v3/projects/caeef8c113754b0383f596605eb89e0f` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:26.650877 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e07b1-3f85-4355-823c-0b8a5f9169d9 None admin] RBAC: Authorizing `identity:get_project(project_id=caeef8c113754b0383f596605eb89e0f)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:26.652593 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e07b1-3f85-4355-823c-0b8a5f9169d9 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:26.654252 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 555/1116] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:40:26 2022] GET /identity/v3/projects/caeef8c113754b0383f596605eb89e0f => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:26.660727 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e03f68-e54f-4f93-afaf-966b92f31930 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:26.766113 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e03f68-e54f-4f93-afaf-966b92f31930 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:26.810171 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59611350-092a-4cbb-bfed-73a50fb50281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:26.810808 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59611350-092a-4cbb-bfed-73a50fb50281 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:26.811083 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59611350-092a-4cbb-bfed-73a50fb50281 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:26.811351 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59611350-092a-4cbb-bfed-73a50fb50281 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:26.812169 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59611350-092a-4cbb-bfed-73a50fb50281 None admin] RBAC: Adding query filter params (role.id=cbd629eb0cbe4cc7b69cc790228cdfc8, scope.project.id=caeef8c113754b0383f596605eb89e0f, user.id=9b3622b713f64b15a3a158ff765c1274) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:26.812477 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59611350-092a-4cbb-bfed-73a50fb50281 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:26.813927 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59611350-092a-4cbb-bfed-73a50fb50281 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:26.819558 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 562/1117] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:40:26 2022] GET /identity/v3/role_assignments?user.id=9b3622b713f64b15a3a158ff765c1274&scope.project.id=caeef8c113754b0383f596605eb89e0f&role.id=cbd629eb0cbe4cc7b69cc790228cdfc8 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:29.095274 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210168f-0a0e-44ce-b646-e6bd051b3eab None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:29.095876 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210168f-0a0e-44ce-b646-e6bd051b3eab None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:29.095876 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210168f-0a0e-44ce-b646-e6bd051b3eab None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:29.097644 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 556/1118] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:29.103944 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7feb8be-22a6-490c-9912-28ae689f9e7e None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:29.104390 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7feb8be-22a6-490c-9912-28ae689f9e7e None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:29.104493 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7feb8be-22a6-490c-9912-28ae689f9e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:29.127661 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-f7feb8be-22a6-490c-9912-28ae689f9e7e None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:29.128841 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-f7feb8be-22a6-490c-9912-28ae689f9e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:29.198807 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 563/1119] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:40:29.222724 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210168f-0a0e-44ce-b646-e6bd051b3eab None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:29.342898 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210168f-0a0e-44ce-b646-e6bd051b3eab None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:29.378332 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3957e1-fde4-4502-805f-c8b746055985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:29.379100 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3957e1-fde4-4502-805f-c8b746055985 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:29.379364 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3957e1-fde4-4502-805f-c8b746055985 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:29.379628 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3957e1-fde4-4502-805f-c8b746055985 None admin] PATH_INFO: `/v3/roles/cbd629eb0cbe4cc7b69cc790228cdfc8` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:29.381165 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3957e1-fde4-4502-805f-c8b746055985 None admin] RBAC: Authorizing `identity:get_role(role_id=cbd629eb0cbe4cc7b69cc790228cdfc8)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:29.382541 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3957e1-fde4-4502-805f-c8b746055985 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:29.383945 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 557/1120] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:40:29 2022] GET /identity/v3/roles/cbd629eb0cbe4cc7b69cc790228cdfc8 => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:29.392997 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7feb8be-22a6-490c-9912-28ae689f9e7e None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:29.499980 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7feb8be-22a6-490c-9912-28ae689f9e7e None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:29.538628 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7081b-a2a8-4084-83ab-56e0dbd90887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:29.539496 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7081b-a2a8-4084-83ab-56e0dbd90887 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:29.539776 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7081b-a2a8-4084-83ab-56e0dbd90887 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:29.540083 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7081b-a2a8-4084-83ab-56e0dbd90887 None admin] PATH_INFO: `/v3/users/9b3622b713f64b15a3a158ff765c1274` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:29.541287 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7081b-a2a8-4084-83ab-56e0dbd90887 None admin] RBAC: Authorizing `identity:get_user(user_id=9b3622b713f64b15a3a158ff765c1274)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:29.542763 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7081b-a2a8-4084-83ab-56e0dbd90887 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:29.544389 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 564/1121] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:40:29 2022] GET /identity/v3/users/9b3622b713f64b15a3a158ff765c1274 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:29.551057 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3957e1-fde4-4502-805f-c8b746055985 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:29.654305 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3957e1-fde4-4502-805f-c8b746055985 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:29.687690 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c73c3-e98f-4906-b64f-4daef911be94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:29.688529 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c73c3-e98f-4906-b64f-4daef911be94 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:29.688803 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c73c3-e98f-4906-b64f-4daef911be94 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:29.689071 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c73c3-e98f-4906-b64f-4daef911be94 None admin] PATH_INFO: `/v3/projects/caeef8c113754b0383f596605eb89e0f` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:29.690388 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c73c3-e98f-4906-b64f-4daef911be94 None admin] RBAC: Authorizing `identity:get_project(project_id=caeef8c113754b0383f596605eb89e0f)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:29.691781 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c73c3-e98f-4906-b64f-4daef911be94 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:29.693454 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 558/1122] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:40:29 2022] GET /identity/v3/projects/caeef8c113754b0383f596605eb89e0f => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:40:29.699396 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7081b-a2a8-4084-83ab-56e0dbd90887 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:29.805896 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7081b-a2a8-4084-83ab-56e0dbd90887 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:29.843524 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19651fa5-5e68-4ea7-8434-7c2ee8e92ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:29.844416 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19651fa5-5e68-4ea7-8434-7c2ee8e92ea8 None admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:29.844693 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19651fa5-5e68-4ea7-8434-7c2ee8e92ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:29.844967 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19651fa5-5e68-4ea7-8434-7c2ee8e92ea8 None admin] PATH_INFO: `/v3/projects/caeef8c113754b0383f596605eb89e0f/users/9b3622b713f64b15a3a158ff765c1274/roles/cbd629eb0cbe4cc7b69cc790228cdfc8` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:29.847584 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19651fa5-5e68-4ea7-8434-7c2ee8e92ea8 None admin] RBAC: Authorizing `identity:create_grant(project_id=caeef8c113754b0383f596605eb89e0f, user_id=9b3622b713f64b15a3a158ff765c1274, role_id=cbd629eb0cbe4cc7b69cc790228cdfc8)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:29.849026 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19651fa5-5e68-4ea7-8434-7c2ee8e92ea8 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:29.864964 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 565/1123] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Mar 8 13:40:29 2022] PUT /identity/v3/projects/caeef8c113754b0383f596605eb89e0f/users/9b3622b713f64b15a3a158ff765c1274/roles/cbd629eb0cbe4cc7b69cc790228cdfc8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:40:32.091532 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ce160-8247-41b7-9d60-3247116b32e8 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:32.092121 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ce160-8247-41b7-9d60-3247116b32e8 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:32.092121 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ce160-8247-41b7-9d60-3247116b32e8 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:32.093911 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 559/1124] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:32.099387 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea48523-8edc-4d3b-ba83-96f84c65131c None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:32.099806 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea48523-8edc-4d3b-ba83-96f84c65131c None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:32.099914 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea48523-8edc-4d3b-ba83-96f84c65131c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:32.119383 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-8ea48523-8edc-4d3b-ba83-96f84c65131c None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:32.120544 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-8ea48523-8edc-4d3b-ba83-96f84c65131c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:32.191894 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 566/1125] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:40:32.216155 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ce160-8247-41b7-9d60-3247116b32e8 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:32.327950 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ce160-8247-41b7-9d60-3247116b32e8 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:32.361576 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ba4b7-44cd-4634-b035-6959f9391dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:32.362345 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ba4b7-44cd-4634-b035-6959f9391dc2 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:32.362617 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ba4b7-44cd-4634-b035-6959f9391dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:32.362885 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ba4b7-44cd-4634-b035-6959f9391dc2 None admin] PATH_INFO: `/v3/roles/cbd629eb0cbe4cc7b69cc790228cdfc8` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:32.364384 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ba4b7-44cd-4634-b035-6959f9391dc2 None admin] RBAC: Authorizing `identity:get_role(role_id=cbd629eb0cbe4cc7b69cc790228cdfc8)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:32.365765 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ba4b7-44cd-4634-b035-6959f9391dc2 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:32.367099 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 560/1126] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:40:32 2022] GET /identity/v3/roles/cbd629eb0cbe4cc7b69cc790228cdfc8 => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:32.376514 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea48523-8edc-4d3b-ba83-96f84c65131c None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:32.477752 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea48523-8edc-4d3b-ba83-96f84c65131c None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:32.512855 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2fb27-8059-464c-9d6a-944cc9b8f974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:32.513759 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2fb27-8059-464c-9d6a-944cc9b8f974 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:32.514035 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2fb27-8059-464c-9d6a-944cc9b8f974 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:32.514304 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e2fb27-8059-464c-9d6a-944cc9b8f974 None admin] PATH_INFO: `/v3/users/9b3622b713f64b15a3a158ff765c1274` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:32.515536 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2fb27-8059-464c-9d6a-944cc9b8f974 None admin] RBAC: Authorizing `identity:get_user(user_id=9b3622b713f64b15a3a158ff765c1274)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:32.516970 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e2fb27-8059-464c-9d6a-944cc9b8f974 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:32.518616 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 567/1127] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:40:32 2022] GET /identity/v3/users/9b3622b713f64b15a3a158ff765c1274 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:32.525427 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ba4b7-44cd-4634-b035-6959f9391dc2 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:32.628768 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ba4b7-44cd-4634-b035-6959f9391dc2 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:32.668496 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0ae18-55fa-4182-a5d8-408e795e45ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:32.669131 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0ae18-55fa-4182-a5d8-408e795e45ee None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:32.669397 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0ae18-55fa-4182-a5d8-408e795e45ee None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:32.669700 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0ae18-55fa-4182-a5d8-408e795e45ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:32.734761 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0ae18-55fa-4182-a5d8-408e795e45ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:32.736173 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c0ae18-55fa-4182-a5d8-408e795e45ee None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:32.834109 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 561/1128] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:40:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:40:32.840222 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2fb27-8059-464c-9d6a-944cc9b8f974 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:32.948152 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e2fb27-8059-464c-9d6a-944cc9b8f974 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:32.982661 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f376243b-76be-456f-84f7-f7b87509f9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:32.983506 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376243b-76be-456f-84f7-f7b87509f9ad None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:32.983778 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376243b-76be-456f-84f7-f7b87509f9ad None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:32.984042 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376243b-76be-456f-84f7-f7b87509f9ad None admin] PATH_INFO: `/v3/projects/caeef8c113754b0383f596605eb89e0f` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:32.985337 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376243b-76be-456f-84f7-f7b87509f9ad None admin] RBAC: Authorizing `identity:get_project(project_id=caeef8c113754b0383f596605eb89e0f)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:32.986793 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f376243b-76be-456f-84f7-f7b87509f9ad None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:32.988421 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 568/1129] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:40:32 2022] GET /identity/v3/projects/caeef8c113754b0383f596605eb89e0f => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:32.996116 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0ae18-55fa-4182-a5d8-408e795e45ee None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:33.096064 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0ae18-55fa-4182-a5d8-408e795e45ee None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:33.136487 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441ec63-3949-4702-b8f1-700293a0bd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:33.137129 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441ec63-3949-4702-b8f1-700293a0bd63 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:33.137397 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441ec63-3949-4702-b8f1-700293a0bd63 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:33.137696 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441ec63-3949-4702-b8f1-700293a0bd63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:33.138519 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441ec63-3949-4702-b8f1-700293a0bd63 None admin] RBAC: Adding query filter params (role.id=cbd629eb0cbe4cc7b69cc790228cdfc8, scope.project.id=caeef8c113754b0383f596605eb89e0f, user.id=9b3622b713f64b15a3a158ff765c1274) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:33.138823 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441ec63-3949-4702-b8f1-700293a0bd63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:33.140227 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441ec63-3949-4702-b8f1-700293a0bd63 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:33.146854 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 562/1130] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:40:32 2022] GET /identity/v3/role_assignments?user.id=9b3622b713f64b15a3a158ff765c1274&scope.project.id=caeef8c113754b0383f596605eb89e0f&role.id=cbd629eb0cbe4cc7b69cc790228cdfc8 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:35.390505 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46519c99-1b03-4023-94ce-f06c4ae6a3de None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:35.391389 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46519c99-1b03-4023-94ce-f06c4ae6a3de None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:35.391389 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46519c99-1b03-4023-94ce-f06c4ae6a3de None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:35.394303 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 569/1131] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:35.400697 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181a87b-8c15-4163-b770-957b452f2de3 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:35.401455 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181a87b-8c15-4163-b770-957b452f2de3 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:35.401884 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9181a87b-8c15-4163-b770-957b452f2de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:35.424073 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-9181a87b-8c15-4163-b770-957b452f2de3 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:35.425258 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-9181a87b-8c15-4163-b770-957b452f2de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:35.491290 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 563/1132] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:40:35.514796 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46519c99-1b03-4023-94ce-f06c4ae6a3de None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:35.617307 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46519c99-1b03-4023-94ce-f06c4ae6a3de None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:35.650955 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1a1c5-6b88-4340-8540-d96489a836f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:35.651974 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1a1c5-6b88-4340-8540-d96489a836f2 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:35.652255 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1a1c5-6b88-4340-8540-d96489a836f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:35.652522 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1a1c5-6b88-4340-8540-d96489a836f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:35.653820 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1a1c5-6b88-4340-8540-d96489a836f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:35.655255 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1a1c5-6b88-4340-8540-d96489a836f2 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:35.656845 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 570/1133] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:40:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:35.663377 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181a87b-8c15-4163-b770-957b452f2de3 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:35.766204 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9181a87b-8c15-4163-b770-957b452f2de3 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:35.811504 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8392ec3-444c-49ad-9cee-49a45eae6aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:35.812151 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8392ec3-444c-49ad-9cee-49a45eae6aa8 None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:35.812428 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8392ec3-444c-49ad-9cee-49a45eae6aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:35.812694 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8392ec3-444c-49ad-9cee-49a45eae6aa8 None admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:35.813417 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8392ec3-444c-49ad-9cee-49a45eae6aa8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:35.814838 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8392ec3-444c-49ad-9cee-49a45eae6aa8 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:35.843449 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 564/1134] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Mar 8 13:40:35 2022] POST /identity/v3/projects => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:40:38.099650 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce78a6-82d7-4c70-89c8-8002bebf3110 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:38.100208 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce78a6-82d7-4c70-89c8-8002bebf3110 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:38.100208 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce78a6-82d7-4c70-89c8-8002bebf3110 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:38.102026 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 571/1135] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:38.108558 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cd4d1-b8e6-417e-96a6-f951ea8bcbc5 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:38.109263 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cd4d1-b8e6-417e-96a6-f951ea8bcbc5 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:38.109481 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cd4d1-b8e6-417e-96a6-f951ea8bcbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:38.130966 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-bd7cd4d1-b8e6-417e-96a6-f951ea8bcbc5 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:38.132148 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-bd7cd4d1-b8e6-417e-96a6-f951ea8bcbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:38.198004 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 565/1136] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:40:38.224013 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce78a6-82d7-4c70-89c8-8002bebf3110 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:38.331647 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce78a6-82d7-4c70-89c8-8002bebf3110 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:38.365426 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3937e67-a6d5-43b6-b4b5-7f9f477a8f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:38.366157 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3937e67-a6d5-43b6-b4b5-7f9f477a8f78 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:38.366427 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3937e67-a6d5-43b6-b4b5-7f9f477a8f78 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:38.366693 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3937e67-a6d5-43b6-b4b5-7f9f477a8f78 None admin] PATH_INFO: `/v3/domains/default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:38.367951 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3937e67-a6d5-43b6-b4b5-7f9f477a8f78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:38.369395 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3937e67-a6d5-43b6-b4b5-7f9f477a8f78 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:38.370975 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 572/1137] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:40:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:38.377598 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7cd4d1-b8e6-417e-96a6-f951ea8bcbc5 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:38.486742 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7cd4d1-b8e6-417e-96a6-f951ea8bcbc5 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:38.524496 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12694f7-7f2f-440e-8953-89e3165f2afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:38.525163 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12694f7-7f2f-440e-8953-89e3165f2afd None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:38.525456 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12694f7-7f2f-440e-8953-89e3165f2afd None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:38.525724 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12694f7-7f2f-440e-8953-89e3165f2afd None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:38.526764 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12694f7-7f2f-440e-8953-89e3165f2afd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:38.528171 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12694f7-7f2f-440e-8953-89e3165f2afd None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:38.551234 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 566/1138] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Mar 8 13:40:38 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:40:40.851982 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50473319-0832-4923-950d-fdd328c8a25b None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:40.852523 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50473319-0832-4923-950d-fdd328c8a25b None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:40.852523 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50473319-0832-4923-950d-fdd328c8a25b None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:40.854316 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 573/1139] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:40.859998 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a3ef9-163b-4c14-9685-cfc47a4b5356 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:40.860418 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a3ef9-163b-4c14-9685-cfc47a4b5356 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:40.860508 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a3ef9-163b-4c14-9685-cfc47a4b5356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:40.878702 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-f11a3ef9-163b-4c14-9685-cfc47a4b5356 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:40.879841 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f11a3ef9-163b-4c14-9685-cfc47a4b5356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:40.949379 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 567/1140] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:40:40.973100 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50473319-0832-4923-950d-fdd328c8a25b None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:41.083570 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50473319-0832-4923-950d-fdd328c8a25b None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:41.120117 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e5640-5410-4e8d-9fa7-7dc65c175610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:41.120828 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e5640-5410-4e8d-9fa7-7dc65c175610 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:41.121101 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e5640-5410-4e8d-9fa7-7dc65c175610 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:41.121396 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e5640-5410-4e8d-9fa7-7dc65c175610 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:41.131787 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e5640-5410-4e8d-9fa7-7dc65c175610 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:40:41.138500 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-088e5640-5410-4e8d-9fa7-7dc65c175610 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:40:41.139649 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 574/1141] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:40:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:40:41.146120 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a3ef9-163b-4c14-9685-cfc47a4b5356 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:41.243126 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a3ef9-163b-4c14-9685-cfc47a4b5356 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:41.276988 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b1f91-4e60-493e-8375-8507d0457210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:41.277672 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b1f91-4e60-493e-8375-8507d0457210 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:41.277943 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b1f91-4e60-493e-8375-8507d0457210 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:41.278207 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b1f91-4e60-493e-8375-8507d0457210 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:41.278950 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b1f91-4e60-493e-8375-8507d0457210 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:41.279248 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b1f91-4e60-493e-8375-8507d0457210 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:41.280598 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b1f91-4e60-493e-8375-8507d0457210 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:41.288503 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 568/1142] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:40:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:41.294782 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e5640-5410-4e8d-9fa7-7dc65c175610 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:41.392704 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e5640-5410-4e8d-9fa7-7dc65c175610 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:41.426258 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce1577-7dae-43a9-a9ef-b810b2055464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:41.427104 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce1577-7dae-43a9-a9ef-b810b2055464 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:41.427374 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce1577-7dae-43a9-a9ef-b810b2055464 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:41.427639 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce1577-7dae-43a9-a9ef-b810b2055464 None admin] PATH_INFO: `/v3/users/09b3a760d1ea42759f7f9c5deeea33f9` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:41.440800 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce1577-7dae-43a9-a9ef-b810b2055464 None admin] RBAC: Authorizing `identity:get_user(user_id=09b3a760d1ea42759f7f9c5deeea33f9)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:41.442285 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce1577-7dae-43a9-a9ef-b810b2055464 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:41.443867 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 575/1143] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:40:41 2022] GET /identity/v3/users/09b3a760d1ea42759f7f9c5deeea33f9 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:41.449907 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b1f91-4e60-493e-8375-8507d0457210 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:41.572239 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b1f91-4e60-493e-8375-8507d0457210 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:41.608021 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14dace6-cb53-47e4-9190-5d4c829d0faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:41.608664 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dace6-cb53-47e4-9190-5d4c829d0faf None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:41.608946 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dace6-cb53-47e4-9190-5d4c829d0faf None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:41.609218 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dace6-cb53-47e4-9190-5d4c829d0faf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:41.675194 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14dace6-cb53-47e4-9190-5d4c829d0faf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:41.676619 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14dace6-cb53-47e4-9190-5d4c829d0faf None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:41.772532 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 569/1144] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:40:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:40:41.779247 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce1577-7dae-43a9-a9ef-b810b2055464 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:41.892697 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce1577-7dae-43a9-a9ef-b810b2055464 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:41.926762 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa5013-48e7-4aeb-a263-e0bb04662e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:41.927546 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa5013-48e7-4aeb-a263-e0bb04662e4a None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:41.927824 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa5013-48e7-4aeb-a263-e0bb04662e4a None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:41.928091 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa5013-48e7-4aeb-a263-e0bb04662e4a None admin] PATH_INFO: `/v3/projects/6c01a0b048ab4ae3b3edfc5979dec0ef` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:41.929309 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa5013-48e7-4aeb-a263-e0bb04662e4a None admin] RBAC: Authorizing `identity:get_project(project_id=6c01a0b048ab4ae3b3edfc5979dec0ef)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:41.930812 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa5013-48e7-4aeb-a263-e0bb04662e4a None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:41.932493 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 576/1145] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:40:41 2022] GET /identity/v3/projects/6c01a0b048ab4ae3b3edfc5979dec0ef => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:41.939402 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14dace6-cb53-47e4-9190-5d4c829d0faf None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:42.045374 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14dace6-cb53-47e4-9190-5d4c829d0faf None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:42.081713 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487c5da-5dcd-46b1-98e7-a3aeffff0444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:42.082312 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487c5da-5dcd-46b1-98e7-a3aeffff0444 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:42.082611 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487c5da-5dcd-46b1-98e7-a3aeffff0444 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:42.082899 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487c5da-5dcd-46b1-98e7-a3aeffff0444 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:42.083711 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487c5da-5dcd-46b1-98e7-a3aeffff0444 None admin] RBAC: Adding query filter params (role.id=fc021ed5870a44f5a0f0b8fff994d6f0, scope.project.id=6c01a0b048ab4ae3b3edfc5979dec0ef, user.id=09b3a760d1ea42759f7f9c5deeea33f9) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:42.084016 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487c5da-5dcd-46b1-98e7-a3aeffff0444 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:42.085399 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3487c5da-5dcd-46b1-98e7-a3aeffff0444 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:42.090794 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 570/1146] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:40:41 2022] GET /identity/v3/role_assignments?user.id=09b3a760d1ea42759f7f9c5deeea33f9&scope.project.id=6c01a0b048ab4ae3b3edfc5979dec0ef&role.id=fc021ed5870a44f5a0f0b8fff994d6f0 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:44.304050 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7926d9-51e6-463c-a9ab-0e8874fc219c None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:44.304612 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7926d9-51e6-463c-a9ab-0e8874fc219c None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:44.304612 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7926d9-51e6-463c-a9ab-0e8874fc219c None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:44.306404 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 577/1147] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:44.312282 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29650d41-cc74-4561-b70f-dc55d0dfad41 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:44.312983 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29650d41-cc74-4561-b70f-dc55d0dfad41 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:44.313172 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29650d41-cc74-4561-b70f-dc55d0dfad41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:44.331646 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-29650d41-cc74-4561-b70f-dc55d0dfad41 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:44.332831 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-29650d41-cc74-4561-b70f-dc55d0dfad41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:44.399875 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 571/1148] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:40:44.423259 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7926d9-51e6-463c-a9ab-0e8874fc219c None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:44.524782 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7926d9-51e6-463c-a9ab-0e8874fc219c None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:44.558071 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d35865-c4a1-46b5-b0a7-6181698600e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:44.558782 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d35865-c4a1-46b5-b0a7-6181698600e9 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:44.559054 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d35865-c4a1-46b5-b0a7-6181698600e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:44.559317 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d35865-c4a1-46b5-b0a7-6181698600e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:44.569177 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d35865-c4a1-46b5-b0a7-6181698600e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:40:44.575842 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-12d35865-c4a1-46b5-b0a7-6181698600e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:40:44.577122 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 578/1149] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:40:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:40:44.595511 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29650d41-cc74-4561-b70f-dc55d0dfad41 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:44.699904 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29650d41-cc74-4561-b70f-dc55d0dfad41 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:44.733517 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55381c13-951e-4664-aa0a-508796c5bbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:44.734172 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55381c13-951e-4664-aa0a-508796c5bbd2 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:44.734453 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55381c13-951e-4664-aa0a-508796c5bbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:44.734722 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55381c13-951e-4664-aa0a-508796c5bbd2 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:44.735457 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55381c13-951e-4664-aa0a-508796c5bbd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:44.735761 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55381c13-951e-4664-aa0a-508796c5bbd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:44.737102 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55381c13-951e-4664-aa0a-508796c5bbd2 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:44.745518 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 572/1150] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:40:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:44.751777 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d35865-c4a1-46b5-b0a7-6181698600e9 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:44.855715 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d35865-c4a1-46b5-b0a7-6181698600e9 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:44.890149 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57846a-7889-4832-9d96-30c71cebc507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:44.891009 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57846a-7889-4832-9d96-30c71cebc507 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:44.891288 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57846a-7889-4832-9d96-30c71cebc507 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:44.891559 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57846a-7889-4832-9d96-30c71cebc507 None admin] PATH_INFO: `/v3/users/09b3a760d1ea42759f7f9c5deeea33f9` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:44.892807 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57846a-7889-4832-9d96-30c71cebc507 None admin] RBAC: Authorizing `identity:get_user(user_id=09b3a760d1ea42759f7f9c5deeea33f9)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:44.894266 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a57846a-7889-4832-9d96-30c71cebc507 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:44.895839 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 579/1151] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:40:44 2022] GET /identity/v3/users/09b3a760d1ea42759f7f9c5deeea33f9 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:44.902848 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55381c13-951e-4664-aa0a-508796c5bbd2 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:45.005640 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55381c13-951e-4664-aa0a-508796c5bbd2 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:45.039292 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a69e4-a001-461e-b75e-91b4e65064bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:45.040135 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a69e4-a001-461e-b75e-91b4e65064bb None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:45.040410 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a69e4-a001-461e-b75e-91b4e65064bb None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:45.040676 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a69e4-a001-461e-b75e-91b4e65064bb None admin] PATH_INFO: `/v3/projects/6c01a0b048ab4ae3b3edfc5979dec0ef` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:45.041983 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a69e4-a001-461e-b75e-91b4e65064bb None admin] RBAC: Authorizing `identity:get_project(project_id=6c01a0b048ab4ae3b3edfc5979dec0ef)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:45.043396 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a69e4-a001-461e-b75e-91b4e65064bb None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:45.045075 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 573/1152] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:40:44 2022] GET /identity/v3/projects/6c01a0b048ab4ae3b3edfc5979dec0ef => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:45.052067 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57846a-7889-4832-9d96-30c71cebc507 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:45.158127 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57846a-7889-4832-9d96-30c71cebc507 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:45.200652 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49791b5f-199e-466f-a89b-e0e6ddf102be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:45.201560 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49791b5f-199e-466f-a89b-e0e6ddf102be None admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:45.201835 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49791b5f-199e-466f-a89b-e0e6ddf102be None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:45.202103 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49791b5f-199e-466f-a89b-e0e6ddf102be None admin] PATH_INFO: `/v3/projects/6c01a0b048ab4ae3b3edfc5979dec0ef/users/09b3a760d1ea42759f7f9c5deeea33f9/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:45.204042 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49791b5f-199e-466f-a89b-e0e6ddf102be None admin] RBAC: Authorizing `identity:create_grant(project_id=6c01a0b048ab4ae3b3edfc5979dec0ef, user_id=09b3a760d1ea42759f7f9c5deeea33f9, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:45.205493 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49791b5f-199e-466f-a89b-e0e6ddf102be None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:45.224093 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 580/1153] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Mar 8 13:40:45 2022] PUT /identity/v3/projects/6c01a0b048ab4ae3b3edfc5979dec0ef/users/09b3a760d1ea42759f7f9c5deeea33f9/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:40:47.463519 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef506fb3-7d5e-473b-9c8e-3798a2fca976 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:47.464121 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef506fb3-7d5e-473b-9c8e-3798a2fca976 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:47.464121 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef506fb3-7d5e-473b-9c8e-3798a2fca976 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:47.465877 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 574/1154] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:47.472573 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f70b3-9c7c-4def-8525-0c33dea60f3b None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:47.473016 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f70b3-9c7c-4def-8525-0c33dea60f3b None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:47.473105 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f70b3-9c7c-4def-8525-0c33dea60f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:47.491765 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-f96f70b3-9c7c-4def-8525-0c33dea60f3b None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:47.492931 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-f96f70b3-9c7c-4def-8525-0c33dea60f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:47.559818 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 581/1155] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:40:47.583921 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef506fb3-7d5e-473b-9c8e-3798a2fca976 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:47.698117 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef506fb3-7d5e-473b-9c8e-3798a2fca976 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:47.731484 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80333b37-67ab-491b-b2e5-b277b1cf0b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:47.732228 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80333b37-67ab-491b-b2e5-b277b1cf0b4e None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:47.732509 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80333b37-67ab-491b-b2e5-b277b1cf0b4e None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:47.732778 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80333b37-67ab-491b-b2e5-b277b1cf0b4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:47.743969 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80333b37-67ab-491b-b2e5-b277b1cf0b4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:40:47.750677 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-80333b37-67ab-491b-b2e5-b277b1cf0b4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:40:47.751868 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 575/1156] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:40:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:40:47.759052 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f70b3-9c7c-4def-8525-0c33dea60f3b None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:47.869084 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f70b3-9c7c-4def-8525-0c33dea60f3b None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:47.903089 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c76382-6e6a-49cd-b051-f7a3f69abdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:47.903730 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c76382-6e6a-49cd-b051-f7a3f69abdbc None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:47.904010 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c76382-6e6a-49cd-b051-f7a3f69abdbc None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:47.904277 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c76382-6e6a-49cd-b051-f7a3f69abdbc None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:47.905014 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c76382-6e6a-49cd-b051-f7a3f69abdbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:47.905315 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c76382-6e6a-49cd-b051-f7a3f69abdbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:47.906713 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c76382-6e6a-49cd-b051-f7a3f69abdbc None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:47.917379 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 582/1157] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:40:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:47.926910 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80333b37-67ab-491b-b2e5-b277b1cf0b4e None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:48.039091 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80333b37-67ab-491b-b2e5-b277b1cf0b4e None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:48.072142 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0451ff-758e-49a2-8ae3-2d5bf450e97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:48.072980 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0451ff-758e-49a2-8ae3-2d5bf450e97c None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:48.073261 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0451ff-758e-49a2-8ae3-2d5bf450e97c None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:48.073565 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0451ff-758e-49a2-8ae3-2d5bf450e97c None admin] PATH_INFO: `/v3/users/09b3a760d1ea42759f7f9c5deeea33f9` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:48.074874 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0451ff-758e-49a2-8ae3-2d5bf450e97c None admin] RBAC: Authorizing `identity:get_user(user_id=09b3a760d1ea42759f7f9c5deeea33f9)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:48.076283 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0451ff-758e-49a2-8ae3-2d5bf450e97c None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:48.077913 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 576/1158] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:40:47 2022] GET /identity/v3/users/09b3a760d1ea42759f7f9c5deeea33f9 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:48.084242 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c76382-6e6a-49cd-b051-f7a3f69abdbc None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:48.189292 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c76382-6e6a-49cd-b051-f7a3f69abdbc None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:48.222783 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef354b-b65e-4f3f-bd4c-d276f57bff66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:48.223415 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef354b-b65e-4f3f-bd4c-d276f57bff66 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:48.223692 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef354b-b65e-4f3f-bd4c-d276f57bff66 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:48.223964 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef354b-b65e-4f3f-bd4c-d276f57bff66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:48.289008 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef354b-b65e-4f3f-bd4c-d276f57bff66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:48.290546 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef354b-b65e-4f3f-bd4c-d276f57bff66 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:48.385160 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 583/1159] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:40:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:40:48.394628 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0451ff-758e-49a2-8ae3-2d5bf450e97c None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:48.501032 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0451ff-758e-49a2-8ae3-2d5bf450e97c None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:48.541134 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c653109-e28d-4466-8f5a-b917f94ebf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:48.541972 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c653109-e28d-4466-8f5a-b917f94ebf18 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:48.542252 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c653109-e28d-4466-8f5a-b917f94ebf18 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:48.542526 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c653109-e28d-4466-8f5a-b917f94ebf18 None admin] PATH_INFO: `/v3/projects/6c01a0b048ab4ae3b3edfc5979dec0ef` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:48.543717 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c653109-e28d-4466-8f5a-b917f94ebf18 None admin] RBAC: Authorizing `identity:get_project(project_id=6c01a0b048ab4ae3b3edfc5979dec0ef)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:48.545134 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c653109-e28d-4466-8f5a-b917f94ebf18 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:48.546847 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 577/1160] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:40:48 2022] GET /identity/v3/projects/6c01a0b048ab4ae3b3edfc5979dec0ef => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:48.554057 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef354b-b65e-4f3f-bd4c-d276f57bff66 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:48.671185 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef354b-b65e-4f3f-bd4c-d276f57bff66 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:48.704865 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec563c3-4a81-41d9-9ece-c5527378d2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:48.705531 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec563c3-4a81-41d9-9ece-c5527378d2ea None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:48.705817 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec563c3-4a81-41d9-9ece-c5527378d2ea None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:48.706086 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec563c3-4a81-41d9-9ece-c5527378d2ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:48.707053 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec563c3-4a81-41d9-9ece-c5527378d2ea None admin] RBAC: Adding query filter params (role.id=fc021ed5870a44f5a0f0b8fff994d6f0, scope.project.id=6c01a0b048ab4ae3b3edfc5979dec0ef, user.id=09b3a760d1ea42759f7f9c5deeea33f9) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:48.707346 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec563c3-4a81-41d9-9ece-c5527378d2ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:48.709130 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec563c3-4a81-41d9-9ece-c5527378d2ea None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:48.714808 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 584/1161] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:40:48 2022] GET /identity/v3/role_assignments?user.id=09b3a760d1ea42759f7f9c5deeea33f9&scope.project.id=6c01a0b048ab4ae3b3edfc5979dec0ef&role.id=fc021ed5870a44f5a0f0b8fff994d6f0 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:50.977645 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b1ef6-0d9b-4a01-bb8d-d573b2f6e965 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:50.978190 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b1ef6-0d9b-4a01-bb8d-d573b2f6e965 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:50.978190 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b1ef6-0d9b-4a01-bb8d-d573b2f6e965 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:50.979974 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 578/1162] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:50.986367 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432e346-0eb5-4106-a23d-fcd5a0d6f639 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:50.987059 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432e346-0eb5-4106-a23d-fcd5a0d6f639 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:50.987190 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432e346-0eb5-4106-a23d-fcd5a0d6f639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:51.012005 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-4432e346-0eb5-4106-a23d-fcd5a0d6f639 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:51.013166 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-4432e346-0eb5-4106-a23d-fcd5a0d6f639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:51.080475 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 585/1163] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:40:51.108396 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b1ef6-0d9b-4a01-bb8d-d573b2f6e965 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:51.210014 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b1ef6-0d9b-4a01-bb8d-d573b2f6e965 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:51.243558 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502882a6-3a5b-410b-bd34-3517d81f8684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:51.244121 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502882a6-3a5b-410b-bd34-3517d81f8684 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:51.244397 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502882a6-3a5b-410b-bd34-3517d81f8684 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:51.244669 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502882a6-3a5b-410b-bd34-3517d81f8684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:51.309901 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502882a6-3a5b-410b-bd34-3517d81f8684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:51.311341 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502882a6-3a5b-410b-bd34-3517d81f8684 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:51.405935 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 579/1164] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:40:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:40:51.412562 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432e346-0eb5-4106-a23d-fcd5a0d6f639 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:51.513142 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432e346-0eb5-4106-a23d-fcd5a0d6f639 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:51.547767 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61268ceb-42bc-4619-80cb-ea983a008118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:51.548541 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61268ceb-42bc-4619-80cb-ea983a008118 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:51.548810 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61268ceb-42bc-4619-80cb-ea983a008118 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:51.549073 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61268ceb-42bc-4619-80cb-ea983a008118 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:51.555911 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61268ceb-42bc-4619-80cb-ea983a008118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:51.557391 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61268ceb-42bc-4619-80cb-ea983a008118 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:51.572271 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-61268ceb-42bc-4619-80cb-ea983a008118 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Mar 08 13:40:51.573419 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 586/1165] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Mar 8 13:40:51 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:40:51.579752 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502882a6-3a5b-410b-bd34-3517d81f8684 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:51.693046 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502882a6-3a5b-410b-bd34-3517d81f8684 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:51.738674 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb9554-6482-40a2-a6a4-ed07fc4f4f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:51.739403 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb9554-6482-40a2-a6a4-ed07fc4f4f83 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:51.739673 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb9554-6482-40a2-a6a4-ed07fc4f4f83 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:51.739942 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb9554-6482-40a2-a6a4-ed07fc4f4f83 None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:51.740652 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb9554-6482-40a2-a6a4-ed07fc4f4f83 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:40:51.740947 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb9554-6482-40a2-a6a4-ed07fc4f4f83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:51.742328 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb9554-6482-40a2-a6a4-ed07fc4f4f83 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:51.750193 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 580/1166] 10.222.0.18 () {56 vars in 1115 bytes} [Tue Mar 8 13:40:51 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:53.970317 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8fb04-3c11-4c5f-b718-82f25799722e None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:53.971162 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8fb04-3c11-4c5f-b718-82f25799722e None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:53.971332 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe8fb04-3c11-4c5f-b718-82f25799722e None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:53.974157 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 587/1167] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:53.981816 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b7faf-706c-442a-946a-bd96316e0abf None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:53.982205 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b7faf-706c-442a-946a-bd96316e0abf None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:53.982542 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b7faf-706c-442a-946a-bd96316e0abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:54.001192 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-f10b7faf-706c-442a-946a-bd96316e0abf None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:54.002423 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f10b7faf-706c-442a-946a-bd96316e0abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:54.070676 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 581/1168] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:40:54.094017 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8fb04-3c11-4c5f-b718-82f25799722e None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:54.200835 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe8fb04-3c11-4c5f-b718-82f25799722e None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:54.234614 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067c71e-4afb-4ff6-9249-a3358e970f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:54.235192 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067c71e-4afb-4ff6-9249-a3358e970f4a None admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:54.235469 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067c71e-4afb-4ff6-9249-a3358e970f4a None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:54.235738 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067c71e-4afb-4ff6-9249-a3358e970f4a None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:54.236480 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067c71e-4afb-4ff6-9249-a3358e970f4a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:54.237895 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067c71e-4afb-4ff6-9249-a3358e970f4a None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:54.255428 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 588/1169] 10.222.0.18 () {60 vars in 1138 bytes} [Tue Mar 8 13:40:54 2022] POST /identity/v3/domains => generated 267 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:40:56.540553 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d28d9-b69e-40a9-afac-d675a736b2e4 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:56.541286 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d28d9-b69e-40a9-afac-d675a736b2e4 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:56.541411 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d28d9-b69e-40a9-afac-d675a736b2e4 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:56.544154 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 582/1170] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:56.550256 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32269a-6d62-46a3-87fb-c9931ad92309 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:56.550700 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32269a-6d62-46a3-87fb-c9931ad92309 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:56.550824 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32269a-6d62-46a3-87fb-c9931ad92309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:56.569171 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-3a32269a-6d62-46a3-87fb-c9931ad92309 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:56.570394 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-3a32269a-6d62-46a3-87fb-c9931ad92309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:56.641999 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 589/1171] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:40:56.666645 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d28d9-b69e-40a9-afac-d675a736b2e4 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:56.779339 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d28d9-b69e-40a9-afac-d675a736b2e4 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:56.816114 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8988a9b-5f55-441f-b7a8-911ff52e147f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:56.816957 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8988a9b-5f55-441f-b7a8-911ff52e147f None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:56.817231 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8988a9b-5f55-441f-b7a8-911ff52e147f None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:56.817542 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8988a9b-5f55-441f-b7a8-911ff52e147f None admin] PATH_INFO: `/v3/domains/55b384e030d84af5bec5eba1124e6ed4` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:56.828173 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8988a9b-5f55-441f-b7a8-911ff52e147f None admin] RBAC: Authorizing `identity:get_domain(domain_id=55b384e030d84af5bec5eba1124e6ed4)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:56.829623 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8988a9b-5f55-441f-b7a8-911ff52e147f None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:56.831217 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 583/1172] 10.222.0.18 () {56 vars in 1183 bytes} [Tue Mar 8 13:40:56 2022] GET /identity/v3/domains/55b384e030d84af5bec5eba1124e6ed4 => generated 267 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:56.839849 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32269a-6d62-46a3-87fb-c9931ad92309 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:56.942996 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32269a-6d62-46a3-87fb-c9931ad92309 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:56.978558 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f2df4-243f-4446-bc1b-63fb5378a22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:56.979208 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f2df4-243f-4446-bc1b-63fb5378a22f None admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:56.979484 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f2df4-243f-4446-bc1b-63fb5378a22f None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:56.979732 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f2df4-243f-4446-bc1b-63fb5378a22f None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:56.980475 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f2df4-243f-4446-bc1b-63fb5378a22f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:56.981928 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f2df4-243f-4446-bc1b-63fb5378a22f None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:57.011262 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 590/1173] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Mar 8 13:40:56 2022] POST /identity/v3/projects => generated 361 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:40:59.283168 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11927f3e-56e0-4e7e-8ea0-36a268fea2c7 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:59.284050 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11927f3e-56e0-4e7e-8ea0-36a268fea2c7 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:59.284228 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11927f3e-56e0-4e7e-8ea0-36a268fea2c7 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:59.287110 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 584/1174] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:40:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:40:59.292681 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083c866-7bea-4d6a-83f0-d03e1fc9367b None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:59.293106 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083c866-7bea-4d6a-83f0-d03e1fc9367b None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:59.293202 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083c866-7bea-4d6a-83f0-d03e1fc9367b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:59.311713 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-b083c866-7bea-4d6a-83f0-d03e1fc9367b None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:40:59.312871 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-b083c866-7bea-4d6a-83f0-d03e1fc9367b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:40:59.378613 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 591/1175] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:40:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:40:59.404724 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11927f3e-56e0-4e7e-8ea0-36a268fea2c7 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:59.527509 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11927f3e-56e0-4e7e-8ea0-36a268fea2c7 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:59.563101 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09daee-4a2c-4bd9-9d48-1d09e70a8ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:59.563893 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09daee-4a2c-4bd9-9d48-1d09e70a8ef8 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:59.564170 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09daee-4a2c-4bd9-9d48-1d09e70a8ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:59.564440 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09daee-4a2c-4bd9-9d48-1d09e70a8ef8 None admin] PATH_INFO: `/v3/domains/55b384e030d84af5bec5eba1124e6ed4` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:59.565692 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09daee-4a2c-4bd9-9d48-1d09e70a8ef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=55b384e030d84af5bec5eba1124e6ed4)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:59.567117 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a09daee-4a2c-4bd9-9d48-1d09e70a8ef8 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:59.568704 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 585/1176] 10.222.0.18 () {56 vars in 1183 bytes} [Tue Mar 8 13:40:59 2022] GET /identity/v3/domains/55b384e030d84af5bec5eba1124e6ed4 => generated 267 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:40:59.574618 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083c866-7bea-4d6a-83f0-d03e1fc9367b None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:40:59.679881 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083c866-7bea-4d6a-83f0-d03e1fc9367b None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:40:59.714070 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247610f7-64e8-49e1-8b2f-09b05f81d913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:40:59.714845 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247610f7-64e8-49e1-8b2f-09b05f81d913 None admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:40:59.715080 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247610f7-64e8-49e1-8b2f-09b05f81d913 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:40:59.715400 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247610f7-64e8-49e1-8b2f-09b05f81d913 None admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:40:59.716127 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247610f7-64e8-49e1-8b2f-09b05f81d913 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:40:59.717580 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247610f7-64e8-49e1-8b2f-09b05f81d913 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:40:59.742297 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 592/1177] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Mar 8 13:40:59 2022] POST /identity/v3/users => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:41:02.029197 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07bba0-14c5-408a-bd57-d28b57880aba None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:41:02.029855 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07bba0-14c5-408a-bd57-d28b57880aba None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:41:02.029855 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07bba0-14c5-408a-bd57-d28b57880aba None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:41:02.031558 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 586/1178] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:41:02.036911 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec9a32-af06-435a-a677-6e896515c5e3 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:41:02.037408 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec9a32-af06-435a-a677-6e896515c5e3 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:41:02.037832 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec9a32-af06-435a-a677-6e896515c5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:41:02.066066 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-f8ec9a32-af06-435a-a677-6e896515c5e3 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:41:02.067941 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-f8ec9a32-af06-435a-a677-6e896515c5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:41:02.138785 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 593/1179] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:41:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:41:02.162764 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07bba0-14c5-408a-bd57-d28b57880aba None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:41:02.266526 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07bba0-14c5-408a-bd57-d28b57880aba None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:41:02.300126 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7d31d-ac28-45d0-9fdf-147ecc9ac908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:41:02.300842 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7d31d-ac28-45d0-9fdf-147ecc9ac908 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:41:02.301128 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7d31d-ac28-45d0-9fdf-147ecc9ac908 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:41:02.301395 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f7d31d-ac28-45d0-9fdf-147ecc9ac908 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:41:02.312063 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f7d31d-ac28-45d0-9fdf-147ecc9ac908 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:41:02.318833 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-71f7d31d-ac28-45d0-9fdf-147ecc9ac908 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:41:02.319976 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 587/1180] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:41:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:41:02.326285 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec9a32-af06-435a-a677-6e896515c5e3 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:41:02.428182 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec9a32-af06-435a-a677-6e896515c5e3 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:41:02.462125 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8bce8-9c24-430f-8820-b8d6b4bddc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:41:02.462783 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8bce8-9c24-430f-8820-b8d6b4bddc5a None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:41:02.463060 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8bce8-9c24-430f-8820-b8d6b4bddc5a None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:41:02.463337 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8bce8-9c24-430f-8820-b8d6b4bddc5a None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:41:02.464084 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8bce8-9c24-430f-8820-b8d6b4bddc5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:41:02.464393 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8bce8-9c24-430f-8820-b8d6b4bddc5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:41:02.465810 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8bce8-9c24-430f-8820-b8d6b4bddc5a None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:41:02.473914 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 594/1181] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:41:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:41:02.483322 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7d31d-ac28-45d0-9fdf-147ecc9ac908 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:41:02.590877 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f7d31d-ac28-45d0-9fdf-147ecc9ac908 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:41:02.624414 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb96c3b-eca8-43ef-bdf4-66a1d819acf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:41:02.625263 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb96c3b-eca8-43ef-bdf4-66a1d819acf7 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:41:02.625578 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb96c3b-eca8-43ef-bdf4-66a1d819acf7 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:41:02.625854 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb96c3b-eca8-43ef-bdf4-66a1d819acf7 None admin] PATH_INFO: `/v3/users/17bfebe6b8d54d8aab9e8d3677f193ee` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:41:02.638799 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb96c3b-eca8-43ef-bdf4-66a1d819acf7 None admin] RBAC: Authorizing `identity:get_user(user_id=17bfebe6b8d54d8aab9e8d3677f193ee)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:41:02.640227 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb96c3b-eca8-43ef-bdf4-66a1d819acf7 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:41:02.641879 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 588/1182] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:41:02 2022] GET /identity/v3/users/17bfebe6b8d54d8aab9e8d3677f193ee => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:41:02.650009 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8bce8-9c24-430f-8820-b8d6b4bddc5a None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:41:02.757135 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8bce8-9c24-430f-8820-b8d6b4bddc5a None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:41:02.791107 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dea3a7-8fb3-4e42-bd99-ae68bf12545a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:41:02.791736 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dea3a7-8fb3-4e42-bd99-ae68bf12545a None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:41:02.792015 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dea3a7-8fb3-4e42-bd99-ae68bf12545a None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:41:02.792292 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dea3a7-8fb3-4e42-bd99-ae68bf12545a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:41:02.862466 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dea3a7-8fb3-4e42-bd99-ae68bf12545a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:41:02.863856 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dea3a7-8fb3-4e42-bd99-ae68bf12545a None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:41:02.961540 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 595/1183] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:41:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Mar 08 13:41:02.968516 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb96c3b-eca8-43ef-bdf4-66a1d819acf7 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:41:03.083269 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb96c3b-eca8-43ef-bdf4-66a1d819acf7 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:41:03.119358 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f300e7e-5f27-4232-9529-2f1922b2ced5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:41:03.120124 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f300e7e-5f27-4232-9529-2f1922b2ced5 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:41:03.120397 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f300e7e-5f27-4232-9529-2f1922b2ced5 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:41:03.120669 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f300e7e-5f27-4232-9529-2f1922b2ced5 None admin] PATH_INFO: `/v3/projects/bd7a894dea834d028bff936c6a23063b` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:41:03.121906 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f300e7e-5f27-4232-9529-2f1922b2ced5 None admin] RBAC: Authorizing `identity:get_project(project_id=bd7a894dea834d028bff936c6a23063b)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:41:03.123313 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f300e7e-5f27-4232-9529-2f1922b2ced5 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:41:03.124996 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 589/1184] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:41:02 2022] GET /identity/v3/projects/bd7a894dea834d028bff936c6a23063b => generated 361 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:41:03.131884 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dea3a7-8fb3-4e42-bd99-ae68bf12545a None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:41:03.234771 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dea3a7-8fb3-4e42-bd99-ae68bf12545a None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:41:03.268849 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe3389-7fed-47c9-b439-c6c1f1533811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:41:03.269513 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe3389-7fed-47c9-b439-c6c1f1533811 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:41:03.269794 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe3389-7fed-47c9-b439-c6c1f1533811 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:41:03.270067 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe3389-7fed-47c9-b439-c6c1f1533811 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:41:03.270899 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe3389-7fed-47c9-b439-c6c1f1533811 None admin] RBAC: Adding query filter params (role.id=fc021ed5870a44f5a0f0b8fff994d6f0, scope.project.id=bd7a894dea834d028bff936c6a23063b, user.id=17bfebe6b8d54d8aab9e8d3677f193ee) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:41:03.271208 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe3389-7fed-47c9-b439-c6c1f1533811 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:41:03.272719 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe3389-7fed-47c9-b439-c6c1f1533811 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:41:03.278471 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 596/1185] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:41:03 2022] GET /identity/v3/role_assignments?user.id=17bfebe6b8d54d8aab9e8d3677f193ee&scope.project.id=bd7a894dea834d028bff936c6a23063b&role.id=fc021ed5870a44f5a0f0b8fff994d6f0 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:41:05.498059 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509e502-9daf-4ebc-94b8-1e4a31bdc9c8 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:41:05.498627 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509e502-9daf-4ebc-94b8-1e4a31bdc9c8 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:41:05.498627 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509e502-9daf-4ebc-94b8-1e4a31bdc9c8 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:41:05.500374 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 590/1186] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:41:05.506805 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfa5ce-8133-4d5d-abe1-77491b81fc8c None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:41:05.507491 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfa5ce-8133-4d5d-abe1-77491b81fc8c None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:41:05.507651 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecfa5ce-8133-4d5d-abe1-77491b81fc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:41:05.530626 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-9ecfa5ce-8133-4d5d-abe1-77491b81fc8c None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:41:05.531811 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-9ecfa5ce-8133-4d5d-abe1-77491b81fc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:41:05.598590 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 597/1187] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:41:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:41:05.621421 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509e502-9daf-4ebc-94b8-1e4a31bdc9c8 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:41:05.731475 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509e502-9daf-4ebc-94b8-1e4a31bdc9c8 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:41:05.769857 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8a226-8bf3-4af6-aa58-0d9229d9eed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:41:05.770583 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8a226-8bf3-4af6-aa58-0d9229d9eed2 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:41:05.770852 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8a226-8bf3-4af6-aa58-0d9229d9eed2 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:41:05.771151 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8a226-8bf3-4af6-aa58-0d9229d9eed2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:41:05.782246 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8a226-8bf3-4af6-aa58-0d9229d9eed2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:41:05.788988 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-2ff8a226-8bf3-4af6-aa58-0d9229d9eed2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:41:05.790203 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 591/1188] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:41:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:41:05.796777 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfa5ce-8133-4d5d-abe1-77491b81fc8c None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:41:06.032075 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecfa5ce-8133-4d5d-abe1-77491b81fc8c None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:41:06.064827 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68db65-a560-413d-a20f-4acd3d504cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:41:06.065494 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68db65-a560-413d-a20f-4acd3d504cbd None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:41:06.065767 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68db65-a560-413d-a20f-4acd3d504cbd None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:41:06.066031 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68db65-a560-413d-a20f-4acd3d504cbd None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:41:06.066765 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68db65-a560-413d-a20f-4acd3d504cbd None admin] RBAC: Adding query filter params (name=admin) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:41:06.067063 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68db65-a560-413d-a20f-4acd3d504cbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:41:06.068462 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68db65-a560-413d-a20f-4acd3d504cbd None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:41:06.076111 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 598/1189] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:41:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:41:06.082912 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8a226-8bf3-4af6-aa58-0d9229d9eed2 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:41:06.196647 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8a226-8bf3-4af6-aa58-0d9229d9eed2 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:41:06.229455 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdb737-b329-4df0-8dc0-ad241bfc39f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:41:06.230308 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdb737-b329-4df0-8dc0-ad241bfc39f7 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:41:06.230583 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdb737-b329-4df0-8dc0-ad241bfc39f7 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:41:06.230848 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdb737-b329-4df0-8dc0-ad241bfc39f7 None admin] PATH_INFO: `/v3/users/17bfebe6b8d54d8aab9e8d3677f193ee` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:41:06.232056 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fdb737-b329-4df0-8dc0-ad241bfc39f7 None admin] RBAC: Authorizing `identity:get_user(user_id=17bfebe6b8d54d8aab9e8d3677f193ee)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:41:06.233493 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fdb737-b329-4df0-8dc0-ad241bfc39f7 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:41:06.235092 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 592/1190] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:41:06 2022] GET /identity/v3/users/17bfebe6b8d54d8aab9e8d3677f193ee => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:41:06.242958 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68db65-a560-413d-a20f-4acd3d504cbd None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:41:06.340518 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68db65-a560-413d-a20f-4acd3d504cbd None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:41:06.373288 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374c932-9375-47f0-a27b-992f3299d839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:41:06.374294 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374c932-9375-47f0-a27b-992f3299d839 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:41:06.374573 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374c932-9375-47f0-a27b-992f3299d839 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:41:06.374830 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374c932-9375-47f0-a27b-992f3299d839 None admin] PATH_INFO: `/v3/projects/bd7a894dea834d028bff936c6a23063b` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:41:06.376107 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374c932-9375-47f0-a27b-992f3299d839 None admin] RBAC: Authorizing `identity:get_project(project_id=bd7a894dea834d028bff936c6a23063b)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:41:06.377550 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374c932-9375-47f0-a27b-992f3299d839 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:41:06.379157 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 599/1191] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:41:06 2022] GET /identity/v3/projects/bd7a894dea834d028bff936c6a23063b => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:41:06.385957 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdb737-b329-4df0-8dc0-ad241bfc39f7 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:41:06.498563 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdb737-b329-4df0-8dc0-ad241bfc39f7 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:41:06.531796 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c5c5e-2cc7-473c-9fcf-afd7a71cc3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:41:06.532673 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c5c5e-2cc7-473c-9fcf-afd7a71cc3e9 None admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:41:06.532948 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c5c5e-2cc7-473c-9fcf-afd7a71cc3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:41:06.533219 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c5c5e-2cc7-473c-9fcf-afd7a71cc3e9 None admin] PATH_INFO: `/v3/projects/bd7a894dea834d028bff936c6a23063b/users/17bfebe6b8d54d8aab9e8d3677f193ee/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:41:06.535290 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c5c5e-2cc7-473c-9fcf-afd7a71cc3e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=bd7a894dea834d028bff936c6a23063b, user_id=17bfebe6b8d54d8aab9e8d3677f193ee, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:41:06.536695 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c5c5e-2cc7-473c-9fcf-afd7a71cc3e9 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:41:06.556070 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 593/1192] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Mar 8 13:41:06 2022] PUT /identity/v3/projects/bd7a894dea834d028bff936c6a23063b/users/17bfebe6b8d54d8aab9e8d3677f193ee/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:41:08.809965 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab98b12-79d9-4d34-9c52-e40d57b4f7df None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:41:08.810490 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab98b12-79d9-4d34-9c52-e40d57b4f7df None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:41:08.810490 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab98b12-79d9-4d34-9c52-e40d57b4f7df None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:41:08.812193 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 600/1193] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:41:08.818855 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f1a58-6518-4885-8af3-b7b1e813e496 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:41:08.819556 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f1a58-6518-4885-8af3-b7b1e813e496 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:41:08.819732 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f1a58-6518-4885-8af3-b7b1e813e496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:41:08.847272 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-6e9f1a58-6518-4885-8af3-b7b1e813e496 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:41:08.849408 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-6e9f1a58-6518-4885-8af3-b7b1e813e496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:41:08.934060 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 594/1194] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:41:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:41:08.960743 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab98b12-79d9-4d34-9c52-e40d57b4f7df None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:41:09.060596 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab98b12-79d9-4d34-9c52-e40d57b4f7df None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:41:09.093531 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a03ae6-191e-414d-8f67-2c09364328e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:41:09.094306 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a03ae6-191e-414d-8f67-2c09364328e1 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:41:09.094578 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a03ae6-191e-414d-8f67-2c09364328e1 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:41:09.094827 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a03ae6-191e-414d-8f67-2c09364328e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:41:09.105313 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a03ae6-191e-414d-8f67-2c09364328e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:41:09.111963 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-49a03ae6-191e-414d-8f67-2c09364328e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:41:09.113134 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 601/1195] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:41:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:41:09.119744 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f1a58-6518-4885-8af3-b7b1e813e496 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:41:09.222357 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f1a58-6518-4885-8af3-b7b1e813e496 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:41:09.255700 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78512c-ee59-4f88-abf6-e986ef76f8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:41:09.256346 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78512c-ee59-4f88-abf6-e986ef76f8dd None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:41:09.256617 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78512c-ee59-4f88-abf6-e986ef76f8dd None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:41:09.256880 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78512c-ee59-4f88-abf6-e986ef76f8dd None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:41:09.257649 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78512c-ee59-4f88-abf6-e986ef76f8dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:41:09.257943 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78512c-ee59-4f88-abf6-e986ef76f8dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:41:09.259303 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78512c-ee59-4f88-abf6-e986ef76f8dd None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:41:09.267096 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 595/1196] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:41:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:41:09.273264 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a03ae6-191e-414d-8f67-2c09364328e1 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:41:09.367195 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a03ae6-191e-414d-8f67-2c09364328e1 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:41:09.400719 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027060f7-2154-45bd-aaef-af07b9b3ffcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:41:09.401592 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027060f7-2154-45bd-aaef-af07b9b3ffcc None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:41:09.401865 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027060f7-2154-45bd-aaef-af07b9b3ffcc None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:41:09.402138 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027060f7-2154-45bd-aaef-af07b9b3ffcc None admin] PATH_INFO: `/v3/users/17bfebe6b8d54d8aab9e8d3677f193ee` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:41:09.403417 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027060f7-2154-45bd-aaef-af07b9b3ffcc None admin] RBAC: Authorizing `identity:get_user(user_id=17bfebe6b8d54d8aab9e8d3677f193ee)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:41:09.404906 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027060f7-2154-45bd-aaef-af07b9b3ffcc None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:41:09.406504 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 602/1197] 10.222.0.18 () {56 vars in 1177 bytes} [Tue Mar 8 13:41:09 2022] GET /identity/v3/users/17bfebe6b8d54d8aab9e8d3677f193ee => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:41:09.413244 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78512c-ee59-4f88-abf6-e986ef76f8dd None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:41:09.518312 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78512c-ee59-4f88-abf6-e986ef76f8dd None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:41:09.552454 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9a464-5a3d-4bae-8977-6ad0e722d26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:41:09.553090 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9a464-5a3d-4bae-8977-6ad0e722d26a None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:41:09.553395 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9a464-5a3d-4bae-8977-6ad0e722d26a None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:41:09.553669 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9a464-5a3d-4bae-8977-6ad0e722d26a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:41:09.619081 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9a464-5a3d-4bae-8977-6ad0e722d26a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:41:09.620435 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f9a464-5a3d-4bae-8977-6ad0e722d26a None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:41:09.719558 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 596/1198] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:41:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:41:09.726109 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027060f7-2154-45bd-aaef-af07b9b3ffcc None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:41:09.837571 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027060f7-2154-45bd-aaef-af07b9b3ffcc None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:41:09.871637 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f64ba-a522-442f-b927-caaa823f9880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:41:09.872457 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f64ba-a522-442f-b927-caaa823f9880 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:41:09.872729 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f64ba-a522-442f-b927-caaa823f9880 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:41:09.872990 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f64ba-a522-442f-b927-caaa823f9880 None admin] PATH_INFO: `/v3/projects/bd7a894dea834d028bff936c6a23063b` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:41:09.874307 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f64ba-a522-442f-b927-caaa823f9880 None admin] RBAC: Authorizing `identity:get_project(project_id=bd7a894dea834d028bff936c6a23063b)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:41:09.875731 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f64ba-a522-442f-b927-caaa823f9880 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:41:09.877370 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 603/1199] 10.222.0.18 () {56 vars in 1186 bytes} [Tue Mar 8 13:41:09 2022] GET /identity/v3/projects/bd7a894dea834d028bff936c6a23063b => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:41:09.884162 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9a464-5a3d-4bae-8977-6ad0e722d26a None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:41:09.989953 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9a464-5a3d-4bae-8977-6ad0e722d26a None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:41:10.030451 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f3d1b-7413-40d3-a54d-41d8408b6ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:41:10.031087 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f3d1b-7413-40d3-a54d-41d8408b6ba1 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:41:10.031363 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f3d1b-7413-40d3-a54d-41d8408b6ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:41:10.031632 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f3d1b-7413-40d3-a54d-41d8408b6ba1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:41:10.032454 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f3d1b-7413-40d3-a54d-41d8408b6ba1 None admin] RBAC: Adding query filter params (role.id=fc021ed5870a44f5a0f0b8fff994d6f0, scope.project.id=bd7a894dea834d028bff936c6a23063b, user.id=17bfebe6b8d54d8aab9e8d3677f193ee) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:41:10.032757 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f3d1b-7413-40d3-a54d-41d8408b6ba1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:41:10.034193 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f3d1b-7413-40d3-a54d-41d8408b6ba1 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:41:10.040250 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 597/1200] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:41:09 2022] GET /identity/v3/role_assignments?user.id=17bfebe6b8d54d8aab9e8d3677f193ee&scope.project.id=bd7a894dea834d028bff936c6a23063b&role.id=fc021ed5870a44f5a0f0b8fff994d6f0 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:10.929558 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2fa7b-54ba-4c87-896b-9ecb12930bec None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:10.930265 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2fa7b-54ba-4c87-896b-9ecb12930bec None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:10.930265 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2fa7b-54ba-4c87-896b-9ecb12930bec None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:10.931914 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 604/1201] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:42:10.938017 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd139640-9a18-48c3-803c-82fb7da4cd10 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:10.938466 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd139640-9a18-48c3-803c-82fb7da4cd10 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:10.938570 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd139640-9a18-48c3-803c-82fb7da4cd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:10.957823 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-cd139640-9a18-48c3-803c-82fb7da4cd10 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:42:10.959362 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-cd139640-9a18-48c3-803c-82fb7da4cd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:42:11.046653 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 598/1202] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:42:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Mar 08 13:42:11.073711 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2fa7b-54ba-4c87-896b-9ecb12930bec None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:11.190125 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2fa7b-54ba-4c87-896b-9ecb12930bec None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:11.230671 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a6d09-ec1c-4327-a5e9-1d545ad62ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:11.231517 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a6d09-ec1c-4327-a5e9-1d545ad62ac0 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:11.231800 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a6d09-ec1c-4327-a5e9-1d545ad62ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:11.232071 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a6d09-ec1c-4327-a5e9-1d545ad62ac0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:11.243445 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a6d09-ec1c-4327-a5e9-1d545ad62ac0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:11.244968 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a6d09-ec1c-4327-a5e9-1d545ad62ac0 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:11.262750 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-9d3a6d09-ec1c-4327-a5e9-1d545ad62ac0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:42:11.272496 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 605/1203] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:42:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:11.272680 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd139640-9a18-48c3-803c-82fb7da4cd10 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:11.399408 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd139640-9a18-48c3-803c-82fb7da4cd10 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:11.443654 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ef819-3ce6-431e-a9dd-d7b2ba8a58f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:11.444697 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ef819-3ce6-431e-a9dd-d7b2ba8a58f2 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:11.445185 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ef819-3ce6-431e-a9dd-d7b2ba8a58f2 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:11.445705 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ef819-3ce6-431e-a9dd-d7b2ba8a58f2 None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:11.446571 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ef819-3ce6-431e-a9dd-d7b2ba8a58f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:11.447073 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ef819-3ce6-431e-a9dd-d7b2ba8a58f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:11.448732 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ef819-3ce6-431e-a9dd-d7b2ba8a58f2 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:11.464163 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 599/1204] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:42:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:42:11.473246 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a6d09-ec1c-4327-a5e9-1d545ad62ac0 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:11.585346 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a6d09-ec1c-4327-a5e9-1d545ad62ac0 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:11.626082 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26945b17-2839-4899-b523-c79a40a49617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:11.627045 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26945b17-2839-4899-b523-c79a40a49617 None admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:11.627324 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26945b17-2839-4899-b523-c79a40a49617 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:11.627604 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26945b17-2839-4899-b523-c79a40a49617 None admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:11.628348 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26945b17-2839-4899-b523-c79a40a49617 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:11.629834 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26945b17-2839-4899-b523-c79a40a49617 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:11.650559 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 606/1205] 10.222.0.18 () {60 vars in 1132 bytes} [Tue Mar 8 13:42:11 2022] POST /identity/v3/users => generated 251 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:42:14.109136 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87b466-765f-4673-8350-f2170f557e9a None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:14.109763 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87b466-765f-4673-8350-f2170f557e9a None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:14.109763 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87b466-765f-4673-8350-f2170f557e9a None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:14.111463 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 600/1206] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:42:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:42:14.117110 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca7a05-d41a-4bce-8447-e7749d659b47 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:14.117592 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca7a05-d41a-4bce-8447-e7749d659b47 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:14.117693 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ca7a05-d41a-4bce-8447-e7749d659b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:14.135155 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-a8ca7a05-d41a-4bce-8447-e7749d659b47 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:42:14.136455 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-a8ca7a05-d41a-4bce-8447-e7749d659b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:42:14.204198 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 607/1207] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:42:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:42:14.227741 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87b466-765f-4673-8350-f2170f557e9a None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:14.334648 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87b466-765f-4673-8350-f2170f557e9a None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:14.367992 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6aaf50-a208-4d07-aa06-2af07969739e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:14.368717 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6aaf50-a208-4d07-aa06-2af07969739e None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:14.368989 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6aaf50-a208-4d07-aa06-2af07969739e None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:14.369255 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6aaf50-a208-4d07-aa06-2af07969739e None admin] PATH_INFO: `/v3/roles/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:14.380941 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6aaf50-a208-4d07-aa06-2af07969739e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:42:14.387929 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-7c6aaf50-a208-4d07-aa06-2af07969739e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:42:14.389119 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 601/1208] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Mar 8 13:42:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:14.395673 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca7a05-d41a-4bce-8447-e7749d659b47 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:14.494479 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ca7a05-d41a-4bce-8447-e7749d659b47 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:14.537661 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf8330-66ee-4fc4-a2ae-74917cd0990b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:14.538316 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf8330-66ee-4fc4-a2ae-74917cd0990b None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:14.538609 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf8330-66ee-4fc4-a2ae-74917cd0990b None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:14.538873 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf8330-66ee-4fc4-a2ae-74917cd0990b None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:14.539623 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf8330-66ee-4fc4-a2ae-74917cd0990b None admin] RBAC: Adding query filter params (name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:14.539926 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf8330-66ee-4fc4-a2ae-74917cd0990b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:14.541307 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf8330-66ee-4fc4-a2ae-74917cd0990b None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:14.550868 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 608/1209] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Mar 8 13:42:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:14.556686 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6aaf50-a208-4d07-aa06-2af07969739e None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:14.658688 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6aaf50-a208-4d07-aa06-2af07969739e None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:14.693334 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8c795-ee49-40a3-ac3b-78f331e34761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:14.694254 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8c795-ee49-40a3-ac3b-78f331e34761 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:14.694570 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8c795-ee49-40a3-ac3b-78f331e34761 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:14.694864 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8c795-ee49-40a3-ac3b-78f331e34761 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:14.705260 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8c795-ee49-40a3-ac3b-78f331e34761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:14.706797 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8c795-ee49-40a3-ac3b-78f331e34761 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:14.724267 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-38f8c795-ee49-40a3-ac3b-78f331e34761 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:42:14.725710 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 602/1210] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:14.731322 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf8330-66ee-4fc4-a2ae-74917cd0990b None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:14.839138 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf8330-66ee-4fc4-a2ae-74917cd0990b None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:14.877150 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2f0b3-acd1-4427-b2a5-1d7cf9bae532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:14.877150 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2f0b3-acd1-4427-b2a5-1d7cf9bae532 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:14.877150 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2f0b3-acd1-4427-b2a5-1d7cf9bae532 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:14.877150 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2f0b3-acd1-4427-b2a5-1d7cf9bae532 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:14.877902 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2f0b3-acd1-4427-b2a5-1d7cf9bae532 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:14.878212 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2f0b3-acd1-4427-b2a5-1d7cf9bae532 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:14.879586 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2f0b3-acd1-4427-b2a5-1d7cf9bae532 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:14.897513 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 609/1211] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:14.900680 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8c795-ee49-40a3-ac3b-78f331e34761 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:15.008418 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8c795-ee49-40a3-ac3b-78f331e34761 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:15.042603 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d0518-190b-464f-99d0-c5f849b22106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:15.043695 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d0518-190b-464f-99d0-c5f849b22106 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:15.044000 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d0518-190b-464f-99d0-c5f849b22106 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:15.044276 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24d0518-190b-464f-99d0-c5f849b22106 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:15.052484 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d0518-190b-464f-99d0-c5f849b22106 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:15.053957 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24d0518-190b-464f-99d0-c5f849b22106 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:15.068115 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-d24d0518-190b-464f-99d0-c5f849b22106 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 13:42:15.069706 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 603/1212] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:42:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:15.075479 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2f0b3-acd1-4427-b2a5-1d7cf9bae532 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:15.177134 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2f0b3-acd1-4427-b2a5-1d7cf9bae532 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:15.216221 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ab1c5-1d1a-4157-83dd-9095429949f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:15.216896 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ab1c5-1d1a-4157-83dd-9095429949f1 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:15.217172 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ab1c5-1d1a-4157-83dd-9095429949f1 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:15.217509 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ab1c5-1d1a-4157-83dd-9095429949f1 None admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:15.218357 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ab1c5-1d1a-4157-83dd-9095429949f1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:15.218786 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ab1c5-1d1a-4157-83dd-9095429949f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:15.220239 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ab1c5-1d1a-4157-83dd-9095429949f1 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:15.241523 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 610/1213] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Mar 8 13:42:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:15.244292 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d0518-190b-464f-99d0-c5f849b22106 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:15.348351 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24d0518-190b-464f-99d0-c5f849b22106 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:15.385654 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404dcb8-3c4e-4522-9657-ef40361a13ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:15.386328 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404dcb8-3c4e-4522-9657-ef40361a13ce None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:15.386631 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404dcb8-3c4e-4522-9657-ef40361a13ce None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:15.386896 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1404dcb8-3c4e-4522-9657-ef40361a13ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:15.458103 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404dcb8-3c4e-4522-9657-ef40361a13ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:15.459676 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1404dcb8-3c4e-4522-9657-ef40361a13ce None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:15.564827 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 604/1214] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:42:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:42:15.570437 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ab1c5-1d1a-4157-83dd-9095429949f1 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:15.674477 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ab1c5-1d1a-4157-83dd-9095429949f1 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:15.708111 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fec2d4-279f-4eee-b555-bbe03f713825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:15.708901 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fec2d4-279f-4eee-b555-bbe03f713825 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:15.709177 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fec2d4-279f-4eee-b555-bbe03f713825 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:15.709480 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fec2d4-279f-4eee-b555-bbe03f713825 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:15.719861 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fec2d4-279f-4eee-b555-bbe03f713825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:15.721416 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fec2d4-279f-4eee-b555-bbe03f713825 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:15.740572 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-a7fec2d4-279f-4eee-b555-bbe03f713825 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:42:15.741936 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 611/1215] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:42:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:42:15.748278 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404dcb8-3c4e-4522-9657-ef40361a13ce None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:15.849767 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1404dcb8-3c4e-4522-9657-ef40361a13ce None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:15.883158 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcde55f-6c05-4a49-8e69-f45e135918dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:15.883817 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcde55f-6c05-4a49-8e69-f45e135918dd None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:15.884176 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcde55f-6c05-4a49-8e69-f45e135918dd None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:15.884403 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcde55f-6c05-4a49-8e69-f45e135918dd None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:15.885223 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcde55f-6c05-4a49-8e69-f45e135918dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:15.885572 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcde55f-6c05-4a49-8e69-f45e135918dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:15.886943 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcde55f-6c05-4a49-8e69-f45e135918dd None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:15.903576 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 605/1216] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:15.904860 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fec2d4-279f-4eee-b555-bbe03f713825 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:16.004140 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fec2d4-279f-4eee-b555-bbe03f713825 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:16.041637 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f888341-f944-4d4c-b57b-2e8f31d47ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:16.042468 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f888341-f944-4d4c-b57b-2e8f31d47ed6 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:16.042739 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f888341-f944-4d4c-b57b-2e8f31d47ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:16.043015 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f888341-f944-4d4c-b57b-2e8f31d47ed6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:16.050426 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f888341-f944-4d4c-b57b-2e8f31d47ed6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:16.051890 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f888341-f944-4d4c-b57b-2e8f31d47ed6 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:16.065005 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-0f888341-f944-4d4c-b57b-2e8f31d47ed6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:42:16.066400 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 612/1217] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:42:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:16.072308 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcde55f-6c05-4a49-8e69-f45e135918dd None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:16.184884 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcde55f-6c05-4a49-8e69-f45e135918dd None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:16.220620 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fe2aa-6aa7-49a6-b352-e3da93d522ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:16.221312 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fe2aa-6aa7-49a6-b352-e3da93d522ff None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:16.221755 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fe2aa-6aa7-49a6-b352-e3da93d522ff None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:16.221875 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fe2aa-6aa7-49a6-b352-e3da93d522ff None admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:16.222656 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349fe2aa-6aa7-49a6-b352-e3da93d522ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:16.222959 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349fe2aa-6aa7-49a6-b352-e3da93d522ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:16.224374 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349fe2aa-6aa7-49a6-b352-e3da93d522ff None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:16.236918 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 606/1218] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:42:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:42:16.242773 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f888341-f944-4d4c-b57b-2e8f31d47ed6 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:16.349507 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f888341-f944-4d4c-b57b-2e8f31d47ed6 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:16.386454 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9edf9dd-28c0-43a0-ba49-04a320a1b713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:16.387117 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edf9dd-28c0-43a0-ba49-04a320a1b713 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:16.387396 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edf9dd-28c0-43a0-ba49-04a320a1b713 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:16.387662 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9edf9dd-28c0-43a0-ba49-04a320a1b713 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:16.388493 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edf9dd-28c0-43a0-ba49-04a320a1b713 None admin] RBAC: Adding query filter params (role.id=5189c0e028ff42908ca943fdb5ce1873, scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e, user.id=6e2e8458589b45fa8c91b0d95840e45e) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:16.388804 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edf9dd-28c0-43a0-ba49-04a320a1b713 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:16.390296 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9edf9dd-28c0-43a0-ba49-04a320a1b713 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:16.396558 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 613/1219] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:42:16 2022] GET /identity/v3/role_assignments?user.id=6e2e8458589b45fa8c91b0d95840e45e&scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e&role.id=5189c0e028ff42908ca943fdb5ce1873 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:42:18.694289 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ab480-334c-4304-8a55-35b00f2c379a None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:18.694937 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ab480-334c-4304-8a55-35b00f2c379a None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:18.694937 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ab480-334c-4304-8a55-35b00f2c379a None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:18.696875 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 607/1220] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:42:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:42:18.702903 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd0b24-0fa5-484c-8be7-5ca59cbf1915 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:18.703399 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd0b24-0fa5-484c-8be7-5ca59cbf1915 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:18.703611 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd0b24-0fa5-484c-8be7-5ca59cbf1915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:18.723490 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-c1fd0b24-0fa5-484c-8be7-5ca59cbf1915 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:42:18.725208 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-c1fd0b24-0fa5-484c-8be7-5ca59cbf1915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:42:18.805927 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 614/1221] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:42:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:42:18.828858 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ab480-334c-4304-8a55-35b00f2c379a None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:18.938820 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ab480-334c-4304-8a55-35b00f2c379a None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:18.973625 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce819758-48a9-423c-b06e-e1e7383bb23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:18.974419 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce819758-48a9-423c-b06e-e1e7383bb23f None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:18.974696 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce819758-48a9-423c-b06e-e1e7383bb23f None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:18.974964 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce819758-48a9-423c-b06e-e1e7383bb23f None admin] PATH_INFO: `/v3/roles/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:18.985803 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce819758-48a9-423c-b06e-e1e7383bb23f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:42:18.994029 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-ce819758-48a9-423c-b06e-e1e7383bb23f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:42:18.995544 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 608/1222] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Mar 8 13:42:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:19.003121 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd0b24-0fa5-484c-8be7-5ca59cbf1915 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:19.101473 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd0b24-0fa5-484c-8be7-5ca59cbf1915 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:19.136562 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32a5d8-804b-4072-913d-a23644878965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:19.137252 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32a5d8-804b-4072-913d-a23644878965 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:19.137545 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32a5d8-804b-4072-913d-a23644878965 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:19.137817 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32a5d8-804b-4072-913d-a23644878965 None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:19.138556 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32a5d8-804b-4072-913d-a23644878965 None admin] RBAC: Adding query filter params (name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:19.138932 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32a5d8-804b-4072-913d-a23644878965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:19.140419 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32a5d8-804b-4072-913d-a23644878965 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:19.149077 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 615/1223] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Mar 8 13:42:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:19.154902 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce819758-48a9-423c-b06e-e1e7383bb23f None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:19.259843 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce819758-48a9-423c-b06e-e1e7383bb23f None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:19.294652 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120016e4-e624-47db-b3e5-d26bbb7e2325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:19.295533 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120016e4-e624-47db-b3e5-d26bbb7e2325 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:19.295814 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120016e4-e624-47db-b3e5-d26bbb7e2325 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:19.296086 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120016e4-e624-47db-b3e5-d26bbb7e2325 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:19.306518 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120016e4-e624-47db-b3e5-d26bbb7e2325 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:19.307973 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120016e4-e624-47db-b3e5-d26bbb7e2325 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:19.323895 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-120016e4-e624-47db-b3e5-d26bbb7e2325 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:42:19.325078 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 609/1224] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:19.331221 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32a5d8-804b-4072-913d-a23644878965 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:19.430840 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32a5d8-804b-4072-913d-a23644878965 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:19.464716 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7080b54-268c-489c-91f8-bf93e51def76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:19.465571 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7080b54-268c-489c-91f8-bf93e51def76 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:19.465730 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7080b54-268c-489c-91f8-bf93e51def76 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:19.466025 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7080b54-268c-489c-91f8-bf93e51def76 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:19.466723 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7080b54-268c-489c-91f8-bf93e51def76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:19.467028 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7080b54-268c-489c-91f8-bf93e51def76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:19.468418 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7080b54-268c-489c-91f8-bf93e51def76 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:19.480257 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 616/1225] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:19.486356 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120016e4-e624-47db-b3e5-d26bbb7e2325 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:19.590036 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120016e4-e624-47db-b3e5-d26bbb7e2325 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:19.626915 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9977748-a321-46bb-80e8-b8156cf919fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:19.627801 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9977748-a321-46bb-80e8-b8156cf919fd None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:19.628117 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9977748-a321-46bb-80e8-b8156cf919fd None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:19.628357 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9977748-a321-46bb-80e8-b8156cf919fd None admin] PATH_INFO: `/v3/users/placement` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:19.638011 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9977748-a321-46bb-80e8-b8156cf919fd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:19.639426 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9977748-a321-46bb-80e8-b8156cf919fd None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:19.654737 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-f9977748-a321-46bb-80e8-b8156cf919fd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 13:42:19.655950 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 610/1226] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:42:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:19.662186 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7080b54-268c-489c-91f8-bf93e51def76 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:19.771436 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7080b54-268c-489c-91f8-bf93e51def76 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:19.806462 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b93847-1c71-4cc8-978e-fc352528d285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:19.807266 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b93847-1c71-4cc8-978e-fc352528d285 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:19.807551 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b93847-1c71-4cc8-978e-fc352528d285 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:19.807983 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b93847-1c71-4cc8-978e-fc352528d285 None admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:19.809084 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b93847-1c71-4cc8-978e-fc352528d285 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:19.809467 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b93847-1c71-4cc8-978e-fc352528d285 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:19.811299 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b93847-1c71-4cc8-978e-fc352528d285 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:19.830530 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 617/1227] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Mar 8 13:42:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:42:19.836308 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9977748-a321-46bb-80e8-b8156cf919fd None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:19.935700 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9977748-a321-46bb-80e8-b8156cf919fd None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:19.972920 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3eafb2-2f19-4b4f-9846-fe30ac78ea48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:19.973767 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eafb2-2f19-4b4f-9846-fe30ac78ea48 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:19.974073 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eafb2-2f19-4b4f-9846-fe30ac78ea48 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:19.974319 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eafb2-2f19-4b4f-9846-fe30ac78ea48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:19.985687 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3eafb2-2f19-4b4f-9846-fe30ac78ea48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:19.987125 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3eafb2-2f19-4b4f-9846-fe30ac78ea48 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:20.004049 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-aa3eafb2-2f19-4b4f-9846-fe30ac78ea48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:42:20.005217 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 611/1228] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:20.011815 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b93847-1c71-4cc8-978e-fc352528d285 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:20.116294 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b93847-1c71-4cc8-978e-fc352528d285 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:20.150110 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e49e5-4e0d-4050-98f7-c8945e1bfc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:20.150768 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e49e5-4e0d-4050-98f7-c8945e1bfc0b None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:20.151046 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e49e5-4e0d-4050-98f7-c8945e1bfc0b None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:20.151319 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e49e5-4e0d-4050-98f7-c8945e1bfc0b None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:20.152076 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e49e5-4e0d-4050-98f7-c8945e1bfc0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:20.152348 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e49e5-4e0d-4050-98f7-c8945e1bfc0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:20.153940 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e49e5-4e0d-4050-98f7-c8945e1bfc0b None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:20.166664 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 618/1229] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:20.172820 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3eafb2-2f19-4b4f-9846-fe30ac78ea48 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:20.281571 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3eafb2-2f19-4b4f-9846-fe30ac78ea48 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:20.314050 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9dd82d-22dc-43e2-bd1a-e56fb60b5cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:20.314848 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9dd82d-22dc-43e2-bd1a-e56fb60b5cc4 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:20.315126 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9dd82d-22dc-43e2-bd1a-e56fb60b5cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:20.315393 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9dd82d-22dc-43e2-bd1a-e56fb60b5cc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:20.322144 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9dd82d-22dc-43e2-bd1a-e56fb60b5cc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:20.323577 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9dd82d-22dc-43e2-bd1a-e56fb60b5cc4 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:20.336968 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-cc9dd82d-22dc-43e2-bd1a-e56fb60b5cc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:42:20.338182 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 612/1230] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:42:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:20.344453 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e49e5-4e0d-4050-98f7-c8945e1bfc0b None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:20.446455 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e49e5-4e0d-4050-98f7-c8945e1bfc0b None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:20.480107 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180518d-e71b-4d66-85d7-fdc37def8ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:20.480821 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180518d-e71b-4d66-85d7-fdc37def8ce7 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:20.481148 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180518d-e71b-4d66-85d7-fdc37def8ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:20.481506 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180518d-e71b-4d66-85d7-fdc37def8ce7 None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:20.482291 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180518d-e71b-4d66-85d7-fdc37def8ce7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:20.482673 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180518d-e71b-4d66-85d7-fdc37def8ce7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:20.484157 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180518d-e71b-4d66-85d7-fdc37def8ce7 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:20.496554 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 619/1231] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:42:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:20.502892 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9dd82d-22dc-43e2-bd1a-e56fb60b5cc4 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:20.606736 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9dd82d-22dc-43e2-bd1a-e56fb60b5cc4 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:20.643235 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208529a4-2fb5-46d2-82a9-e65990bf0b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:20.644490 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208529a4-2fb5-46d2-82a9-e65990bf0b8d None admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:20.644733 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208529a4-2fb5-46d2-82a9-e65990bf0b8d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:20.645002 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208529a4-2fb5-46d2-82a9-e65990bf0b8d None admin] PATH_INFO: `/v3/projects/7d693fb3e9fc4d82a0ed054f31f1e56e/users/6e2e8458589b45fa8c91b0d95840e45e/roles/5189c0e028ff42908ca943fdb5ce1873` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:20.660151 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208529a4-2fb5-46d2-82a9-e65990bf0b8d None admin] RBAC: Authorizing `identity:create_grant(project_id=7d693fb3e9fc4d82a0ed054f31f1e56e, user_id=6e2e8458589b45fa8c91b0d95840e45e, role_id=5189c0e028ff42908ca943fdb5ce1873)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:20.661781 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208529a4-2fb5-46d2-82a9-e65990bf0b8d None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:20.676631 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 613/1232] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Mar 8 13:42:20 2022] PUT /identity/v3/projects/7d693fb3e9fc4d82a0ed054f31f1e56e/users/6e2e8458589b45fa8c91b0d95840e45e/roles/5189c0e028ff42908ca943fdb5ce1873 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:42:23.014572 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96df293-cde2-49dc-aa72-bd547fbc9980 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:23.015183 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96df293-cde2-49dc-aa72-bd547fbc9980 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:23.015183 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96df293-cde2-49dc-aa72-bd547fbc9980 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:23.016880 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 620/1233] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:42:23.023233 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1dbbe-6630-4ade-b0ea-365e62019df4 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:23.023688 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1dbbe-6630-4ade-b0ea-365e62019df4 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:23.023788 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1dbbe-6630-4ade-b0ea-365e62019df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:23.042342 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-ffe1dbbe-6630-4ade-b0ea-365e62019df4 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:42:23.043818 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-ffe1dbbe-6630-4ade-b0ea-365e62019df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:42:23.117971 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 614/1234] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:42:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:42:23.141202 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96df293-cde2-49dc-aa72-bd547fbc9980 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:23.242150 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96df293-cde2-49dc-aa72-bd547fbc9980 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:23.278551 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fc237-c406-4b48-9cfa-6fab7341ddec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:23.279269 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fc237-c406-4b48-9cfa-6fab7341ddec None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:23.279647 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fc237-c406-4b48-9cfa-6fab7341ddec None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:23.280001 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fc237-c406-4b48-9cfa-6fab7341ddec None admin] PATH_INFO: `/v3/roles/service` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:23.290280 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fc237-c406-4b48-9cfa-6fab7341ddec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:42:23.297459 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-435fc237-c406-4b48-9cfa-6fab7341ddec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Mar 08 13:42:23.298689 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 621/1235] 10.222.0.18 () {56 vars in 1102 bytes} [Tue Mar 8 13:42:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:23.305412 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1dbbe-6630-4ade-b0ea-365e62019df4 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:23.407912 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1dbbe-6630-4ade-b0ea-365e62019df4 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:23.446207 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98400bf6-b2d6-4ec0-ab3b-0c43d3c89864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:23.447067 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98400bf6-b2d6-4ec0-ab3b-0c43d3c89864 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:23.447405 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98400bf6-b2d6-4ec0-ab3b-0c43d3c89864 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:23.447825 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98400bf6-b2d6-4ec0-ab3b-0c43d3c89864 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:23.448819 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98400bf6-b2d6-4ec0-ab3b-0c43d3c89864 None admin] RBAC: Adding query filter params (name=service) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:23.449264 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98400bf6-b2d6-4ec0-ab3b-0c43d3c89864 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:23.450832 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98400bf6-b2d6-4ec0-ab3b-0c43d3c89864 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:23.459590 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 615/1236] 10.222.0.18 () {56 vars in 1103 bytes} [Tue Mar 8 13:42:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:42:23.465812 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fc237-c406-4b48-9cfa-6fab7341ddec None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:23.569156 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fc237-c406-4b48-9cfa-6fab7341ddec None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:23.603518 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e24671-605d-4b21-9dcb-b9d805611d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:23.604348 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e24671-605d-4b21-9dcb-b9d805611d6f None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:23.604654 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e24671-605d-4b21-9dcb-b9d805611d6f None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:23.605022 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e24671-605d-4b21-9dcb-b9d805611d6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:23.616336 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e24671-605d-4b21-9dcb-b9d805611d6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:23.618013 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e24671-605d-4b21-9dcb-b9d805611d6f None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:23.635000 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-b6e24671-605d-4b21-9dcb-b9d805611d6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:42:23.636262 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 622/1237] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:23.642467 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98400bf6-b2d6-4ec0-ab3b-0c43d3c89864 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:23.754406 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98400bf6-b2d6-4ec0-ab3b-0c43d3c89864 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:23.789781 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e590213-11fb-4d69-a309-e21f9078e1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:23.790673 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e590213-11fb-4d69-a309-e21f9078e1c4 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:23.791042 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e590213-11fb-4d69-a309-e21f9078e1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:23.791310 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e590213-11fb-4d69-a309-e21f9078e1c4 None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:23.792206 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e590213-11fb-4d69-a309-e21f9078e1c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:23.792536 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e590213-11fb-4d69-a309-e21f9078e1c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:23.794344 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e590213-11fb-4d69-a309-e21f9078e1c4 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:23.807802 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 616/1238] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:23.813381 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e24671-605d-4b21-9dcb-b9d805611d6f None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:23.923934 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e24671-605d-4b21-9dcb-b9d805611d6f None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:23.961317 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eaec7e-c9cc-4534-a508-529109b56ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:23.962394 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eaec7e-c9cc-4534-a508-529109b56ab0 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:23.962709 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eaec7e-c9cc-4534-a508-529109b56ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:23.963054 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eaec7e-c9cc-4534-a508-529109b56ab0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:23.971944 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eaec7e-c9cc-4534-a508-529109b56ab0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:23.973690 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eaec7e-c9cc-4534-a508-529109b56ab0 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:23.987181 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-03eaec7e-c9cc-4534-a508-529109b56ab0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 13:42:23.988363 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 623/1239] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:42:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:23.994535 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e590213-11fb-4d69-a309-e21f9078e1c4 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:24.098995 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e590213-11fb-4d69-a309-e21f9078e1c4 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:24.136181 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5790c09-6fc0-4b64-aba6-86cd12daa0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:24.137116 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5790c09-6fc0-4b64-aba6-86cd12daa0bd None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:24.137590 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5790c09-6fc0-4b64-aba6-86cd12daa0bd None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:24.138110 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5790c09-6fc0-4b64-aba6-86cd12daa0bd None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:24.139154 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5790c09-6fc0-4b64-aba6-86cd12daa0bd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:24.139471 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5790c09-6fc0-4b64-aba6-86cd12daa0bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:24.141037 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5790c09-6fc0-4b64-aba6-86cd12daa0bd None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:24.160725 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 617/1240] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Mar 8 13:42:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:24.166594 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eaec7e-c9cc-4534-a508-529109b56ab0 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:24.277385 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eaec7e-c9cc-4534-a508-529109b56ab0 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:24.313002 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f02046-777d-4a0a-aaed-bb52ebd01623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:24.313685 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f02046-777d-4a0a-aaed-bb52ebd01623 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:24.313965 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f02046-777d-4a0a-aaed-bb52ebd01623 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:24.314284 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f02046-777d-4a0a-aaed-bb52ebd01623 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:24.388133 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f02046-777d-4a0a-aaed-bb52ebd01623 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:24.389635 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f02046-777d-4a0a-aaed-bb52ebd01623 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:24.490513 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 624/1241] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:42:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:42:24.496369 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5790c09-6fc0-4b64-aba6-86cd12daa0bd None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:24.601455 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5790c09-6fc0-4b64-aba6-86cd12daa0bd None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:24.635362 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa32ac9-f48e-42e0-a03e-e3d2341ddaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:24.636161 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa32ac9-f48e-42e0-a03e-e3d2341ddaac None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:24.636451 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa32ac9-f48e-42e0-a03e-e3d2341ddaac None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:24.636716 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa32ac9-f48e-42e0-a03e-e3d2341ddaac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:24.646884 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa32ac9-f48e-42e0-a03e-e3d2341ddaac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:24.648319 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa32ac9-f48e-42e0-a03e-e3d2341ddaac None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:24.664775 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-2aa32ac9-f48e-42e0-a03e-e3d2341ddaac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:42:24.666028 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 618/1242] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:24.672016 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f02046-777d-4a0a-aaed-bb52ebd01623 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:24.777898 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f02046-777d-4a0a-aaed-bb52ebd01623 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:24.814203 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34a512-e008-4acb-a284-786501665a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:24.814859 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34a512-e008-4acb-a284-786501665a39 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:24.815140 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34a512-e008-4acb-a284-786501665a39 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:24.815409 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34a512-e008-4acb-a284-786501665a39 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:24.816131 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34a512-e008-4acb-a284-786501665a39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:24.816435 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34a512-e008-4acb-a284-786501665a39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:24.817838 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34a512-e008-4acb-a284-786501665a39 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:24.829072 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 625/1243] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:42:24.834980 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa32ac9-f48e-42e0-a03e-e3d2341ddaac None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:24.939346 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa32ac9-f48e-42e0-a03e-e3d2341ddaac None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:24.981475 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e6443-aa62-43e4-b250-098300486e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:24.982308 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e6443-aa62-43e4-b250-098300486e3b None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:24.982628 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e6443-aa62-43e4-b250-098300486e3b None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:24.982898 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4e6443-aa62-43e4-b250-098300486e3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:24.989759 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e6443-aa62-43e4-b250-098300486e3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:24.991189 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4e6443-aa62-43e4-b250-098300486e3b None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:25.006176 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-0d4e6443-aa62-43e4-b250-098300486e3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:42:25.012212 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 619/1244] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:42:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:25.013530 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34a512-e008-4acb-a284-786501665a39 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:25.116238 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34a512-e008-4acb-a284-786501665a39 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:25.155307 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31016c-5b41-4c07-a6b0-517c35207d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:25.156245 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31016c-5b41-4c07-a6b0-517c35207d15 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:25.156636 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31016c-5b41-4c07-a6b0-517c35207d15 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:25.157072 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31016c-5b41-4c07-a6b0-517c35207d15 None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:25.158318 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31016c-5b41-4c07-a6b0-517c35207d15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:25.158590 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31016c-5b41-4c07-a6b0-517c35207d15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:25.160406 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31016c-5b41-4c07-a6b0-517c35207d15 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:25.175801 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 626/1245] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:42:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:25.181849 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e6443-aa62-43e4-b250-098300486e3b None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:25.294230 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4e6443-aa62-43e4-b250-098300486e3b None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:25.331416 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae145a-d546-46ee-9563-0cb9ed4f1f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:25.332266 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae145a-d546-46ee-9563-0cb9ed4f1f50 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:25.332537 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae145a-d546-46ee-9563-0cb9ed4f1f50 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:25.333018 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae145a-d546-46ee-9563-0cb9ed4f1f50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:25.334369 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae145a-d546-46ee-9563-0cb9ed4f1f50 None admin] RBAC: Adding query filter params (role.id=5189c0e028ff42908ca943fdb5ce1873, scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e, user.id=6e2e8458589b45fa8c91b0d95840e45e) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:25.334851 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae145a-d546-46ee-9563-0cb9ed4f1f50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:25.336987 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae145a-d546-46ee-9563-0cb9ed4f1f50 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:25.344260 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 620/1246] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:42:25 2022] GET /identity/v3/role_assignments?user.id=6e2e8458589b45fa8c91b0d95840e45e&scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e&role.id=5189c0e028ff42908ca943fdb5ce1873 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:27.790859 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694d768-5982-4cc3-84cf-de0e481f627f None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:27.791442 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694d768-5982-4cc3-84cf-de0e481f627f None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:27.791442 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694d768-5982-4cc3-84cf-de0e481f627f None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:27.793117 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 627/1247] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:42:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:42:27.799346 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab0ffe-37a7-45f3-98e1-3de7810cc3df None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:27.799800 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab0ffe-37a7-45f3-98e1-3de7810cc3df None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:27.799992 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab0ffe-37a7-45f3-98e1-3de7810cc3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:27.818907 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-69ab0ffe-37a7-45f3-98e1-3de7810cc3df None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:42:27.820342 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-69ab0ffe-37a7-45f3-98e1-3de7810cc3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:42:27.899024 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 621/1248] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:42:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:42:27.922964 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694d768-5982-4cc3-84cf-de0e481f627f None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:28.033106 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694d768-5982-4cc3-84cf-de0e481f627f None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:28.066931 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bad74-5708-4d08-abc7-5a5de61277fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:28.067572 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bad74-5708-4d08-abc7-5a5de61277fa None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:28.067859 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bad74-5708-4d08-abc7-5a5de61277fa None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:28.068128 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bad74-5708-4d08-abc7-5a5de61277fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:28.079329 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bad74-5708-4d08-abc7-5a5de61277fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:42:28.087038 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-a35bad74-5708-4d08-abc7-5a5de61277fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:42:28.088548 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 628/1249] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:42:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:28.095448 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab0ffe-37a7-45f3-98e1-3de7810cc3df None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:28.206291 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab0ffe-37a7-45f3-98e1-3de7810cc3df None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:28.241139 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f211132-c40a-4fd8-aa06-7459a4980ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:28.241991 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f211132-c40a-4fd8-aa06-7459a4980ff6 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:28.242362 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f211132-c40a-4fd8-aa06-7459a4980ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:28.242643 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f211132-c40a-4fd8-aa06-7459a4980ff6 None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:28.243627 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f211132-c40a-4fd8-aa06-7459a4980ff6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:28.243928 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f211132-c40a-4fd8-aa06-7459a4980ff6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:28.245483 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f211132-c40a-4fd8-aa06-7459a4980ff6 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:28.254397 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 622/1250] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:42:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:42:28.260439 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bad74-5708-4d08-abc7-5a5de61277fa None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:28.365372 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bad74-5708-4d08-abc7-5a5de61277fa None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:28.403088 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c9bf6-f64a-48c9-bd1e-db3953809276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:28.404028 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c9bf6-f64a-48c9-bd1e-db3953809276 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:28.404345 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c9bf6-f64a-48c9-bd1e-db3953809276 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:28.404619 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c9bf6-f64a-48c9-bd1e-db3953809276 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:28.416726 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c9bf6-f64a-48c9-bd1e-db3953809276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:28.418479 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3c9bf6-f64a-48c9-bd1e-db3953809276 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:28.434872 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-aa3c9bf6-f64a-48c9-bd1e-db3953809276 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:42:28.436096 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 629/1251] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:42:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:28.441878 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f211132-c40a-4fd8-aa06-7459a4980ff6 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:28.542474 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f211132-c40a-4fd8-aa06-7459a4980ff6 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:28.575936 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b1a5a-648a-4336-8db3-c361e636f878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:28.576596 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b1a5a-648a-4336-8db3-c361e636f878 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:28.576876 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b1a5a-648a-4336-8db3-c361e636f878 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:28.577149 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b1a5a-648a-4336-8db3-c361e636f878 None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:28.577910 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b1a5a-648a-4336-8db3-c361e636f878 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:28.578215 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b1a5a-648a-4336-8db3-c361e636f878 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:28.579571 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b1a5a-648a-4336-8db3-c361e636f878 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:28.592831 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 623/1252] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:28.598457 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c9bf6-f64a-48c9-bd1e-db3953809276 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:28.701449 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c9bf6-f64a-48c9-bd1e-db3953809276 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:28.739076 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a5abb-beac-4af1-88b7-bf1fee0d3383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:28.739988 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a5abb-beac-4af1-88b7-bf1fee0d3383 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:28.740268 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a5abb-beac-4af1-88b7-bf1fee0d3383 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:28.740611 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9a5abb-beac-4af1-88b7-bf1fee0d3383 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:28.749966 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a5abb-beac-4af1-88b7-bf1fee0d3383 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:28.751745 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9a5abb-beac-4af1-88b7-bf1fee0d3383 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:28.769096 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-ad9a5abb-beac-4af1-88b7-bf1fee0d3383 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 13:42:28.775212 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 630/1253] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:42:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:28.776871 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b1a5a-648a-4336-8db3-c361e636f878 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:28.886283 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b1a5a-648a-4336-8db3-c361e636f878 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:28.924272 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b920cbe-67ed-457c-bfee-61ecc46ee5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:28.925307 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b920cbe-67ed-457c-bfee-61ecc46ee5b6 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:28.925793 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b920cbe-67ed-457c-bfee-61ecc46ee5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:28.926161 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b920cbe-67ed-457c-bfee-61ecc46ee5b6 None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:28.927129 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b920cbe-67ed-457c-bfee-61ecc46ee5b6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:28.927435 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b920cbe-67ed-457c-bfee-61ecc46ee5b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:28.928969 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b920cbe-67ed-457c-bfee-61ecc46ee5b6 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:28.946692 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 624/1254] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Mar 8 13:42:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:28.952827 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a5abb-beac-4af1-88b7-bf1fee0d3383 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:29.055578 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9a5abb-beac-4af1-88b7-bf1fee0d3383 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:29.091826 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d945295-f589-474f-8cd0-da4522450a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:29.092551 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d945295-f589-474f-8cd0-da4522450a8f None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:29.092875 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d945295-f589-474f-8cd0-da4522450a8f None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:29.093154 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d945295-f589-474f-8cd0-da4522450a8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:29.163905 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d945295-f589-474f-8cd0-da4522450a8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:29.165391 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d945295-f589-474f-8cd0-da4522450a8f None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:29.271249 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 631/1255] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:42:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:42:29.277192 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b920cbe-67ed-457c-bfee-61ecc46ee5b6 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:29.383571 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b920cbe-67ed-457c-bfee-61ecc46ee5b6 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:29.419987 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9534d53-9bb7-4bfc-8e91-f1548ccf9670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:29.420791 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9534d53-9bb7-4bfc-8e91-f1548ccf9670 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:29.421062 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9534d53-9bb7-4bfc-8e91-f1548ccf9670 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:29.421546 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9534d53-9bb7-4bfc-8e91-f1548ccf9670 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:29.432337 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9534d53-9bb7-4bfc-8e91-f1548ccf9670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:29.433831 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9534d53-9bb7-4bfc-8e91-f1548ccf9670 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:29.451318 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-b9534d53-9bb7-4bfc-8e91-f1548ccf9670 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:42:29.452564 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 625/1256] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:29.458577 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d945295-f589-474f-8cd0-da4522450a8f None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:29.559148 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d945295-f589-474f-8cd0-da4522450a8f None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:29.593071 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf497ff-256e-49df-9b84-a0df628014b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:29.593778 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf497ff-256e-49df-9b84-a0df628014b6 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:29.594056 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf497ff-256e-49df-9b84-a0df628014b6 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:29.594326 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf497ff-256e-49df-9b84-a0df628014b6 None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:29.595042 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf497ff-256e-49df-9b84-a0df628014b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:29.595342 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf497ff-256e-49df-9b84-a0df628014b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:29.596706 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf497ff-256e-49df-9b84-a0df628014b6 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:29.607615 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 632/1257] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:29.613263 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9534d53-9bb7-4bfc-8e91-f1548ccf9670 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:29.708046 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9534d53-9bb7-4bfc-8e91-f1548ccf9670 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:29.745146 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a856aa-7c2d-4878-9c63-269ac807fee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:29.746305 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a856aa-7c2d-4878-9c63-269ac807fee4 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:29.746606 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a856aa-7c2d-4878-9c63-269ac807fee4 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:29.746973 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a856aa-7c2d-4878-9c63-269ac807fee4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:29.756059 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a856aa-7c2d-4878-9c63-269ac807fee4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:29.757988 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a856aa-7c2d-4878-9c63-269ac807fee4 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:29.773763 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-71a856aa-7c2d-4878-9c63-269ac807fee4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:42:29.775112 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 626/1258] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:42:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:29.781874 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf497ff-256e-49df-9b84-a0df628014b6 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:29.877957 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf497ff-256e-49df-9b84-a0df628014b6 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:29.912517 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b810685-076a-4521-b8df-38d2bde7bda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:29.913503 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b810685-076a-4521-b8df-38d2bde7bda2 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:29.913880 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b810685-076a-4521-b8df-38d2bde7bda2 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:29.914225 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b810685-076a-4521-b8df-38d2bde7bda2 None admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:29.915413 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b810685-076a-4521-b8df-38d2bde7bda2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:29.915841 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b810685-076a-4521-b8df-38d2bde7bda2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:29.918124 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b810685-076a-4521-b8df-38d2bde7bda2 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:29.931048 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 633/1259] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:42:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:29.937635 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a856aa-7c2d-4878-9c63-269ac807fee4 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:30.047336 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a856aa-7c2d-4878-9c63-269ac807fee4 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:30.082748 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3d05d-f75b-4569-9c70-51d9ba50ee8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:30.083691 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3d05d-f75b-4569-9c70-51d9ba50ee8a None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:30.084279 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3d05d-f75b-4569-9c70-51d9ba50ee8a None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:30.084674 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3d05d-f75b-4569-9c70-51d9ba50ee8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:30.086048 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3d05d-f75b-4569-9c70-51d9ba50ee8a None admin] RBAC: Adding query filter params (role.id=fc021ed5870a44f5a0f0b8fff994d6f0, scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e, user.id=6e2e8458589b45fa8c91b0d95840e45e) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:30.086498 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3d05d-f75b-4569-9c70-51d9ba50ee8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:30.088741 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3d05d-f75b-4569-9c70-51d9ba50ee8a None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:30.097679 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 627/1260] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:42:29 2022] GET /identity/v3/role_assignments?user.id=6e2e8458589b45fa8c91b0d95840e45e&scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e&role.id=fc021ed5870a44f5a0f0b8fff994d6f0 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:32.346711 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9800f-8e7e-4add-a677-895d2502367f None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:32.347269 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9800f-8e7e-4add-a677-895d2502367f None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:32.347269 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9800f-8e7e-4add-a677-895d2502367f None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:32.349346 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 634/1261] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:42:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:42:32.356581 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b290b-7ca8-43ff-b264-e0588683c3e6 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:32.357029 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b290b-7ca8-43ff-b264-e0588683c3e6 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:32.357251 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b290b-7ca8-43ff-b264-e0588683c3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:32.375926 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-5c6b290b-7ca8-43ff-b264-e0588683c3e6 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:42:32.377097 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-5c6b290b-7ca8-43ff-b264-e0588683c3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:42:32.446170 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 628/1262] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:42:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:42:32.468377 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9800f-8e7e-4add-a677-895d2502367f None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:32.579406 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9800f-8e7e-4add-a677-895d2502367f None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:32.615596 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d85140-ce18-40cf-b087-0c46f7c60a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:32.616310 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d85140-ce18-40cf-b087-0c46f7c60a65 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:32.616584 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d85140-ce18-40cf-b087-0c46f7c60a65 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:32.616853 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d85140-ce18-40cf-b087-0c46f7c60a65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:32.627965 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d85140-ce18-40cf-b087-0c46f7c60a65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:42:32.634774 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-53d85140-ce18-40cf-b087-0c46f7c60a65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:42:32.635918 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 635/1263] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:42:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:32.645082 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b290b-7ca8-43ff-b264-e0588683c3e6 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:32.754335 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b290b-7ca8-43ff-b264-e0588683c3e6 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:32.800017 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac270c-9456-40ec-b2ea-e151027d568d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:32.800761 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac270c-9456-40ec-b2ea-e151027d568d None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:32.801077 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac270c-9456-40ec-b2ea-e151027d568d None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:32.801384 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac270c-9456-40ec-b2ea-e151027d568d None admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:32.802304 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac270c-9456-40ec-b2ea-e151027d568d None admin] RBAC: Adding query filter params (name=admin) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:32.802645 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac270c-9456-40ec-b2ea-e151027d568d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:32.804228 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac270c-9456-40ec-b2ea-e151027d568d None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:32.812565 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 629/1264] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:42:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:32.818714 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d85140-ce18-40cf-b087-0c46f7c60a65 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:32.922815 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d85140-ce18-40cf-b087-0c46f7c60a65 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:32.956925 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3681af-b714-4315-bbe7-020160a5f11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:32.957741 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3681af-b714-4315-bbe7-020160a5f11e None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:32.958017 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3681af-b714-4315-bbe7-020160a5f11e None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:32.958292 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3681af-b714-4315-bbe7-020160a5f11e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:32.968815 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3681af-b714-4315-bbe7-020160a5f11e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:32.970304 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3681af-b714-4315-bbe7-020160a5f11e None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:32.986423 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-2b3681af-b714-4315-bbe7-020160a5f11e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:42:32.987575 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 636/1265] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:42:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:32.994238 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac270c-9456-40ec-b2ea-e151027d568d None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:33.119012 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac270c-9456-40ec-b2ea-e151027d568d None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:33.152732 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546d6dd-24e8-49f5-b992-e0d46a01508a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:33.153397 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546d6dd-24e8-49f5-b992-e0d46a01508a None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:33.153675 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546d6dd-24e8-49f5-b992-e0d46a01508a None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:33.153950 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546d6dd-24e8-49f5-b992-e0d46a01508a None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:33.154660 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546d6dd-24e8-49f5-b992-e0d46a01508a None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:33.154958 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546d6dd-24e8-49f5-b992-e0d46a01508a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:33.156311 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3546d6dd-24e8-49f5-b992-e0d46a01508a None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:33.167754 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 630/1266] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:33.174041 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3681af-b714-4315-bbe7-020160a5f11e None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:33.278670 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3681af-b714-4315-bbe7-020160a5f11e None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:33.311306 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a03b9-92e4-4c4f-8809-c71a0618c53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:33.312078 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a03b9-92e4-4c4f-8809-c71a0618c53a None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:33.312351 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a03b9-92e4-4c4f-8809-c71a0618c53a None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:33.312619 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2a03b9-92e4-4c4f-8809-c71a0618c53a None admin] PATH_INFO: `/v3/users/placement` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:33.319969 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a03b9-92e4-4c4f-8809-c71a0618c53a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:33.321398 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2a03b9-92e4-4c4f-8809-c71a0618c53a None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:33.334681 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-ec2a03b9-92e4-4c4f-8809-c71a0618c53a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 13:42:33.335863 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 637/1267] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:42:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:33.344215 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546d6dd-24e8-49f5-b992-e0d46a01508a None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:33.451192 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3546d6dd-24e8-49f5-b992-e0d46a01508a None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:33.485431 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d435aa7-f2e1-4d18-b931-d4c481a7d0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:33.486115 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d435aa7-f2e1-4d18-b931-d4c481a7d0a6 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:33.486388 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d435aa7-f2e1-4d18-b931-d4c481a7d0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:33.486659 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d435aa7-f2e1-4d18-b931-d4c481a7d0a6 None admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:33.487479 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d435aa7-f2e1-4d18-b931-d4c481a7d0a6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:33.487780 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d435aa7-f2e1-4d18-b931-d4c481a7d0a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:33.489183 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d435aa7-f2e1-4d18-b931-d4c481a7d0a6 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:33.505921 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 631/1268] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Mar 8 13:42:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:33.511682 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a03b9-92e4-4c4f-8809-c71a0618c53a None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:33.609369 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2a03b9-92e4-4c4f-8809-c71a0618c53a None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:33.641823 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449d390-b0a7-4022-bdbf-54a7c3ca15e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:33.642583 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449d390-b0a7-4022-bdbf-54a7c3ca15e3 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:33.643171 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449d390-b0a7-4022-bdbf-54a7c3ca15e3 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:33.643438 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449d390-b0a7-4022-bdbf-54a7c3ca15e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:33.654314 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449d390-b0a7-4022-bdbf-54a7c3ca15e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:33.655791 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449d390-b0a7-4022-bdbf-54a7c3ca15e3 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:33.671641 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-6449d390-b0a7-4022-bdbf-54a7c3ca15e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:42:33.672752 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 638/1269] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:42:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:42:33.681807 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d435aa7-f2e1-4d18-b931-d4c481a7d0a6 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:33.798269 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d435aa7-f2e1-4d18-b931-d4c481a7d0a6 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:33.830968 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7125e2-3c4d-475c-aca5-36a74584900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:33.831626 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7125e2-3c4d-475c-aca5-36a74584900b None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:33.831903 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7125e2-3c4d-475c-aca5-36a74584900b None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:33.832175 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7125e2-3c4d-475c-aca5-36a74584900b None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:33.832898 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7125e2-3c4d-475c-aca5-36a74584900b None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:33.833200 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7125e2-3c4d-475c-aca5-36a74584900b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:33.834584 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7125e2-3c4d-475c-aca5-36a74584900b None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:33.846808 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 632/1270] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:33.852251 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449d390-b0a7-4022-bdbf-54a7c3ca15e3 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:33.950312 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449d390-b0a7-4022-bdbf-54a7c3ca15e3 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:33.981673 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67f8d1-9440-4605-9b12-3a8ecd8ae0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:33.982590 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67f8d1-9440-4605-9b12-3a8ecd8ae0ad None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:33.982912 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67f8d1-9440-4605-9b12-3a8ecd8ae0ad None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:33.983185 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67f8d1-9440-4605-9b12-3a8ecd8ae0ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:33.989783 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67f8d1-9440-4605-9b12-3a8ecd8ae0ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:33.991229 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67f8d1-9440-4605-9b12-3a8ecd8ae0ad None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:34.004487 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-5d67f8d1-9440-4605-9b12-3a8ecd8ae0ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:42:34.005960 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 639/1271] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:42:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:34.011442 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7125e2-3c4d-475c-aca5-36a74584900b None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:34.104158 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7125e2-3c4d-475c-aca5-36a74584900b None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:34.143699 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316616ef-4d15-4518-8e8c-00d9f2298942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:34.144602 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316616ef-4d15-4518-8e8c-00d9f2298942 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:34.144969 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316616ef-4d15-4518-8e8c-00d9f2298942 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:34.145312 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316616ef-4d15-4518-8e8c-00d9f2298942 None admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:34.146574 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316616ef-4d15-4518-8e8c-00d9f2298942 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:34.146988 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316616ef-4d15-4518-8e8c-00d9f2298942 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:34.149286 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316616ef-4d15-4518-8e8c-00d9f2298942 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:34.163604 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 633/1272] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:42:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:34.169967 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67f8d1-9440-4605-9b12-3a8ecd8ae0ad None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:34.271892 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67f8d1-9440-4605-9b12-3a8ecd8ae0ad None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:34.310378 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbcba1-c499-4b33-ac78-d8e713ebfba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:34.311321 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbcba1-c499-4b33-ac78-d8e713ebfba0 None admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:34.311601 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbcba1-c499-4b33-ac78-d8e713ebfba0 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:34.311872 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbcba1-c499-4b33-ac78-d8e713ebfba0 None admin] PATH_INFO: `/v3/projects/7d693fb3e9fc4d82a0ed054f31f1e56e/users/6e2e8458589b45fa8c91b0d95840e45e/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:34.313816 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bbcba1-c499-4b33-ac78-d8e713ebfba0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d693fb3e9fc4d82a0ed054f31f1e56e, user_id=6e2e8458589b45fa8c91b0d95840e45e, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:34.315253 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bbcba1-c499-4b33-ac78-d8e713ebfba0 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:34.330813 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 640/1273] 10.222.0.18 () {58 vars in 1439 bytes} [Tue Mar 8 13:42:34 2022] PUT /identity/v3/projects/7d693fb3e9fc4d82a0ed054f31f1e56e/users/6e2e8458589b45fa8c91b0d95840e45e/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:42:36.607771 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8f45e-c941-4cef-9989-f2a47ca9d490 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:36.608302 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8f45e-c941-4cef-9989-f2a47ca9d490 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:36.608302 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8f45e-c941-4cef-9989-f2a47ca9d490 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:36.610110 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 634/1274] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:42:36.616370 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb6c27-6dd1-4c7d-b866-1ea4088df250 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:36.617049 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb6c27-6dd1-4c7d-b866-1ea4088df250 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:36.617224 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb6c27-6dd1-4c7d-b866-1ea4088df250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:36.642941 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-1feb6c27-6dd1-4c7d-b866-1ea4088df250 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:42:36.644141 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-1feb6c27-6dd1-4c7d-b866-1ea4088df250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:42:36.722634 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 641/1275] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:42:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:42:36.746857 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8f45e-c941-4cef-9989-f2a47ca9d490 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:36.851650 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8f45e-c941-4cef-9989-f2a47ca9d490 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:36.884925 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb95c7-f9be-42cf-af16-6ce25f38935a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:36.885744 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb95c7-f9be-42cf-af16-6ce25f38935a None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:36.886017 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb95c7-f9be-42cf-af16-6ce25f38935a None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:36.886292 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb95c7-f9be-42cf-af16-6ce25f38935a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:36.897209 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb95c7-f9be-42cf-af16-6ce25f38935a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Mar 08 13:42:36.903996 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-0adb95c7-f9be-42cf-af16-6ce25f38935a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Mar 08 13:42:36.905220 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 635/1276] 10.222.0.18 () {56 vars in 1096 bytes} [Tue Mar 8 13:42:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:36.912328 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb6c27-6dd1-4c7d-b866-1ea4088df250 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:37.013207 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb6c27-6dd1-4c7d-b866-1ea4088df250 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:37.046413 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa72c6-13fa-40e8-99a9-a2d5f70afcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:37.047063 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa72c6-13fa-40e8-99a9-a2d5f70afcea None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:37.047342 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa72c6-13fa-40e8-99a9-a2d5f70afcea None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:37.047615 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa72c6-13fa-40e8-99a9-a2d5f70afcea None admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:37.048351 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa72c6-13fa-40e8-99a9-a2d5f70afcea None admin] RBAC: Adding query filter params (name=admin) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:37.048650 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa72c6-13fa-40e8-99a9-a2d5f70afcea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:37.050053 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effa72c6-13fa-40e8-99a9-a2d5f70afcea None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:37.057854 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 642/1277] 10.222.0.18 () {56 vars in 1099 bytes} [Tue Mar 8 13:42:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:37.064266 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb95c7-f9be-42cf-af16-6ce25f38935a None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:37.181185 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb95c7-f9be-42cf-af16-6ce25f38935a None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:37.214451 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988dfb0-2ca4-48f8-81b5-53ecce614254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:37.215218 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988dfb0-2ca4-48f8-81b5-53ecce614254 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:37.215499 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988dfb0-2ca4-48f8-81b5-53ecce614254 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:37.215772 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988dfb0-2ca4-48f8-81b5-53ecce614254 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:37.226423 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988dfb0-2ca4-48f8-81b5-53ecce614254 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:37.227849 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988dfb0-2ca4-48f8-81b5-53ecce614254 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:37.244045 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-1988dfb0-2ca4-48f8-81b5-53ecce614254 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:42:37.245194 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 636/1278] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:37.254466 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa72c6-13fa-40e8-99a9-a2d5f70afcea None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:37.362276 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa72c6-13fa-40e8-99a9-a2d5f70afcea None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:37.395434 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d2509-0e21-49f3-8308-d57e3958321c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:37.396078 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d2509-0e21-49f3-8308-d57e3958321c None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:37.396351 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d2509-0e21-49f3-8308-d57e3958321c None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:37.396622 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d2509-0e21-49f3-8308-d57e3958321c None admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:37.397333 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d2509-0e21-49f3-8308-d57e3958321c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:37.397667 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d2509-0e21-49f3-8308-d57e3958321c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:37.399022 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315d2509-0e21-49f3-8308-d57e3958321c None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:37.411332 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 643/1279] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:37.417636 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988dfb0-2ca4-48f8-81b5-53ecce614254 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:37.526384 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988dfb0-2ca4-48f8-81b5-53ecce614254 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:37.559743 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13509d-4272-433e-8e09-70b6b22338b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:37.560525 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13509d-4272-433e-8e09-70b6b22338b0 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:37.560836 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13509d-4272-433e-8e09-70b6b22338b0 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:37.561149 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13509d-4272-433e-8e09-70b6b22338b0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:37.568633 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13509d-4272-433e-8e09-70b6b22338b0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:37.570092 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13509d-4272-433e-8e09-70b6b22338b0 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:37.583448 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-3f13509d-4272-433e-8e09-70b6b22338b0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Mar 08 13:42:37.584603 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 637/1280] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:42:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:37.593804 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d2509-0e21-49f3-8308-d57e3958321c None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:37.703268 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315d2509-0e21-49f3-8308-d57e3958321c None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:37.737726 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ca156-8f76-43a7-bf7d-7619f8584ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:37.738385 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ca156-8f76-43a7-bf7d-7619f8584ef5 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:37.738686 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ca156-8f76-43a7-bf7d-7619f8584ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:37.738979 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ca156-8f76-43a7-bf7d-7619f8584ef5 None admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:37.739757 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ca156-8f76-43a7-bf7d-7619f8584ef5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:37.740065 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ca156-8f76-43a7-bf7d-7619f8584ef5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:37.741554 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ca156-8f76-43a7-bf7d-7619f8584ef5 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:37.758257 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 644/1281] 10.222.0.18 () {56 vars in 1143 bytes} [Tue Mar 8 13:42:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:37.764132 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13509d-4272-433e-8e09-70b6b22338b0 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:37.864699 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13509d-4272-433e-8e09-70b6b22338b0 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:37.898433 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2ef29-351d-4188-b908-72503d91e73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:37.899073 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2ef29-351d-4188-b908-72503d91e73c None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:37.899352 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2ef29-351d-4188-b908-72503d91e73c None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:37.899622 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2ef29-351d-4188-b908-72503d91e73c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:37.967702 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2ef29-351d-4188-b908-72503d91e73c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:37.969137 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2ef29-351d-4188-b908-72503d91e73c None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:38.067002 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 638/1282] 10.222.0.18 () {58 vars in 1282 bytes} [Tue Mar 8 13:42:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Mar 08 13:42:38.072943 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ca156-8f76-43a7-bf7d-7619f8584ef5 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:38.169457 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ca156-8f76-43a7-bf7d-7619f8584ef5 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:38.202701 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68b27b-ec2a-431e-acbb-44f1baac45c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:38.203471 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68b27b-ec2a-431e-acbb-44f1baac45c4 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:38.203742 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68b27b-ec2a-431e-acbb-44f1baac45c4 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:38.204007 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68b27b-ec2a-431e-acbb-44f1baac45c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:38.214406 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68b27b-ec2a-431e-acbb-44f1baac45c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:38.215866 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68b27b-ec2a-431e-acbb-44f1baac45c4 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:38.233113 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-2c68b27b-ec2a-431e-acbb-44f1baac45c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Mar 08 13:42:38.234320 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 645/1283] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:38.240740 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2ef29-351d-4188-b908-72503d91e73c None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:38.354737 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2ef29-351d-4188-b908-72503d91e73c None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:38.387875 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d538f-1c7a-4e16-93b7-bd470a13026c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:38.388517 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d538f-1c7a-4e16-93b7-bd470a13026c None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:38.388850 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d538f-1c7a-4e16-93b7-bd470a13026c None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:38.389122 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d538f-1c7a-4e16-93b7-bd470a13026c None admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:38.389868 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d538f-1c7a-4e16-93b7-bd470a13026c None admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:38.390166 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d538f-1c7a-4e16-93b7-bd470a13026c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:38.391507 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d538f-1c7a-4e16-93b7-bd470a13026c None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:38.402516 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 639/1284] 10.222.0.18 () {56 vars in 1109 bytes} [Tue Mar 8 13:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:38.411599 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68b27b-ec2a-431e-acbb-44f1baac45c4 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:38.520919 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68b27b-ec2a-431e-acbb-44f1baac45c4 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:38.554941 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152740f8-6e50-4386-a913-de4759fbfb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:38.555792 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152740f8-6e50-4386-a913-de4759fbfb40 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:38.556055 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152740f8-6e50-4386-a913-de4759fbfb40 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:38.556329 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152740f8-6e50-4386-a913-de4759fbfb40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:38.563158 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152740f8-6e50-4386-a913-de4759fbfb40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:38.564630 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152740f8-6e50-4386-a913-de4759fbfb40 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:38.577389 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING keystone.server.flask.application [None req-152740f8-6e50-4386-a913-de4759fbfb40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Mar 08 13:42:38.578517 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 646/1285] 10.222.0.18 () {56 vars in 1111 bytes} [Tue Mar 8 13:42:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:38.585146 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d538f-1c7a-4e16-93b7-bd470a13026c None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:38.699993 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d538f-1c7a-4e16-93b7-bd470a13026c None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:38.735857 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e5d8d-a377-4b4b-b322-5cf4ee03f02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:38.736508 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e5d8d-a377-4b4b-b322-5cf4ee03f02f None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:38.736785 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e5d8d-a377-4b4b-b322-5cf4ee03f02f None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:38.737056 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e5d8d-a377-4b4b-b322-5cf4ee03f02f None admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:38.737881 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e5d8d-a377-4b4b-b322-5cf4ee03f02f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:38.738190 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e5d8d-a377-4b4b-b322-5cf4ee03f02f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:38.739603 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e5d8d-a377-4b4b-b322-5cf4ee03f02f None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:38.752100 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 640/1286] 10.222.0.18 () {56 vars in 1148 bytes} [Tue Mar 8 13:42:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:38.758369 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152740f8-6e50-4386-a913-de4759fbfb40 None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:38.854510 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152740f8-6e50-4386-a913-de4759fbfb40 None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:38.887580 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509f096-d917-45f9-ac1c-ea322117a29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:38.888211 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509f096-d917-45f9-ac1c-ea322117a29f None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:38.888488 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509f096-d917-45f9-ac1c-ea322117a29f None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:38.888881 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509f096-d917-45f9-ac1c-ea322117a29f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:38.889732 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509f096-d917-45f9-ac1c-ea322117a29f None admin] RBAC: Adding query filter params (role.id=fc021ed5870a44f5a0f0b8fff994d6f0, scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e, user.id=6e2e8458589b45fa8c91b0d95840e45e) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:38.890035 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509f096-d917-45f9-ac1c-ea322117a29f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:38.891450 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509f096-d917-45f9-ac1c-ea322117a29f None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:38.897478 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 647/1287] 10.222.0.18 () {56 vars in 1374 bytes} [Tue Mar 8 13:42:38 2022] GET /identity/v3/role_assignments?user.id=6e2e8458589b45fa8c91b0d95840e45e&scope.project.id=7d693fb3e9fc4d82a0ed054f31f1e56e&role.id=fc021ed5870a44f5a0f0b8fff994d6f0 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:41.140025 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62dceb-e538-409f-9bed-0cbda88104a6 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:41.140701 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62dceb-e538-409f-9bed-0cbda88104a6 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:41.140701 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62dceb-e538-409f-9bed-0cbda88104a6 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:41.143985 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 641/1288] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:42:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:42:41.149332 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee37ec-e9ed-4d48-84b7-64d346d693cc None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:41.149794 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee37ec-e9ed-4d48-84b7-64d346d693cc None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:41.149895 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee37ec-e9ed-4d48-84b7-64d346d693cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:41.168192 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-17ee37ec-e9ed-4d48-84b7-64d346d693cc None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:42:41.169388 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-17ee37ec-e9ed-4d48-84b7-64d346d693cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:42:41.235210 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 648/1289] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:42:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:42:41.257289 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62dceb-e538-409f-9bed-0cbda88104a6 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:41.369760 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62dceb-e538-409f-9bed-0cbda88104a6 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:41.405608 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c818885-adfa-41a5-9a12-32e5ae805e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:41.406318 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c818885-adfa-41a5-9a12-32e5ae805e58 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:41.406601 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c818885-adfa-41a5-9a12-32e5ae805e58 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:41.406864 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c818885-adfa-41a5-9a12-32e5ae805e58 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:41.407512 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c818885-adfa-41a5-9a12-32e5ae805e58 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:41.408861 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c818885-adfa-41a5-9a12-32e5ae805e58 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:41.420001 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-1c818885-adfa-41a5-9a12-32e5ae805e58 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 08 13:42:41.421149 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 642/1290] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Mar 8 13:42:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:41.430730 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee37ec-e9ed-4d48-84b7-64d346d693cc None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:41.545320 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee37ec-e9ed-4d48-84b7-64d346d693cc None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:41.580518 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b03ec9e-100b-4e23-a365-c5c0994d6947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:41.581161 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03ec9e-100b-4e23-a365-c5c0994d6947 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:41.581465 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03ec9e-100b-4e23-a365-c5c0994d6947 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:41.581733 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b03ec9e-100b-4e23-a365-c5c0994d6947 None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:41.582458 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b03ec9e-100b-4e23-a365-c5c0994d6947 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:41.582751 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b03ec9e-100b-4e23-a365-c5c0994d6947 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:41.584127 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b03ec9e-100b-4e23-a365-c5c0994d6947 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:41.588987 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 649/1291] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Mar 8 13:42:41 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:41.595756 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c818885-adfa-41a5-9a12-32e5ae805e58 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:41.714194 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c818885-adfa-41a5-9a12-32e5ae805e58 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:41.754171 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50adc3-1812-4d5c-b122-b4cc1bbf4fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:41.754823 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50adc3-1812-4d5c-b122-b4cc1bbf4fc2 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:41.755147 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50adc3-1812-4d5c-b122-b4cc1bbf4fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:41.755399 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50adc3-1812-4d5c-b122-b4cc1bbf4fc2 None admin] PATH_INFO: `/v3/services` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:41.756111 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50adc3-1812-4d5c-b122-b4cc1bbf4fc2 None admin] RBAC: Adding query filter params (type=placement) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:41.756414 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50adc3-1812-4d5c-b122-b4cc1bbf4fc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:41.757812 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50adc3-1812-4d5c-b122-b4cc1bbf4fc2 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:41.762459 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 643/1292] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Mar 8 13:42:41 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:44.001409 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1baa4a6-9e2a-4a4f-983c-f3e324a74484 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:44.002265 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1baa4a6-9e2a-4a4f-983c-f3e324a74484 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:44.002358 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1baa4a6-9e2a-4a4f-983c-f3e324a74484 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:44.005193 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 650/1293] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:42:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:42:44.011491 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e43b2b-ea19-4929-a38d-49d392fa15bb None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:44.012171 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e43b2b-ea19-4929-a38d-49d392fa15bb None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:44.012373 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e43b2b-ea19-4929-a38d-49d392fa15bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:44.036713 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-37e43b2b-ea19-4929-a38d-49d392fa15bb None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:42:44.037954 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-37e43b2b-ea19-4929-a38d-49d392fa15bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:42:44.103246 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 644/1294] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:42:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:42:44.127964 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1baa4a6-9e2a-4a4f-983c-f3e324a74484 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:44.233532 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1baa4a6-9e2a-4a4f-983c-f3e324a74484 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:44.266545 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294aaa0a-817e-4a2d-b1ab-2d4f9ccbe21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:44.267499 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294aaa0a-817e-4a2d-b1ab-2d4f9ccbe21e None admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:44.267773 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294aaa0a-817e-4a2d-b1ab-2d4f9ccbe21e None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:44.268040 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294aaa0a-817e-4a2d-b1ab-2d4f9ccbe21e None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:44.268758 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294aaa0a-817e-4a2d-b1ab-2d4f9ccbe21e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:44.270196 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294aaa0a-817e-4a2d-b1ab-2d4f9ccbe21e None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:44.286416 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 651/1295] 10.222.0.18 () {60 vars in 1141 bytes} [Tue Mar 8 13:42:44 2022] POST /identity/v3/services => generated 246 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:42:46.578642 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2c882-5374-4830-a471-75e36cf77708 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:46.579189 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2c882-5374-4830-a471-75e36cf77708 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:46.579189 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2c882-5374-4830-a471-75e36cf77708 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:46.580981 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 645/1296] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:42:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:42:46.587547 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2237122-6cd3-486c-9b0a-60c6636732f3 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:46.588239 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2237122-6cd3-486c-9b0a-60c6636732f3 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:46.588384 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2237122-6cd3-486c-9b0a-60c6636732f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:46.613099 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-d2237122-6cd3-486c-9b0a-60c6636732f3 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:42:46.614379 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-d2237122-6cd3-486c-9b0a-60c6636732f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:42:46.686811 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 652/1297] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:42:46 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:42:46.721262 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2c882-5374-4830-a471-75e36cf77708 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:46.835904 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2c882-5374-4830-a471-75e36cf77708 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:46.866646 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a797a-a609-4a77-ad6d-9e96b1e576f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:46.867420 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a797a-a609-4a77-ad6d-9e96b1e576f4 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:46.867697 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a797a-a609-4a77-ad6d-9e96b1e576f4 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:46.868037 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a797a-a609-4a77-ad6d-9e96b1e576f4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:46.868688 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a797a-a609-4a77-ad6d-9e96b1e576f4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:46.870062 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a797a-a609-4a77-ad6d-9e96b1e576f4 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:46.881257 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-f97a797a-a609-4a77-ad6d-9e96b1e576f4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 08 13:42:46.882427 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 646/1298] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Mar 8 13:42:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Mar 08 13:42:46.892238 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2237122-6cd3-486c-9b0a-60c6636732f3 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:46.999523 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2237122-6cd3-486c-9b0a-60c6636732f3 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:47.035615 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99d0a3-3c63-4f34-a021-2ab48879a2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:47.036256 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99d0a3-3c63-4f34-a021-2ab48879a2df None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:47.036533 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99d0a3-3c63-4f34-a021-2ab48879a2df None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:47.036798 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99d0a3-3c63-4f34-a021-2ab48879a2df None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:47.037507 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99d0a3-3c63-4f34-a021-2ab48879a2df None admin] RBAC: Adding query filter params (name=placement) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:47.037843 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99d0a3-3c63-4f34-a021-2ab48879a2df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:47.039222 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99d0a3-3c63-4f34-a021-2ab48879a2df None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:47.044396 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 653/1299] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Mar 8 13:42:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:42:47.050467 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a797a-a609-4a77-ad6d-9e96b1e576f4 None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:47.150143 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a797a-a609-4a77-ad6d-9e96b1e576f4 None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:47.183231 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3c3b6-6189-43f2-bf6f-37d342ea4d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:47.183877 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3c3b6-6189-43f2-bf6f-37d342ea4d72 None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:47.184148 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3c3b6-6189-43f2-bf6f-37d342ea4d72 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:47.184416 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3c3b6-6189-43f2-bf6f-37d342ea4d72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:47.185243 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c3c3b6-6189-43f2-bf6f-37d342ea4d72 None admin] RBAC: Adding query filter params (interface=public, service_id=a3410419224a47e4a1138f9cd1973299, region_id=RegionOne) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:47.185577 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c3c3b6-6189-43f2-bf6f-37d342ea4d72 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:47.186928 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c3c3b6-6189-43f2-bf6f-37d342ea4d72 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:47.191991 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 647/1300] 10.222.0.18 () {56 vars in 1251 bytes} [Tue Mar 8 13:42:47 2022] GET /identity/v3/endpoints?service_id=a3410419224a47e4a1138f9cd1973299&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:47.198526 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99d0a3-3c63-4f34-a021-2ab48879a2df None admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:47.299060 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99d0a3-3c63-4f34-a021-2ab48879a2df None admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:47.332649 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2274de5c-ee87-4cc7-b1af-1a751f36bf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:47.333294 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274de5c-ee87-4cc7-b1af-1a751f36bf9e None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:47.333603 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274de5c-ee87-4cc7-b1af-1a751f36bf9e None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:47.333879 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2274de5c-ee87-4cc7-b1af-1a751f36bf9e None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:47.334559 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274de5c-ee87-4cc7-b1af-1a751f36bf9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:47.335924 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2274de5c-ee87-4cc7-b1af-1a751f36bf9e None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:47.342646 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 654/1301] 10.222.0.18 () {56 vars in 1087 bytes} [Tue Mar 8 13:42:47 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:42:49.581151 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a0f9a-0711-49d5-9fb5-e7d662beb88d None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:49.581976 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a0f9a-0711-49d5-9fb5-e7d662beb88d None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:49.582322 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a0f9a-0711-49d5-9fb5-e7d662beb88d None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:49.585088 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 648/1302] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:42:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:42:49.591344 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151b9b0-9822-4d23-a9ec-4b1ced959f3b None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:49.591774 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151b9b0-9822-4d23-a9ec-4b1ced959f3b None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:49.591903 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4151b9b0-9822-4d23-a9ec-4b1ced959f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:49.613954 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-4151b9b0-9822-4d23-a9ec-4b1ced959f3b None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:42:49.615119 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-4151b9b0-9822-4d23-a9ec-4b1ced959f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:42:49.682639 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 655/1303] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:42:49 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Mar 08 13:42:49.706237 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a0f9a-0711-49d5-9fb5-e7d662beb88d None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:49.813738 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a0f9a-0711-49d5-9fb5-e7d662beb88d None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:49.858078 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f99880-6736-4d5b-892e-0a47e180a17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:49.859172 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f99880-6736-4d5b-892e-0a47e180a17a None admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:49.859581 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f99880-6736-4d5b-892e-0a47e180a17a None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:49.859971 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f99880-6736-4d5b-892e-0a47e180a17a None admin] PATH_INFO: `/v3/services/placement` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:49.861022 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f99880-6736-4d5b-892e-0a47e180a17a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:49.862632 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f99880-6736-4d5b-892e-0a47e180a17a None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:49.873892 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING keystone.server.flask.application [None req-d5f99880-6736-4d5b-892e-0a47e180a17a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Mar 08 13:42:49.875033 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 649/1304] 10.222.0.18 () {56 vars in 1117 bytes} [Tue Mar 8 13:42:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Mar 08 13:42:49.884775 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151b9b0-9822-4d23-a9ec-4b1ced959f3b None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:49.990176 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4151b9b0-9822-4d23-a9ec-4b1ced959f3b None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:50.023791 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eef1fa-e5e8-46fd-b55c-cb1c087d7421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:50.024448 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eef1fa-e5e8-46fd-b55c-cb1c087d7421 None admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:50.024722 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eef1fa-e5e8-46fd-b55c-cb1c087d7421 None admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:50.024992 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eef1fa-e5e8-46fd-b55c-cb1c087d7421 None admin] PATH_INFO: `/v3/services` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:50.025730 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eef1fa-e5e8-46fd-b55c-cb1c087d7421 None admin] RBAC: Adding query filter params (name=placement) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:42:50.026029 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eef1fa-e5e8-46fd-b55c-cb1c087d7421 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:50.027389 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eef1fa-e5e8-46fd-b55c-cb1c087d7421 None admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:50.032554 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 656/1305] 10.222.0.18 () {56 vars in 1116 bytes} [Tue Mar 8 13:42:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:42:50.038939 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f99880-6736-4d5b-892e-0a47e180a17a None admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:42:50.149635 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f99880-6736-4d5b-892e-0a47e180a17a None admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:42:50.187930 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b4fdf-c5b9-4d13-8945-304d5bd99c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:42:50.188901 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b4fdf-c5b9-4d13-8945-304d5bd99c77 None admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:42:50.189331 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b4fdf-c5b9-4d13-8945-304d5bd99c77 None admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:42:50.189721 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b4fdf-c5b9-4d13-8945-304d5bd99c77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:42:50.190831 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b4fdf-c5b9-4d13-8945-304d5bd99c77 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:42:50.192913 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b4fdf-c5b9-4d13-8945-304d5bd99c77 None admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:42:50.220143 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 650/1306] 10.222.0.18 () {60 vars in 1144 bytes} [Tue Mar 8 13:42:50 2022] POST /identity/v3/endpoints => generated 331 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:43:52.931189 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d15ce-fe55-41df-97a1-f2d9e849d72d None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:43:52.931829 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d15ce-fe55-41df-97a1-f2d9e849d72d None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:43:52.931829 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d15ce-fe55-41df-97a1-f2d9e849d72d None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:43:52.942536 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021e349-62b8-4e75-990c-a90ae2fb61cd None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:43:52.942536 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021e349-62b8-4e75-990c-a90ae2fb61cd None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:43:52.942536 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021e349-62b8-4e75-990c-a90ae2fb61cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:43:52.946043 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 657/1307] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:43:52 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:43:53.029973 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-b021e349-62b8-4e75-990c-a90ae2fb61cd None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:43:53.031067 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-b021e349-62b8-4e75-990c-a90ae2fb61cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:43:53.163928 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 651/1308] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:43:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:43:53.186932 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d15ce-fe55-41df-97a1-f2d9e849d72d None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:43:53.188655 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-a93d15ce-fe55-41df-97a1-f2d9e849d72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:43:53.324274 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d15ce-fe55-41df-97a1-f2d9e849d72d None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:43:53.417425 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a068e-d161-4878-b34c-1d8960c1cff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:43:53.418105 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a068e-d161-4878-b34c-1d8960c1cff5 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:43:53.418343 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a068e-d161-4878-b34c-1d8960c1cff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:43:53.418635 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a068e-d161-4878-b34c-1d8960c1cff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:43:53.419409 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a068e-d161-4878-b34c-1d8960c1cff5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:43:53.421126 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING py.warnings [None req-353a068e-d161-4878-b34c-1d8960c1cff5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:43:53.421126 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: warnings.warn(msg) Mar 08 13:43:53.421126 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: Mar 08 13:43:53.422284 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a068e-d161-4878-b34c-1d8960c1cff5 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:43:53.441223 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 658/1309] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:43:53 2022] GET /identity/v3/projects => generated 2553 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:43:55.733223 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e841b2f-c4eb-4bc2-8bf7-5e9deb46510b None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:43:55.733844 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e841b2f-c4eb-4bc2-8bf7-5e9deb46510b None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:43:55.733844 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e841b2f-c4eb-4bc2-8bf7-5e9deb46510b None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:43:55.735653 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 652/1310] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:43:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:43:55.741050 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1942bad-d6a1-4967-85fe-ac3109b5eaab None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:43:55.741558 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1942bad-d6a1-4967-85fe-ac3109b5eaab None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:43:55.741790 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1942bad-d6a1-4967-85fe-ac3109b5eaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:43:55.810012 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-c1942bad-d6a1-4967-85fe-ac3109b5eaab None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:43:55.811166 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-c1942bad-d6a1-4967-85fe-ac3109b5eaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:43:55.907596 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 659/1311] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:43:55.956469 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde53c3-9d80-4b75-aa0c-26083a770f4b None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:43:55.956739 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde53c3-9d80-4b75-aa0c-26083a770f4b None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:43:55.956990 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde53c3-9d80-4b75-aa0c-26083a770f4b None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:43:55.958980 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 653/1312] 10.222.0.18 () {54 vars in 964 bytes} [Tue Mar 8 13:43:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:43:55.965285 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa83b5-c874-47a2-b93d-af372f193014 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:43:55.965824 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa83b5-c874-47a2-b93d-af372f193014 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:43:55.966172 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa83b5-c874-47a2-b93d-af372f193014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:43:56.041832 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-0afa83b5-c874-47a2-b93d-af372f193014 None None] MFA Rules not processed for user `4c610d719b3049f98b95cc8e9bd56834`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:43:56.043354 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-0afa83b5-c874-47a2-b93d-af372f193014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:43:56.117721 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 660/1313] 10.222.0.18 () {58 vars in 1061 bytes} [Tue Mar 8 13:43:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:43:56.126523 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde53c3-9d80-4b75-aa0c-26083a770f4b None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:43:56.128252 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-2bde53c3-9d80-4b75-aa0c-26083a770f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:43:56.236195 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde53c3-9d80-4b75-aa0c-26083a770f4b None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:43:56.312214 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b1d30-82cf-46a8-a369-fd5ad22fbb5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:43:56.312862 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b1d30-82cf-46a8-a369-fd5ad22fbb5e service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:43:56.313133 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b1d30-82cf-46a8-a369-fd5ad22fbb5e service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:43:56.313428 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b1d30-82cf-46a8-a369-fd5ad22fbb5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:43:56.315047 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-d28b1d30-82cf-46a8-a369-fd5ad22fbb5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:43:56.437096 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b1d30-82cf-46a8-a369-fd5ad22fbb5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:43:56.438988 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b1d30-82cf-46a8-a369-fd5ad22fbb5e service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:43:56.464763 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 654/1314] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:43:59.019726 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf53d3-e4f2-4952-8622-20504ede148c None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:43:59.020213 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf53d3-e4f2-4952-8622-20504ede148c None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:43:59.020304 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf53d3-e4f2-4952-8622-20504ede148c None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:43:59.022131 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 661/1315] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:43:59.027526 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2796a9-477a-4e5a-866a-318809fb260d None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:43:59.027973 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2796a9-477a-4e5a-866a-318809fb260d None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:43:59.028080 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2796a9-477a-4e5a-866a-318809fb260d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:43:59.091971 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-0d2796a9-477a-4e5a-866a-318809fb260d None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:43:59.093144 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-0d2796a9-477a-4e5a-866a-318809fb260d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:43:59.197136 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 655/1316] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:43:59.250635 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8395f99-20df-465f-ac3d-f834846aed7e None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:43:59.250923 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8395f99-20df-465f-ac3d-f834846aed7e None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:43:59.251192 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8395f99-20df-465f-ac3d-f834846aed7e None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:43:59.252970 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 662/1317] 10.222.0.18 () {54 vars in 964 bytes} [Tue Mar 8 13:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:43:59.259964 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbf0a9-1571-42bb-bbad-5e67d6a8ed54 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:43:59.260434 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbf0a9-1571-42bb-bbad-5e67d6a8ed54 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:43:59.260896 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbf0a9-1571-42bb-bbad-5e67d6a8ed54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:43:59.342647 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-97dbf0a9-1571-42bb-bbad-5e67d6a8ed54 None None] MFA Rules not processed for user `4c610d719b3049f98b95cc8e9bd56834`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:43:59.343831 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-97dbf0a9-1571-42bb-bbad-5e67d6a8ed54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:43:59.417692 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 656/1318] 10.222.0.18 () {58 vars in 1061 bytes} [Tue Mar 8 13:43:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:43:59.430854 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8395f99-20df-465f-ac3d-f834846aed7e None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:43:59.432372 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-c8395f99-20df-465f-ac3d-f834846aed7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:43:59.537680 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8395f99-20df-465f-ac3d-f834846aed7e None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:43:59.607930 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f5dd8-eac0-4b7b-bcaa-b67f5a325118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:43:59.608563 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f5dd8-eac0-4b7b-bcaa-b67f5a325118 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:43:59.608838 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f5dd8-eac0-4b7b-bcaa-b67f5a325118 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:43:59.609110 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f5dd8-eac0-4b7b-bcaa-b67f5a325118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:43:59.610743 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-b62f5dd8-eac0-4b7b-bcaa-b67f5a325118 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:43:59.720754 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f5dd8-eac0-4b7b-bcaa-b67f5a325118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:43:59.722253 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f5dd8-eac0-4b7b-bcaa-b67f5a325118 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:43:59.741519 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 663/1319] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:43:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:44:02.531800 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc16d0-6f0c-42ba-8cb7-f852fa09d6f9 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:02.532269 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc16d0-6f0c-42ba-8cb7-f852fa09d6f9 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:02.532387 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc16d0-6f0c-42ba-8cb7-f852fa09d6f9 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:02.534181 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 657/1320] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:44:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:44:02.540440 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6a4d0-db4c-4807-884f-153efe761072 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:02.541147 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6a4d0-db4c-4807-884f-153efe761072 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:02.541255 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6a4d0-db4c-4807-884f-153efe761072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:02.619332 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-93c6a4d0-db4c-4807-884f-153efe761072 None None] MFA Rules not processed for user `1a3f15d7da12407f871bd0cc9ee78047`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:44:02.620515 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-93c6a4d0-db4c-4807-884f-153efe761072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:02.715472 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 664/1321] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:44:02 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:44:02.759103 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc16d0-6f0c-42ba-8cb7-f852fa09d6f9 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:44:02.760634 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-79dc16d0-6f0c-42ba-8cb7-f852fa09d6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:02.867057 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc16d0-6f0c-42ba-8cb7-f852fa09d6f9 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:44:02.941008 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b932c3-adb2-42e0-8628-e1a48be61a4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:44:02.941665 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b932c3-adb2-42e0-8628-e1a48be61a4b service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:02.941938 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b932c3-adb2-42e0-8628-e1a48be61a4b service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:02.942209 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b932c3-adb2-42e0-8628-e1a48be61a4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:02.943836 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-a4b932c3-adb2-42e0-8628-e1a48be61a4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:03.068613 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b932c3-adb2-42e0-8628-e1a48be61a4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:44:03.069972 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b932c3-adb2-42e0-8628-e1a48be61a4b service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:44:03.089385 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 658/1322] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:44:02 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:44:05.881072 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6449354-f217-4c25-8ff9-b015b61af54d None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:05.881633 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6449354-f217-4c25-8ff9-b015b61af54d None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:05.881725 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6449354-f217-4c25-8ff9-b015b61af54d None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:05.883475 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 665/1323] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:44:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:44:05.890405 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a0064-3c05-4500-96e7-ea5e8080d23e None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:05.891077 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a0064-3c05-4500-96e7-ea5e8080d23e None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:05.891228 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a0064-3c05-4500-96e7-ea5e8080d23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:05.962418 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-5b2a0064-3c05-4500-96e7-ea5e8080d23e None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:44:05.963617 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-5b2a0064-3c05-4500-96e7-ea5e8080d23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:06.059482 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 659/1324] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:44:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:44:06.107543 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6449354-f217-4c25-8ff9-b015b61af54d None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:44:06.109054 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-e6449354-f217-4c25-8ff9-b015b61af54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:06.209108 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6449354-f217-4c25-8ff9-b015b61af54d None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:44:06.281402 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44488a-1a8c-4bfc-8fdb-3d0e84407a81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:44:06.282061 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44488a-1a8c-4bfc-8fdb-3d0e84407a81 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:06.282314 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44488a-1a8c-4bfc-8fdb-3d0e84407a81 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:06.282568 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44488a-1a8c-4bfc-8fdb-3d0e84407a81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:06.284206 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-5a44488a-1a8c-4bfc-8fdb-3d0e84407a81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:06.390370 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44488a-1a8c-4bfc-8fdb-3d0e84407a81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:44:06.391782 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44488a-1a8c-4bfc-8fdb-3d0e84407a81 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:44:06.410801 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 666/1325] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:44:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:44:09.377751 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c387e8-214c-4981-a66b-d37ca430698f None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:09.378277 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c387e8-214c-4981-a66b-d37ca430698f None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:09.378277 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c387e8-214c-4981-a66b-d37ca430698f None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:09.380007 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 660/1326] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:44:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:44:09.385905 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07130a10-ae88-4044-ad50-ffe87efd1aa7 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:09.386362 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07130a10-ae88-4044-ad50-ffe87efd1aa7 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:09.386469 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07130a10-ae88-4044-ad50-ffe87efd1aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:09.450274 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-07130a10-ae88-4044-ad50-ffe87efd1aa7 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:44:09.451456 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-07130a10-ae88-4044-ad50-ffe87efd1aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:09.549967 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 667/1327] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:44:09.585861 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c387e8-214c-4981-a66b-d37ca430698f None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:44:09.587370 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f7c387e8-214c-4981-a66b-d37ca430698f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:09.690300 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c387e8-214c-4981-a66b-d37ca430698f None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:44:09.767860 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a93b67-afff-4c14-92e0-8ce02c18b550 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:44:09.768510 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a93b67-afff-4c14-92e0-8ce02c18b550 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:09.768790 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a93b67-afff-4c14-92e0-8ce02c18b550 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:09.769063 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a93b67-afff-4c14-92e0-8ce02c18b550 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:09.770767 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-a1a93b67-afff-4c14-92e0-8ce02c18b550 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:09.879864 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a93b67-afff-4c14-92e0-8ce02c18b550 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:44:09.881288 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a93b67-afff-4c14-92e0-8ce02c18b550 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:44:09.899991 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 661/1328] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:44:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:44:12.204424 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3c2eb-65f2-412b-af68-bc6f334cc456 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:12.205047 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3c2eb-65f2-412b-af68-bc6f334cc456 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:12.205047 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe3c2eb-65f2-412b-af68-bc6f334cc456 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:12.206747 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 668/1329] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:44:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:44:12.212165 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afc167-d28a-47b0-8e84-a0a814d6b50f None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:12.212599 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afc167-d28a-47b0-8e84-a0a814d6b50f None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:12.212691 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02afc167-d28a-47b0-8e84-a0a814d6b50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:12.275498 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-02afc167-d28a-47b0-8e84-a0a814d6b50f None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:44:12.276688 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-02afc167-d28a-47b0-8e84-a0a814d6b50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:12.372549 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 662/1330] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:44:12.408338 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3c2eb-65f2-412b-af68-bc6f334cc456 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:44:12.409970 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-cfe3c2eb-65f2-412b-af68-bc6f334cc456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:12.518354 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe3c2eb-65f2-412b-af68-bc6f334cc456 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:44:12.594027 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f644b9-de3f-49b8-a672-f65c089cc153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:44:12.594656 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f644b9-de3f-49b8-a672-f65c089cc153 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:12.594937 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f644b9-de3f-49b8-a672-f65c089cc153 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:12.595207 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f644b9-de3f-49b8-a672-f65c089cc153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:12.596855 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-b6f644b9-de3f-49b8-a672-f65c089cc153 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:12.709815 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f644b9-de3f-49b8-a672-f65c089cc153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:44:12.711256 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f644b9-de3f-49b8-a672-f65c089cc153 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:44:12.730007 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 669/1331] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:44:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:44:15.053511 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b0331-e517-459f-8074-29ccc1a43af9 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:15.054081 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b0331-e517-459f-8074-29ccc1a43af9 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:15.054081 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b0331-e517-459f-8074-29ccc1a43af9 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:15.056014 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 663/1332] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:44:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:44:15.061477 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb7347-c023-414f-8b36-8bab4b2ae9af None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:15.061936 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb7347-c023-414f-8b36-8bab4b2ae9af None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:15.062062 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb7347-c023-414f-8b36-8bab4b2ae9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:15.130629 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-45eb7347-c023-414f-8b36-8bab4b2ae9af None None] MFA Rules not processed for user `1a3f15d7da12407f871bd0cc9ee78047`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:44:15.131848 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-45eb7347-c023-414f-8b36-8bab4b2ae9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:15.227058 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 670/1333] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:44:15 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:44:15.263648 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b0331-e517-459f-8074-29ccc1a43af9 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:44:15.265150 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-b86b0331-e517-459f-8074-29ccc1a43af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:15.371857 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b0331-e517-459f-8074-29ccc1a43af9 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:44:15.446457 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9870da-e7aa-4ca9-ba7f-847127ffe428 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:44:15.447104 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9870da-e7aa-4ca9-ba7f-847127ffe428 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:15.447386 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9870da-e7aa-4ca9-ba7f-847127ffe428 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:15.447619 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9870da-e7aa-4ca9-ba7f-847127ffe428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:15.449259 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-3a9870da-e7aa-4ca9-ba7f-847127ffe428 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:15.559274 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9870da-e7aa-4ca9-ba7f-847127ffe428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:44:15.560773 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9870da-e7aa-4ca9-ba7f-847127ffe428 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:44:15.578834 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 664/1334] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:44:15 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:44:18.236713 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26677f6-a748-4339-838b-29bca4cae325 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:18.237299 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26677f6-a748-4339-838b-29bca4cae325 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:18.237299 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26677f6-a748-4339-838b-29bca4cae325 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:18.239160 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 671/1335] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:44:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:44:18.245633 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b30375-bf1b-464d-9369-d2eac463be8c None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:18.246277 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b30375-bf1b-464d-9369-d2eac463be8c None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:18.246389 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b30375-bf1b-464d-9369-d2eac463be8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:18.320512 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-89b30375-bf1b-464d-9369-d2eac463be8c None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:44:18.322162 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-89b30375-bf1b-464d-9369-d2eac463be8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:18.422411 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 665/1336] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:44:18.457830 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26677f6-a748-4339-838b-29bca4cae325 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:44:18.459376 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-b26677f6-a748-4339-838b-29bca4cae325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:18.561668 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26677f6-a748-4339-838b-29bca4cae325 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:44:18.635959 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9b8ad-c78e-4905-9211-0918756646ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:44:18.636592 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9b8ad-c78e-4905-9211-0918756646ec service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:18.636870 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9b8ad-c78e-4905-9211-0918756646ec service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:18.637140 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9b8ad-c78e-4905-9211-0918756646ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:18.638798 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-09f9b8ad-c78e-4905-9211-0918756646ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:18.748050 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9b8ad-c78e-4905-9211-0918756646ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:44:18.749513 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9b8ad-c78e-4905-9211-0918756646ec service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:44:18.767981 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 672/1337] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:44:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:44:21.077560 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b308cc-a7d0-4909-b492-86c5a56e22f4 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:21.078062 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b308cc-a7d0-4909-b492-86c5a56e22f4 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:21.078178 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b308cc-a7d0-4909-b492-86c5a56e22f4 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:21.079884 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 666/1338] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:44:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:44:21.085661 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca8c94-c8d2-41ad-a1f4-9da8d27706ee None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:21.086069 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca8c94-c8d2-41ad-a1f4-9da8d27706ee None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:21.086210 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca8c94-c8d2-41ad-a1f4-9da8d27706ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:21.152197 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-b6ca8c94-c8d2-41ad-a1f4-9da8d27706ee None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:44:21.153419 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-b6ca8c94-c8d2-41ad-a1f4-9da8d27706ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:21.250251 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 673/1339] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:44:21.295355 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b308cc-a7d0-4909-b492-86c5a56e22f4 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:44:21.297801 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-36b308cc-a7d0-4909-b492-86c5a56e22f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:21.414739 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b308cc-a7d0-4909-b492-86c5a56e22f4 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:44:21.488427 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668537b5-f02d-4048-aa35-bd006368d290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:44:21.489097 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668537b5-f02d-4048-aa35-bd006368d290 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:21.489390 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668537b5-f02d-4048-aa35-bd006368d290 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:21.489678 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668537b5-f02d-4048-aa35-bd006368d290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:21.491305 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-668537b5-f02d-4048-aa35-bd006368d290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:21.621165 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668537b5-f02d-4048-aa35-bd006368d290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:44:21.622661 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668537b5-f02d-4048-aa35-bd006368d290 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:44:21.642268 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 667/1340] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:44:24.348007 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6673c00-2222-4732-8bee-4b66b05e727c None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:24.348559 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6673c00-2222-4732-8bee-4b66b05e727c None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:24.348559 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6673c00-2222-4732-8bee-4b66b05e727c None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:24.351476 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 674/1341] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:44:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:44:24.359279 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab40114-7cc4-4768-80d4-bd4058ac089d None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:24.359720 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab40114-7cc4-4768-80d4-bd4058ac089d None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:24.359811 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab40114-7cc4-4768-80d4-bd4058ac089d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:24.437194 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-1ab40114-7cc4-4768-80d4-bd4058ac089d None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:44:24.438404 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-1ab40114-7cc4-4768-80d4-bd4058ac089d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:24.545612 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 668/1342] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:44:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:44:24.580986 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6673c00-2222-4732-8bee-4b66b05e727c None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:44:24.583598 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-c6673c00-2222-4732-8bee-4b66b05e727c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:24.687798 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6673c00-2222-4732-8bee-4b66b05e727c None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:44:24.692137 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8581140-c881-4190-b002-b698442b47d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:44:24.692780 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8581140-c881-4190-b002-b698442b47d6 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:24.693065 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8581140-c881-4190-b002-b698442b47d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:24.693337 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8581140-c881-4190-b002-b698442b47d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:24.702882 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8581140-c881-4190-b002-b698442b47d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:44:24.704317 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8581140-c881-4190-b002-b698442b47d6 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:44:24.714502 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 675/1343] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:44:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:44:28.949457 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc296f4d-64ea-416b-afc9-c2f45287e8f7 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:28.950060 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc296f4d-64ea-416b-afc9-c2f45287e8f7 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:28.950060 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc296f4d-64ea-416b-afc9-c2f45287e8f7 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:28.951879 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 669/1344] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:44:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:44:28.957534 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165fec6-11e3-46f8-ad73-9881f6ffec71 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:28.957977 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165fec6-11e3-46f8-ad73-9881f6ffec71 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:28.958127 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165fec6-11e3-46f8-ad73-9881f6ffec71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:28.988752 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-a165fec6-11e3-46f8-ad73-9881f6ffec71 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:44:28.989950 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-a165fec6-11e3-46f8-ad73-9881f6ffec71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:29.068267 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 676/1345] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:44:29.106262 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc296f4d-64ea-416b-afc9-c2f45287e8f7 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:44:29.108082 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-dc296f4d-64ea-416b-afc9-c2f45287e8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:29.122425 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc296f4d-64ea-416b-afc9-c2f45287e8f7 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:44:29.126089 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028ae94-9809-42ce-b37a-c5da0eecdee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:44:29.126724 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028ae94-9809-42ce-b37a-c5da0eecdee7 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:29.127004 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028ae94-9809-42ce-b37a-c5da0eecdee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:29.127277 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028ae94-9809-42ce-b37a-c5da0eecdee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:29.137195 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028ae94-9809-42ce-b37a-c5da0eecdee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:44:29.138699 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028ae94-9809-42ce-b37a-c5da0eecdee7 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:44:29.148097 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 670/1346] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:44:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:44:32.135378 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4511f9f-2442-4e80-b765-8dd2d56654c2 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:32.135917 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4511f9f-2442-4e80-b765-8dd2d56654c2 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:32.135917 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4511f9f-2442-4e80-b765-8dd2d56654c2 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:32.137630 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 677/1347] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:44:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:44:32.142882 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fa8a6-238b-4dd8-9383-8d5717e5c9a6 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:32.143324 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fa8a6-238b-4dd8-9383-8d5717e5c9a6 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:32.143467 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fa8a6-238b-4dd8-9383-8d5717e5c9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:32.161891 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-c45fa8a6-238b-4dd8-9383-8d5717e5c9a6 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:44:32.163071 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-c45fa8a6-238b-4dd8-9383-8d5717e5c9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:32.171388 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 671/1348] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:44:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:44:32.208499 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4511f9f-2442-4e80-b765-8dd2d56654c2 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:44:32.220743 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4511f9f-2442-4e80-b765-8dd2d56654c2 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:44:32.224843 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01780aa-e2e4-443a-b6d6-41beab049ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:44:32.225502 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01780aa-e2e4-443a-b6d6-41beab049ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:32.225784 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01780aa-e2e4-443a-b6d6-41beab049ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:32.226058 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01780aa-e2e4-443a-b6d6-41beab049ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:32.235147 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01780aa-e2e4-443a-b6d6-41beab049ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:44:32.236653 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01780aa-e2e4-443a-b6d6-41beab049ce8 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:44:32.246496 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 678/1349] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:44:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:44:36.539305 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05409894-d491-484a-b836-9ccc54a101db None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:36.539833 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05409894-d491-484a-b836-9ccc54a101db None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:36.539833 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05409894-d491-484a-b836-9ccc54a101db None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:36.541712 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 672/1350] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:44:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:44:36.546989 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1c18a-9f8a-421b-8e22-5eac96c177db None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:36.547432 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1c18a-9f8a-421b-8e22-5eac96c177db None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:36.547522 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1c18a-9f8a-421b-8e22-5eac96c177db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:36.565513 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-2bd1c18a-9f8a-421b-8e22-5eac96c177db None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:44:36.566686 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-2bd1c18a-9f8a-421b-8e22-5eac96c177db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:36.574975 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 679/1351] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:44:36.611361 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05409894-d491-484a-b836-9ccc54a101db None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:44:36.622445 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05409894-d491-484a-b836-9ccc54a101db None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:44:36.626277 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cb0b4-129e-4888-bcda-d966091ab16f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:44:36.626901 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cb0b4-129e-4888-bcda-d966091ab16f service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:36.627180 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cb0b4-129e-4888-bcda-d966091ab16f service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:36.627449 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cb0b4-129e-4888-bcda-d966091ab16f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:36.636767 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5cb0b4-129e-4888-bcda-d966091ab16f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:44:36.638204 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5cb0b4-129e-4888-bcda-d966091ab16f service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:44:36.647606 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 673/1352] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:44:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:44:41.931796 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f6b2b-d983-437c-8b89-88447e63969c None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:41.932662 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f6b2b-d983-437c-8b89-88447e63969c None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:41.933085 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f6b2b-d983-437c-8b89-88447e63969c None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:41.935354 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 680/1353] 10.222.0.18 () {54 vars in 921 bytes} [Tue Mar 8 13:44:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:44:41.940538 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15794cb9-9d6a-427c-9e76-4468bc19af26 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:41.941295 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15794cb9-9d6a-427c-9e76-4468bc19af26 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:41.941758 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15794cb9-9d6a-427c-9e76-4468bc19af26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:42.009484 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-15794cb9-9d6a-427c-9e76-4468bc19af26 None None] MFA Rules not processed for user `6e2e8458589b45fa8c91b0d95840e45e`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:44:42.010958 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-15794cb9-9d6a-427c-9e76-4468bc19af26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:42.095409 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 674/1354] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Mar 8 13:44:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:44:46.264171 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f28480-e43e-4fcb-8a28-757bada2a9e6 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:46.264712 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f28480-e43e-4fcb-8a28-757bada2a9e6 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:46.264712 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f28480-e43e-4fcb-8a28-757bada2a9e6 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:46.266715 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 681/1355] 10.222.0.18 () {54 vars in 921 bytes} [Tue Mar 8 13:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:44:46.271808 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53243b52-b345-4304-bbf7-5e45d2c951f9 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:46.272654 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53243b52-b345-4304-bbf7-5e45d2c951f9 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:46.273132 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53243b52-b345-4304-bbf7-5e45d2c951f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:46.293782 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-53243b52-b345-4304-bbf7-5e45d2c951f9 None None] MFA Rules not processed for user `6e2e8458589b45fa8c91b0d95840e45e`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:44:46.294982 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-53243b52-b345-4304-bbf7-5e45d2c951f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:46.304766 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 675/1356] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Mar 8 13:44:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:44:47.646995 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb79f02-fb14-4f57-8bb8-94376914575b None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:47.647552 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb79f02-fb14-4f57-8bb8-94376914575b None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:47.647552 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb79f02-fb14-4f57-8bb8-94376914575b None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:47.649302 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 682/1357] 10.222.0.18 () {54 vars in 921 bytes} [Tue Mar 8 13:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:44:47.654798 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581eef7-a3b6-480c-9f35-d94fe4620ec3 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:47.655219 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581eef7-a3b6-480c-9f35-d94fe4620ec3 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:47.655341 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581eef7-a3b6-480c-9f35-d94fe4620ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:47.673401 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-b581eef7-a3b6-480c-9f35-d94fe4620ec3 None None] MFA Rules not processed for user `6e2e8458589b45fa8c91b0d95840e45e`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:44:47.674653 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-b581eef7-a3b6-480c-9f35-d94fe4620ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:47.683559 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 676/1358] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Mar 8 13:44:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:44:51.470881 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f833f2-5dee-4f38-b0eb-ca42707502a4 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:51.471390 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f833f2-5dee-4f38-b0eb-ca42707502a4 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:51.471491 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f833f2-5dee-4f38-b0eb-ca42707502a4 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:51.473384 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 683/1359] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:44:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:44:51.478450 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463eb6aa-cd66-41f6-bd2e-b97c80ec36a9 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:51.478893 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463eb6aa-cd66-41f6-bd2e-b97c80ec36a9 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:51.478981 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463eb6aa-cd66-41f6-bd2e-b97c80ec36a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:51.497691 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-463eb6aa-cd66-41f6-bd2e-b97c80ec36a9 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:44:51.499137 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-463eb6aa-cd66-41f6-bd2e-b97c80ec36a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:51.508781 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 677/1360] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:44:51.555539 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd68ae0-e1ed-49ca-96be-6e8155398a91 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:51.555847 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd68ae0-e1ed-49ca-96be-6e8155398a91 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:51.556226 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd68ae0-e1ed-49ca-96be-6e8155398a91 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:51.558112 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 684/1361] 10.222.0.18 () {54 vars in 961 bytes} [Tue Mar 8 13:44:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:44:51.563689 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b466b-63d0-49eb-8878-8fceffa9ad93 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:51.564245 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b466b-63d0-49eb-8878-8fceffa9ad93 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:51.564764 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b466b-63d0-49eb-8878-8fceffa9ad93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:51.614039 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-3b6b466b-63d0-49eb-8878-8fceffa9ad93 None None] MFA Rules not processed for user `21ec894123044d4382995791c74c587b`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:44:51.615341 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-3b6b466b-63d0-49eb-8878-8fceffa9ad93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:51.696041 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 678/1362] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Mar 8 13:44:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:44:51.703881 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd68ae0-e1ed-49ca-96be-6e8155398a91 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:44:51.718409 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd68ae0-e1ed-49ca-96be-6e8155398a91 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:44:51.723984 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915552f-51e1-4ed1-8968-bcc4454c4c6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:44:51.724691 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915552f-51e1-4ed1-8968-bcc4454c4c6e service nova] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:51.725039 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915552f-51e1-4ed1-8968-bcc4454c4c6e service nova] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:51.725401 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915552f-51e1-4ed1-8968-bcc4454c4c6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:51.734065 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915552f-51e1-4ed1-8968-bcc4454c4c6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:44:51.736513 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915552f-51e1-4ed1-8968-bcc4454c4c6e service nova] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:44:51.747130 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 685/1363] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:44:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:44:54.229784 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cb939-6755-45e3-a624-d6d8390d58c1 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:54.230302 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cb939-6755-45e3-a624-d6d8390d58c1 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:54.230302 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cb939-6755-45e3-a624-d6d8390d58c1 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:54.232046 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 679/1364] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:44:54.237771 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e560fc-aad6-40e7-8ea2-9ac4401e959e None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:54.238216 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e560fc-aad6-40e7-8ea2-9ac4401e959e None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:54.238324 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e560fc-aad6-40e7-8ea2-9ac4401e959e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:54.257550 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-a6e560fc-aad6-40e7-8ea2-9ac4401e959e None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:44:54.258784 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-a6e560fc-aad6-40e7-8ea2-9ac4401e959e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:54.267010 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 686/1365] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:44:54.309849 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078cb939-6755-45e3-a624-d6d8390d58c1 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:44:54.324211 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078cb939-6755-45e3-a624-d6d8390d58c1 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:44:54.329619 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73dd8f-ec4d-452c-9d37-0e08203ae27e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:44:54.330321 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73dd8f-ec4d-452c-9d37-0e08203ae27e service nova] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:54.330669 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73dd8f-ec4d-452c-9d37-0e08203ae27e service nova] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:54.331007 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73dd8f-ec4d-452c-9d37-0e08203ae27e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:54.339343 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73dd8f-ec4d-452c-9d37-0e08203ae27e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:44:54.341171 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73dd8f-ec4d-452c-9d37-0e08203ae27e service nova] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:44:54.351757 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 680/1366] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:44:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:44:56.915258 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780184c8-ec62-4cd1-951d-d9b171170071 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:56.915856 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780184c8-ec62-4cd1-951d-d9b171170071 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:56.915856 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780184c8-ec62-4cd1-951d-d9b171170071 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:56.917654 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 687/1367] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:44:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:44:56.923012 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae1961-ac64-45ea-a32e-f94a8bf2b66b None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:56.923500 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae1961-ac64-45ea-a32e-f94a8bf2b66b None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:56.923500 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae1961-ac64-45ea-a32e-f94a8bf2b66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:56.941430 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-54ae1961-ac64-45ea-a32e-f94a8bf2b66b None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:44:56.942613 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-54ae1961-ac64-45ea-a32e-f94a8bf2b66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:56.950806 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 681/1368] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:44:56.994519 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef023f9b-9435-4cd9-8862-2799ab865fbd None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:56.994878 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef023f9b-9435-4cd9-8862-2799ab865fbd None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:56.995320 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef023f9b-9435-4cd9-8862-2799ab865fbd None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:56.997258 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 688/1369] 10.222.0.18 () {54 vars in 961 bytes} [Tue Mar 8 13:44:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:44:57.002916 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1835d22-10d1-4267-8b6a-b8d44a054e7f None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:57.003175 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1835d22-10d1-4267-8b6a-b8d44a054e7f None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:57.003447 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1835d22-10d1-4267-8b6a-b8d44a054e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:57.023027 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-d1835d22-10d1-4267-8b6a-b8d44a054e7f None None] MFA Rules not processed for user `21ec894123044d4382995791c74c587b`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:44:57.024219 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-d1835d22-10d1-4267-8b6a-b8d44a054e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:57.035461 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 682/1370] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Mar 8 13:44:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:44:57.043333 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef023f9b-9435-4cd9-8862-2799ab865fbd None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:44:57.058498 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef023f9b-9435-4cd9-8862-2799ab865fbd None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:44:57.070584 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37447fba-9e96-480e-86a0-d6b079776ca4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:44:57.071241 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37447fba-9e96-480e-86a0-d6b079776ca4 service nova] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:57.071516 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37447fba-9e96-480e-86a0-d6b079776ca4 service nova] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:57.071786 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37447fba-9e96-480e-86a0-d6b079776ca4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:57.080687 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37447fba-9e96-480e-86a0-d6b079776ca4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:44:57.082303 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37447fba-9e96-480e-86a0-d6b079776ca4 service nova] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:44:57.091846 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 689/1371] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:44:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:44:59.405905 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f658e-9b03-4027-baca-777e81b78177 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:59.406425 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f658e-9b03-4027-baca-777e81b78177 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:59.406425 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f658e-9b03-4027-baca-777e81b78177 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:59.408670 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 683/1372] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:44:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:44:59.413869 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85077153-6441-4218-943f-0b108cefa0fc None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:59.414341 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85077153-6441-4218-943f-0b108cefa0fc None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:59.414429 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85077153-6441-4218-943f-0b108cefa0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:59.433017 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-85077153-6441-4218-943f-0b108cefa0fc None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:44:59.434260 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-85077153-6441-4218-943f-0b108cefa0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:59.443566 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 690/1373] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:44:59.487750 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f658e-9b03-4027-baca-777e81b78177 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:44:59.502880 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f658e-9b03-4027-baca-777e81b78177 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:44:59.509774 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802352ab-a9ad-4269-9adc-6002c13e1c8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:44:59.510687 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802352ab-a9ad-4269-9adc-6002c13e1c8d service nova] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:59.511120 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802352ab-a9ad-4269-9adc-6002c13e1c8d service nova] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:59.511555 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802352ab-a9ad-4269-9adc-6002c13e1c8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:59.520778 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802352ab-a9ad-4269-9adc-6002c13e1c8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:44:59.522605 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802352ab-a9ad-4269-9adc-6002c13e1c8d service nova] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:44:59.532282 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 684/1374] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:44:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:44:59.605793 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82cbaf-5946-491d-b17b-759385b2d277 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:59.606060 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82cbaf-5946-491d-b17b-759385b2d277 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:59.606339 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82cbaf-5946-491d-b17b-759385b2d277 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:59.608407 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 691/1375] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:44:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:44:59.614472 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ec7ec-af0b-45f3-bf83-40bb78bb463a None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:59.614750 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ec7ec-af0b-45f3-bf83-40bb78bb463a None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:59.615320 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ec7ec-af0b-45f3-bf83-40bb78bb463a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:59.635009 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-751ec7ec-af0b-45f3-bf83-40bb78bb463a None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:44:59.636484 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-751ec7ec-af0b-45f3-bf83-40bb78bb463a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:44:59.645473 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 685/1376] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:44:59.903049 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf93600-cec5-4aec-89ae-359fafb62e7d None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:59.903304 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf93600-cec5-4aec-89ae-359fafb62e7d None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:59.903762 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf93600-cec5-4aec-89ae-359fafb62e7d None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:59.905527 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 692/1377] 10.222.0.18 () {54 vars in 963 bytes} [Tue Mar 8 13:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:44:59.910793 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48c3ef-346d-42df-bb38-55e3889fc574 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:44:59.911045 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48c3ef-346d-42df-bb38-55e3889fc574 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:44:59.911510 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d48c3ef-346d-42df-bb38-55e3889fc574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:44:59.961026 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-6d48c3ef-346d-42df-bb38-55e3889fc574 None None] MFA Rules not processed for user `56ddb15832b048f5a19d7d3887e088b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:44:59.962156 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-6d48c3ef-346d-42df-bb38-55e3889fc574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:00.021787 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 686/1378] 10.222.0.18 () {58 vars in 1060 bytes} [Tue Mar 8 13:44:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:45:00.029304 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf93600-cec5-4aec-89ae-359fafb62e7d None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:45:00.041152 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf93600-cec5-4aec-89ae-359fafb62e7d None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:45:00.044740 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae512369-a313-4749-966c-90b2b9ed133f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:45:00.045461 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae512369-a313-4749-966c-90b2b9ed133f service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:00.045941 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae512369-a313-4749-966c-90b2b9ed133f service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:00.046499 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae512369-a313-4749-966c-90b2b9ed133f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:00.056042 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae512369-a313-4749-966c-90b2b9ed133f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:45:00.058066 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae512369-a313-4749-966c-90b2b9ed133f service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:45:00.068448 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 693/1379] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:45:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:45:01.822929 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd0157-bd24-4dbb-b1ed-169179b17e42 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:01.823495 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd0157-bd24-4dbb-b1ed-169179b17e42 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:01.823495 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd0157-bd24-4dbb-b1ed-169179b17e42 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:01.825284 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 687/1380] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:45:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:45:01.831668 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87865872-7f00-4d49-892e-04ffef993461 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:01.832270 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87865872-7f00-4d49-892e-04ffef993461 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:01.832270 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87865872-7f00-4d49-892e-04ffef993461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:01.852067 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-87865872-7f00-4d49-892e-04ffef993461 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:45:01.853345 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-87865872-7f00-4d49-892e-04ffef993461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:01.861819 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 694/1381] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:45:01.910316 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd0157-bd24-4dbb-b1ed-169179b17e42 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:45:01.925208 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd0157-bd24-4dbb-b1ed-169179b17e42 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:45:01.931012 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3144c1df-47ee-4208-9b5f-dca4cbfb1747 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:45:01.931697 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144c1df-47ee-4208-9b5f-dca4cbfb1747 service nova] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:01.931979 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144c1df-47ee-4208-9b5f-dca4cbfb1747 service nova] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:01.932250 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3144c1df-47ee-4208-9b5f-dca4cbfb1747 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:01.942675 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3144c1df-47ee-4208-9b5f-dca4cbfb1747 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:45:01.945378 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3144c1df-47ee-4208-9b5f-dca4cbfb1747 service nova] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:45:01.956162 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 688/1382] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:45:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:45:04.262206 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b04654-fd6d-4dba-b859-3ddd9dd193a3 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:04.262783 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b04654-fd6d-4dba-b859-3ddd9dd193a3 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:04.262783 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b04654-fd6d-4dba-b859-3ddd9dd193a3 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:04.264504 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 695/1383] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:45:04.269942 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc5211-f5d8-42ee-82f7-5a906e2a0872 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:04.270365 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc5211-f5d8-42ee-82f7-5a906e2a0872 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:04.270468 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc5211-f5d8-42ee-82f7-5a906e2a0872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:04.289818 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-acdc5211-f5d8-42ee-82f7-5a906e2a0872 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:45:04.290973 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-acdc5211-f5d8-42ee-82f7-5a906e2a0872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:04.299243 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 689/1384] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:45:04.342549 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b04654-fd6d-4dba-b859-3ddd9dd193a3 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:45:04.359463 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b04654-fd6d-4dba-b859-3ddd9dd193a3 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:45:04.365797 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c74e7c-341e-47cd-bbce-cc66b7b2b19b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:45:04.366470 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c74e7c-341e-47cd-bbce-cc66b7b2b19b service nova] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:04.367340 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c74e7c-341e-47cd-bbce-cc66b7b2b19b service nova] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:04.367622 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c74e7c-341e-47cd-bbce-cc66b7b2b19b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:04.376602 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c74e7c-341e-47cd-bbce-cc66b7b2b19b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:45:04.378999 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c74e7c-341e-47cd-bbce-cc66b7b2b19b service nova] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:45:04.391248 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 696/1385] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:45:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:45:06.706387 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fff82-1535-49f6-8c33-82b58bdc6b50 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:06.706973 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fff82-1535-49f6-8c33-82b58bdc6b50 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:06.706973 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fff82-1535-49f6-8c33-82b58bdc6b50 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:06.708676 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 690/1386] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:45:06.714081 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6970648-9418-4a59-92a6-56b03006da15 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:06.714545 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6970648-9418-4a59-92a6-56b03006da15 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:06.714647 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6970648-9418-4a59-92a6-56b03006da15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:06.732516 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-a6970648-9418-4a59-92a6-56b03006da15 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:45:06.733704 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-a6970648-9418-4a59-92a6-56b03006da15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:06.742470 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 697/1387] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:45:06.783635 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fff82-1535-49f6-8c33-82b58bdc6b50 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:45:06.799880 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fff82-1535-49f6-8c33-82b58bdc6b50 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:45:06.806791 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7900392-3a0b-4150-976e-9a0894a7bc90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:45:06.807821 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7900392-3a0b-4150-976e-9a0894a7bc90 service nova] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:06.808179 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7900392-3a0b-4150-976e-9a0894a7bc90 service nova] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:06.808510 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7900392-3a0b-4150-976e-9a0894a7bc90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:06.818284 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7900392-3a0b-4150-976e-9a0894a7bc90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:45:06.820296 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7900392-3a0b-4150-976e-9a0894a7bc90 service nova] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:45:06.832445 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 691/1388] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:45:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:45:09.381643 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3455b14-2268-4bb7-9c9e-f5d9d430b308 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:09.382171 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3455b14-2268-4bb7-9c9e-f5d9d430b308 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:09.382171 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3455b14-2268-4bb7-9c9e-f5d9d430b308 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:09.384090 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 698/1389] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:45:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:45:09.389545 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdd378-b4da-4e35-9fdd-0400bff4d6ce None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:09.390033 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdd378-b4da-4e35-9fdd-0400bff4d6ce None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:09.390033 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdd378-b4da-4e35-9fdd-0400bff4d6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:09.408747 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-7fbdd378-b4da-4e35-9fdd-0400bff4d6ce None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:45:09.409954 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-7fbdd378-b4da-4e35-9fdd-0400bff4d6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:09.418095 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 692/1390] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:45:09.461816 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3455b14-2268-4bb7-9c9e-f5d9d430b308 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:45:09.476539 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3455b14-2268-4bb7-9c9e-f5d9d430b308 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:45:09.482177 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbed67-a72e-46cb-86fb-ab6fedfe23f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:45:09.482910 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbed67-a72e-46cb-86fb-ab6fedfe23f7 service nova] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:09.483213 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbed67-a72e-46cb-86fb-ab6fedfe23f7 service nova] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:09.483439 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbed67-a72e-46cb-86fb-ab6fedfe23f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:09.491913 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbed67-a72e-46cb-86fb-ab6fedfe23f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:45:09.493534 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbed67-a72e-46cb-86fb-ab6fedfe23f7 service nova] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:45:09.503612 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 699/1391] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:45:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:45:11.977852 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcb10b-a939-4547-989a-b75007c7b7c8 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:11.978412 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcb10b-a939-4547-989a-b75007c7b7c8 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:11.978546 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcb10b-a939-4547-989a-b75007c7b7c8 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:11.980866 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 693/1392] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:45:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:45:11.987003 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58963dc4-1c82-4e39-9235-afe8e8332772 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:11.987450 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58963dc4-1c82-4e39-9235-afe8e8332772 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:11.987858 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58963dc4-1c82-4e39-9235-afe8e8332772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:12.010919 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-58963dc4-1c82-4e39-9235-afe8e8332772 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:45:12.012477 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-58963dc4-1c82-4e39-9235-afe8e8332772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:12.022963 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 700/1393] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:45:12.068136 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcb10b-a939-4547-989a-b75007c7b7c8 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:45:12.083954 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcb10b-a939-4547-989a-b75007c7b7c8 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:45:12.089426 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5b90e-a522-4ef2-a203-5be7d4f14588 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:45:12.090064 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5b90e-a522-4ef2-a203-5be7d4f14588 service nova] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:12.090340 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5b90e-a522-4ef2-a203-5be7d4f14588 service nova] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:12.090611 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5b90e-a522-4ef2-a203-5be7d4f14588 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:12.098889 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5b90e-a522-4ef2-a203-5be7d4f14588 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:45:12.100489 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5b90e-a522-4ef2-a203-5be7d4f14588 service nova] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:45:12.110361 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 694/1394] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:45:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:45:14.575737 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b85ad-ff45-4228-8d72-4f3cb54bc95d None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:14.576433 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b85ad-ff45-4228-8d72-4f3cb54bc95d None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:14.576433 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b85ad-ff45-4228-8d72-4f3cb54bc95d None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:14.578062 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 701/1395] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:45:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:45:14.583641 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313637e-389f-4838-a592-524476d86a8f None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:14.584123 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313637e-389f-4838-a592-524476d86a8f None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:14.584239 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313637e-389f-4838-a592-524476d86a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:14.603773 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-6313637e-389f-4838-a592-524476d86a8f None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:45:14.605023 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-6313637e-389f-4838-a592-524476d86a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:14.614597 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 695/1396] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:45:14.658844 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b85ad-ff45-4228-8d72-4f3cb54bc95d None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:45:14.675099 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b85ad-ff45-4228-8d72-4f3cb54bc95d None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:45:14.681338 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2697dcad-76cf-4d5d-9fbc-80d22b7b0c3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:45:14.682001 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697dcad-76cf-4d5d-9fbc-80d22b7b0c3d service nova] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:14.682284 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697dcad-76cf-4d5d-9fbc-80d22b7b0c3d service nova] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:14.682558 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2697dcad-76cf-4d5d-9fbc-80d22b7b0c3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:14.691600 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2697dcad-76cf-4d5d-9fbc-80d22b7b0c3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:45:14.693217 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2697dcad-76cf-4d5d-9fbc-80d22b7b0c3d service nova] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:45:14.704123 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 702/1397] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:45:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:45:15.730619 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7490553-d230-494a-b4f0-a4db642680a4 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:15.731276 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7490553-d230-494a-b4f0-a4db642680a4 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:15.731276 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7490553-d230-494a-b4f0-a4db642680a4 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:15.733104 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 696/1398] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:45:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:45:15.738516 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16c825-33d2-4b2c-99db-ebbb64c9480a None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:15.738983 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16c825-33d2-4b2c-99db-ebbb64c9480a None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:15.739083 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d16c825-33d2-4b2c-99db-ebbb64c9480a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:15.758187 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-6d16c825-33d2-4b2c-99db-ebbb64c9480a None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:45:15.759279 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-6d16c825-33d2-4b2c-99db-ebbb64c9480a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:15.767691 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 703/1399] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:45:15.824185 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e3ae7-76c9-4734-9f1d-3f91fa4eb3d0 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:15.824469 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e3ae7-76c9-4734-9f1d-3f91fa4eb3d0 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:15.824735 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e3ae7-76c9-4734-9f1d-3f91fa4eb3d0 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:15.826532 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 697/1400] 10.222.0.18 () {54 vars in 961 bytes} [Tue Mar 8 13:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:45:15.831702 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd81e14-7d56-4248-9817-2745c13dc092 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:15.831989 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd81e14-7d56-4248-9817-2745c13dc092 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:15.832262 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd81e14-7d56-4248-9817-2745c13dc092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:15.883179 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-efd81e14-7d56-4248-9817-2745c13dc092 None None] MFA Rules not processed for user `731b8e066deb49e6b48804cbbe5cd6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:45:15.884370 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-efd81e14-7d56-4248-9817-2745c13dc092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:15.942562 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 704/1401] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Mar 8 13:45:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:45:15.950019 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e3ae7-76c9-4734-9f1d-3f91fa4eb3d0 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:45:15.961002 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e3ae7-76c9-4734-9f1d-3f91fa4eb3d0 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:45:15.964852 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddab28d-72dc-495e-93ef-5e176c34f0bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b8e066deb49e6b48804cbbe5cd6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:45:15.965506 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddab28d-72dc-495e-93ef-5e176c34f0bb service glance] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:15.965784 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddab28d-72dc-495e-93ef-5e176c34f0bb service glance] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:15.966048 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddab28d-72dc-495e-93ef-5e176c34f0bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:15.974981 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddab28d-72dc-495e-93ef-5e176c34f0bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:45:15.976369 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddab28d-72dc-495e-93ef-5e176c34f0bb service glance] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:45:15.985682 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 698/1402] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:45:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:45:16.398280 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ee488-0356-4b8a-a049-8393949f9c4b None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:16.398642 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ee488-0356-4b8a-a049-8393949f9c4b None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:16.399105 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ee488-0356-4b8a-a049-8393949f9c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:16.446961 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-633ee488-0356-4b8a-a049-8393949f9c4b None None] MFA Rules not processed for user `817bcd2c5f6e4bceb049eeb122d4e432`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:45:16.448137 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-633ee488-0356-4b8a-a049-8393949f9c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:16.514968 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 705/1403] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Mar 8 13:45:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:45:16.556289 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f7969-22d6-4aa4-8a5e-cd81ebf64b46 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:16.556650 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f7969-22d6-4aa4-8a5e-cd81ebf64b46 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:16.556989 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f7969-22d6-4aa4-8a5e-cd81ebf64b46 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:16.558930 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 699/1404] 10.222.0.18 () {54 vars in 942 bytes} [Tue Mar 8 13:45:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:45:16.565099 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f13e5-f56f-471d-acd0-8ea6f1666d9d None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:16.565478 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f13e5-f56f-471d-acd0-8ea6f1666d9d None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:16.565754 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9f13e5-f56f-471d-acd0-8ea6f1666d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:16.611996 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-2a9f13e5-f56f-471d-acd0-8ea6f1666d9d None None] MFA Rules not processed for user `5a0f442666d0459aa9a34fc2f91228e9`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:45:16.613090 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-2a9f13e5-f56f-471d-acd0-8ea6f1666d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:16.691604 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 706/1405] 10.222.0.18 () {58 vars in 1039 bytes} [Tue Mar 8 13:45:16 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:45:16.701501 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f7969-22d6-4aa4-8a5e-cd81ebf64b46 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:45:16.715193 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f7969-22d6-4aa4-8a5e-cd81ebf64b46 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:45:16.720295 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4bf242-097d-4875-917f-bea335b9a4ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0f442666d0459aa9a34fc2f91228e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:45:16.720922 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bf242-097d-4875-917f-bea335b9a4ec service swift] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:16.721197 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bf242-097d-4875-917f-bea335b9a4ec service swift] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:16.721500 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4bf242-097d-4875-917f-bea335b9a4ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:16.729630 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bf242-097d-4875-917f-bea335b9a4ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:45:16.731182 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4bf242-097d-4875-917f-bea335b9a4ec service swift] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:45:16.739915 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 700/1406] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Mar 8 13:45:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 13:45:17.022469 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e91a6d-04b4-453c-8d04-e19a62bace41 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:17.022931 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e91a6d-04b4-453c-8d04-e19a62bace41 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:17.023012 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e91a6d-04b4-453c-8d04-e19a62bace41 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:17.024925 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 707/1407] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:45:17.030026 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2c2f5-6fda-4398-b7a5-33d67f2d9e46 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:17.030321 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2c2f5-6fda-4398-b7a5-33d67f2d9e46 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:17.030596 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d2c2f5-6fda-4398-b7a5-33d67f2d9e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:17.048506 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-02d2c2f5-6fda-4398-b7a5-33d67f2d9e46 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:45:17.049724 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-02d2c2f5-6fda-4398-b7a5-33d67f2d9e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:17.058501 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 701/1408] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:45:17.109573 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e91a6d-04b4-453c-8d04-e19a62bace41 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:45:17.124002 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e91a6d-04b4-453c-8d04-e19a62bace41 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:45:17.129530 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39053c4a-7a52-4960-b801-c608b92a89fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:45:17.130176 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39053c4a-7a52-4960-b801-c608b92a89fe service nova] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:17.130784 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39053c4a-7a52-4960-b801-c608b92a89fe service nova] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:17.131051 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39053c4a-7a52-4960-b801-c608b92a89fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:17.141870 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39053c4a-7a52-4960-b801-c608b92a89fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:45:17.143461 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39053c4a-7a52-4960-b801-c608b92a89fe service nova] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:45:17.154269 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 708/1409] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:45:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:45:19.539585 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c743a-11a8-4693-983c-2c8ba85e9f10 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:19.540471 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c743a-11a8-4693-983c-2c8ba85e9f10 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:19.540973 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c743a-11a8-4693-983c-2c8ba85e9f10 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:19.543033 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 702/1410] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:45:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:45:19.548528 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b90758-a5e3-4733-a3e9-a5f7b07a7ee8 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:19.548969 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b90758-a5e3-4733-a3e9-a5f7b07a7ee8 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:19.549068 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b90758-a5e3-4733-a3e9-a5f7b07a7ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:19.567955 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-c1b90758-a5e3-4733-a3e9-a5f7b07a7ee8 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:45:19.569220 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-c1b90758-a5e3-4733-a3e9-a5f7b07a7ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:19.577372 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 709/1411] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:45:19.621309 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c743a-11a8-4693-983c-2c8ba85e9f10 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:45:19.640380 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c743a-11a8-4693-983c-2c8ba85e9f10 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:45:19.645702 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edd34f5-66ef-4e0c-8824-9cc23c0dfc74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:45:19.646340 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd34f5-66ef-4e0c-8824-9cc23c0dfc74 service nova] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:19.646662 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd34f5-66ef-4e0c-8824-9cc23c0dfc74 service nova] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:19.646939 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd34f5-66ef-4e0c-8824-9cc23c0dfc74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:19.655622 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd34f5-66ef-4e0c-8824-9cc23c0dfc74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:45:19.657180 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edd34f5-66ef-4e0c-8824-9cc23c0dfc74 service nova] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:45:19.667410 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 703/1412] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:45:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:45:39.421472 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f04f38-2d00-4f51-9603-aeebefa85458 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:39.422140 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f04f38-2d00-4f51-9603-aeebefa85458 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:39.422140 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f04f38-2d00-4f51-9603-aeebefa85458 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:39.423772 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 710/1413] 10.222.0.18 () {54 vars in 918 bytes} [Tue Mar 8 13:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:45:39.429038 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef347a06-a54c-4dfc-a2f9-fff5a901719e None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:39.429606 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef347a06-a54c-4dfc-a2f9-fff5a901719e None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:39.429606 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef347a06-a54c-4dfc-a2f9-fff5a901719e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:39.449874 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-ef347a06-a54c-4dfc-a2f9-fff5a901719e None None] MFA Rules not processed for user `6e2e8458589b45fa8c91b0d95840e45e`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:45:39.451032 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-ef347a06-a54c-4dfc-a2f9-fff5a901719e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:39.460490 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 704/1414] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Mar 8 13:45:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:45:39.474683 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151809e-e447-49ca-b54c-7f6868f1c37a None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:39.474965 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151809e-e447-49ca-b54c-7f6868f1c37a None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:39.475241 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151809e-e447-49ca-b54c-7f6868f1c37a None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:39.476982 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 711/1415] 10.222.0.18 () {54 vars in 918 bytes} [Tue Mar 8 13:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:45:39.481720 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3568932-88de-4ea7-bb30-a0de5d945986 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:39.482008 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3568932-88de-4ea7-bb30-a0de5d945986 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:39.482295 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3568932-88de-4ea7-bb30-a0de5d945986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:39.500942 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-c3568932-88de-4ea7-bb30-a0de5d945986 None None] MFA Rules not processed for user `21ec894123044d4382995791c74c587b`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:45:39.502156 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-c3568932-88de-4ea7-bb30-a0de5d945986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:39.512741 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 705/1416] 10.222.0.18 () {58 vars in 1015 bytes} [Tue Mar 8 13:45:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:45:42.249954 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cc320-c68e-4701-ada4-1c442b44196e None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:42.250576 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cc320-c68e-4701-ada4-1c442b44196e None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:42.250576 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21cc320-c68e-4701-ada4-1c442b44196e None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:42.252243 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:45:42.261319 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc83e7-9f1a-4a85-a8a8-0cd754bb041a None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:42.262574 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc83e7-9f1a-4a85-a8a8-0cd754bb041a None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:42.265177 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc83e7-9f1a-4a85-a8a8-0cd754bb041a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:42.287018 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-b8fc83e7-9f1a-4a85-a8a8-0cd754bb041a None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:45:42.288210 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-b8fc83e7-9f1a-4a85-a8a8-0cd754bb041a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:42.296990 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:45:42.351222 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cc320-c68e-4701-ada4-1c442b44196e None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:45:42.369720 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21cc320-c68e-4701-ada4-1c442b44196e None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:45:42.376065 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a823a-6dfa-4236-977f-89fbdafba8ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:45:42.376738 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a823a-6dfa-4236-977f-89fbdafba8ae service nova] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:42.376993 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a823a-6dfa-4236-977f-89fbdafba8ae service nova] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:42.377296 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a823a-6dfa-4236-977f-89fbdafba8ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:42.385988 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a823a-6dfa-4236-977f-89fbdafba8ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:45:42.387632 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a823a-6dfa-4236-977f-89fbdafba8ae service nova] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:45:42.397393 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 713/1419] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:45:43.738637 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3628460-62c8-40a2-8e3f-2e7a1c442fd2 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:43.739236 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3628460-62c8-40a2-8e3f-2e7a1c442fd2 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:43.739236 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3628460-62c8-40a2-8e3f-2e7a1c442fd2 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:43.741977 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 13:45:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:45:43.749184 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fead80-eac9-4b23-b1d0-18492bf34db1 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:43.749713 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fead80-eac9-4b23-b1d0-18492bf34db1 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:43.749902 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fead80-eac9-4b23-b1d0-18492bf34db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:43.769479 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-f0fead80-eac9-4b23-b1d0-18492bf34db1 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:45:43.771210 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-f0fead80-eac9-4b23-b1d0-18492bf34db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:43.781737 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 13:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:45:43.938451 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3628460-62c8-40a2-8e3f-2e7a1c442fd2 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:45:43.958036 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3628460-62c8-40a2-8e3f-2e7a1c442fd2 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:45:43.964473 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24599c90-a32c-4966-b646-cfd9bbc13f5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:45:43.965104 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24599c90-a32c-4966-b646-cfd9bbc13f5c service nova] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:43.965406 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24599c90-a32c-4966-b646-cfd9bbc13f5c service nova] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:43.965676 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24599c90-a32c-4966-b646-cfd9bbc13f5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:43.973972 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24599c90-a32c-4966-b646-cfd9bbc13f5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:45:43.975535 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24599c90-a32c-4966-b646-cfd9bbc13f5c service nova] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:45:43.985323 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 708/1422] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:45:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:45:45.305963 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197cb68-c9a3-4e06-b6ec-113df0cb34a7 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:45.306837 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197cb68-c9a3-4e06-b6ec-113df0cb34a7 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:45.306837 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197cb68-c9a3-4e06-b6ec-113df0cb34a7 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:45.309416 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 13:45:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:45:45.315346 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce929f4e-7ed6-4167-8ae3-8f442f32ad37 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:45.315777 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce929f4e-7ed6-4167-8ae3-8f442f32ad37 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:45.315941 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce929f4e-7ed6-4167-8ae3-8f442f32ad37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:45.338150 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-ce929f4e-7ed6-4167-8ae3-8f442f32ad37 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:45:45.339344 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-ce929f4e-7ed6-4167-8ae3-8f442f32ad37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:45.347945 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 13:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:45:45.498175 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197cb68-c9a3-4e06-b6ec-113df0cb34a7 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:45:45.514842 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197cb68-c9a3-4e06-b6ec-113df0cb34a7 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:45:45.520931 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39fd42-4af6-40a7-b318-5f5932f3aafc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:45:45.521588 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39fd42-4af6-40a7-b318-5f5932f3aafc service nova] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:45.521867 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39fd42-4af6-40a7-b318-5f5932f3aafc service nova] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:45.522193 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39fd42-4af6-40a7-b318-5f5932f3aafc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:45.530520 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39fd42-4af6-40a7-b318-5f5932f3aafc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:45:45.532115 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39fd42-4af6-40a7-b318-5f5932f3aafc service nova] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:45:45.541234 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 716/1425] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:45:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:45:46.815540 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbc569-47fc-4875-8686-3f3402059b6b None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:46.816099 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbc569-47fc-4875-8686-3f3402059b6b None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:46.816099 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbc569-47fc-4875-8686-3f3402059b6b None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:46.817828 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 13:45:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:45:46.823840 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1734c58-3c6c-4386-b0d5-ffc4c1cedcf2 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:46.824330 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1734c58-3c6c-4386-b0d5-ffc4c1cedcf2 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:46.824498 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1734c58-3c6c-4386-b0d5-ffc4c1cedcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:46.843348 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-e1734c58-3c6c-4386-b0d5-ffc4c1cedcf2 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:45:46.844547 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-e1734c58-3c6c-4386-b0d5-ffc4c1cedcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:46.852899 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 13:45:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:45:47.006001 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbc569-47fc-4875-8686-3f3402059b6b None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:45:47.024701 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbc569-47fc-4875-8686-3f3402059b6b None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:45:47.031186 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fb9f6-bce8-4693-ae55-cbfc5c5591ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:45:47.031846 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fb9f6-bce8-4693-ae55-cbfc5c5591ce service nova] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:47.032118 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fb9f6-bce8-4693-ae55-cbfc5c5591ce service nova] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:47.032383 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fb9f6-bce8-4693-ae55-cbfc5c5591ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:47.041063 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fb9f6-bce8-4693-ae55-cbfc5c5591ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:45:47.042710 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35fb9f6-bce8-4693-ae55-cbfc5c5591ce service nova] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:45:47.052535 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 711/1428] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:45:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:45:48.331801 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d0eb6-b453-427a-8adb-bf9b07b7e94d None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:48.332670 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d0eb6-b453-427a-8adb-bf9b07b7e94d None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:48.332670 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d0eb6-b453-427a-8adb-bf9b07b7e94d None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:48.335345 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 13:45:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:45:48.343346 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b0ec6-06bc-468d-9580-f1651b015c6d None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:48.343978 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b0ec6-06bc-468d-9580-f1651b015c6d None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:48.344097 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b0ec6-06bc-468d-9580-f1651b015c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:48.366279 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-102b0ec6-06bc-468d-9580-f1651b015c6d None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:45:48.367452 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-102b0ec6-06bc-468d-9580-f1651b015c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:48.375888 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 13:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:45:48.528290 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d0eb6-b453-427a-8adb-bf9b07b7e94d None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:45:48.545609 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d0eb6-b453-427a-8adb-bf9b07b7e94d None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:45:48.551936 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d25b4a-69b3-4ef7-80c8-a715325e7bb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:45:48.552569 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d25b4a-69b3-4ef7-80c8-a715325e7bb9 service nova] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:48.552852 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d25b4a-69b3-4ef7-80c8-a715325e7bb9 service nova] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:48.553128 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d25b4a-69b3-4ef7-80c8-a715325e7bb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:48.563840 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d25b4a-69b3-4ef7-80c8-a715325e7bb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:45:48.565717 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d25b4a-69b3-4ef7-80c8-a715325e7bb9 service nova] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:45:48.577283 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 719/1431] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:45:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:45:49.810456 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ffe95-9bf0-4827-89d3-e0898d5b9eec None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:49.811363 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ffe95-9bf0-4827-89d3-e0898d5b9eec None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:49.811363 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ffe95-9bf0-4827-89d3-e0898d5b9eec None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:49.814175 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 13:45:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:45:49.822476 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964062e-f89c-4379-ac58-e6b29c818a09 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:49.822896 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964062e-f89c-4379-ac58-e6b29c818a09 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:49.823101 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964062e-f89c-4379-ac58-e6b29c818a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:49.842742 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-7964062e-f89c-4379-ac58-e6b29c818a09 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:45:49.843951 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-7964062e-f89c-4379-ac58-e6b29c818a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:49.853379 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 13:45:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:45:50.007538 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ffe95-9bf0-4827-89d3-e0898d5b9eec None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:45:50.022287 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ffe95-9bf0-4827-89d3-e0898d5b9eec None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:45:50.029803 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfd2b9-9270-41c7-98a9-a15d928ebf7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:45:50.030721 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfd2b9-9270-41c7-98a9-a15d928ebf7e service nova] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:50.031118 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfd2b9-9270-41c7-98a9-a15d928ebf7e service nova] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:50.031499 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfd2b9-9270-41c7-98a9-a15d928ebf7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:50.043557 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bfd2b9-9270-41c7-98a9-a15d928ebf7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:45:50.045123 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bfd2b9-9270-41c7-98a9-a15d928ebf7e service nova] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:45:50.054654 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 714/1434] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:45:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:45:51.292607 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf63e9-0a67-48f9-b979-14701015a3a1 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:51.293139 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf63e9-0a67-48f9-b979-14701015a3a1 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:51.293139 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf63e9-0a67-48f9-b979-14701015a3a1 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:51.295775 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 13:45:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:45:51.301066 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec135c6-267b-4b89-b9f5-1173f12f8787 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:51.301564 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec135c6-267b-4b89-b9f5-1173f12f8787 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:51.301669 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec135c6-267b-4b89-b9f5-1173f12f8787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:51.320554 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-fec135c6-267b-4b89-b9f5-1173f12f8787 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:45:51.321763 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-fec135c6-267b-4b89-b9f5-1173f12f8787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:51.330623 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 13:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:45:51.486560 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf63e9-0a67-48f9-b979-14701015a3a1 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:45:51.501490 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf63e9-0a67-48f9-b979-14701015a3a1 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:45:51.507840 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860573ed-32ca-4906-84b4-9b954cb27011 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:45:51.508468 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860573ed-32ca-4906-84b4-9b954cb27011 service nova] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:51.508742 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860573ed-32ca-4906-84b4-9b954cb27011 service nova] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:51.509009 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860573ed-32ca-4906-84b4-9b954cb27011 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:51.517529 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860573ed-32ca-4906-84b4-9b954cb27011 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:45:51.519113 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860573ed-32ca-4906-84b4-9b954cb27011 service nova] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:45:51.528617 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 722/1437] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:45:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:45:52.763827 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ed335-627c-4715-9463-7533fda1f39a None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:52.764381 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ed335-627c-4715-9463-7533fda1f39a None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:52.764381 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ed335-627c-4715-9463-7533fda1f39a None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:52.766146 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 13:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:45:52.772206 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6169b17-46c0-495a-b9f8-6ad0009742cb None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:52.772960 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6169b17-46c0-495a-b9f8-6ad0009742cb None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:52.773141 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6169b17-46c0-495a-b9f8-6ad0009742cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:52.793858 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-a6169b17-46c0-495a-b9f8-6ad0009742cb None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:45:52.795037 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-a6169b17-46c0-495a-b9f8-6ad0009742cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:52.803735 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 13:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:45:52.952773 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ed335-627c-4715-9463-7533fda1f39a None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:45:52.968269 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ed335-627c-4715-9463-7533fda1f39a None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:45:52.974198 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54739ad4-4076-4098-8e87-1f2c81d0d0cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:45:52.974821 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54739ad4-4076-4098-8e87-1f2c81d0d0cd service nova] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:52.975095 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54739ad4-4076-4098-8e87-1f2c81d0d0cd service nova] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:52.975360 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54739ad4-4076-4098-8e87-1f2c81d0d0cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:52.984081 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54739ad4-4076-4098-8e87-1f2c81d0d0cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:45:52.985657 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54739ad4-4076-4098-8e87-1f2c81d0d0cd service nova] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:45:52.994936 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 717/1440] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:45:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:45:54.211620 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f52d43-4751-458b-b558-6f533798fac3 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:54.212193 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f52d43-4751-458b-b558-6f533798fac3 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:54.212193 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f52d43-4751-458b-b558-6f533798fac3 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:54.214028 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 13:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:45:54.222662 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1a499-dc17-42c9-baab-6007b2eae68c None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:54.223403 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1a499-dc17-42c9-baab-6007b2eae68c None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:54.223588 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc1a499-dc17-42c9-baab-6007b2eae68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:54.250646 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-2dc1a499-dc17-42c9-baab-6007b2eae68c None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:45:54.251831 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-2dc1a499-dc17-42c9-baab-6007b2eae68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:54.261530 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 13:45:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:45:54.430841 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f52d43-4751-458b-b558-6f533798fac3 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:45:54.453603 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f52d43-4751-458b-b558-6f533798fac3 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:45:54.460192 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c73964-ef19-414d-bc77-405d797af542 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:45:54.460828 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c73964-ef19-414d-bc77-405d797af542 service nova] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:54.461110 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c73964-ef19-414d-bc77-405d797af542 service nova] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:54.461385 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c73964-ef19-414d-bc77-405d797af542 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:54.469706 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c73964-ef19-414d-bc77-405d797af542 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:45:54.471246 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c73964-ef19-414d-bc77-405d797af542 service nova] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:45:54.480887 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 725/1443] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:45:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:45:56.658001 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996c030-3837-440a-be59-108991d35865 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:56.658525 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996c030-3837-440a-be59-108991d35865 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:56.658525 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996c030-3837-440a-be59-108991d35865 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:56.661627 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:45:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:45:56.669616 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ac821-12dc-4306-bd6e-66be217afdbc None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:56.670001 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ac821-12dc-4306-bd6e-66be217afdbc None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:56.670165 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ac821-12dc-4306-bd6e-66be217afdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:56.689136 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-549ac821-12dc-4306-bd6e-66be217afdbc None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:45:56.690377 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-549ac821-12dc-4306-bd6e-66be217afdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:56.699431 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:45:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:45:56.740336 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996c030-3837-440a-be59-108991d35865 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:45:56.756485 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996c030-3837-440a-be59-108991d35865 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:45:56.761634 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d7486-a079-4d9e-8ffc-55e77b64d3aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:45:56.762556 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d7486-a079-4d9e-8ffc-55e77b64d3aa service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:56.762866 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d7486-a079-4d9e-8ffc-55e77b64d3aa service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:56.763388 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d7486-a079-4d9e-8ffc-55e77b64d3aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:56.773817 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d7486-a079-4d9e-8ffc-55e77b64d3aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:45:56.775419 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d7486-a079-4d9e-8ffc-55e77b64d3aa service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:45:56.785200 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 720/1446] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:45:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:45:59.180960 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f7bee-19f6-47db-99ad-b81bdf4469bf None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:59.181588 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f7bee-19f6-47db-99ad-b81bdf4469bf None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:59.181588 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f7bee-19f6-47db-99ad-b81bdf4469bf None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:59.183375 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:45:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:45:59.188690 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc02579-d696-4a99-a4a5-17e0da5f52de None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:59.189159 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc02579-d696-4a99-a4a5-17e0da5f52de None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:59.189264 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc02579-d696-4a99-a4a5-17e0da5f52de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:59.207383 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-6fc02579-d696-4a99-a4a5-17e0da5f52de None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:45:59.208529 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-6fc02579-d696-4a99-a4a5-17e0da5f52de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:45:59.217188 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:45:59.258285 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f7bee-19f6-47db-99ad-b81bdf4469bf None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:45:59.277227 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f7bee-19f6-47db-99ad-b81bdf4469bf None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:45:59.281613 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a823f-c270-422e-aaf2-41a986aaef2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:45:59.282280 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a823f-c270-422e-aaf2-41a986aaef2f service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:45:59.282560 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a823f-c270-422e-aaf2-41a986aaef2f service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:45:59.282890 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a823f-c270-422e-aaf2-41a986aaef2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:45:59.292775 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a823f-c270-422e-aaf2-41a986aaef2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:45:59.294286 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a823f-c270-422e-aaf2-41a986aaef2f service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:45:59.304197 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 728/1449] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:45:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:46:01.903156 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2e867-9576-486c-895b-40f621f1791f None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:01.904089 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2e867-9576-486c-895b-40f621f1791f None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:01.904089 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2e867-9576-486c-895b-40f621f1791f None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:01.906870 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:46:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:46:01.913328 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa240f-8978-467c-86cc-d20e37b53bde None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:01.914132 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa240f-8978-467c-86cc-d20e37b53bde None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:01.914317 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa240f-8978-467c-86cc-d20e37b53bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:01.935870 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-7caa240f-8978-467c-86cc-d20e37b53bde None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:46:01.937083 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-7caa240f-8978-467c-86cc-d20e37b53bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:46:01.948330 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:46:01.990257 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2e867-9576-486c-895b-40f621f1791f None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:46:02.008020 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2e867-9576-486c-895b-40f621f1791f None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:46:02.013331 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daec22-d764-4b13-ab8b-bdf56131cab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:46:02.014000 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daec22-d764-4b13-ab8b-bdf56131cab8 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:02.014282 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daec22-d764-4b13-ab8b-bdf56131cab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:02.014555 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daec22-d764-4b13-ab8b-bdf56131cab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:02.024302 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84daec22-d764-4b13-ab8b-bdf56131cab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:46:02.025782 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84daec22-d764-4b13-ab8b-bdf56131cab8 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:46:02.035814 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 723/1452] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:46:04.456346 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbbd21-0e1a-4998-834d-b517458c147b None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:04.457223 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbbd21-0e1a-4998-834d-b517458c147b None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:04.457223 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbbd21-0e1a-4998-834d-b517458c147b None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:04.460033 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:46:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:46:04.465629 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893efac-0ed5-4126-ba03-68d1cf98613e None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:04.466052 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893efac-0ed5-4126-ba03-68d1cf98613e None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:04.466164 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893efac-0ed5-4126-ba03-68d1cf98613e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:04.486901 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-f893efac-0ed5-4126-ba03-68d1cf98613e None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:46:04.488087 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f893efac-0ed5-4126-ba03-68d1cf98613e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:46:04.497435 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:46:04.538045 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbbd21-0e1a-4998-834d-b517458c147b None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:46:04.553116 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dbbd21-0e1a-4998-834d-b517458c147b None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:46:04.558996 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4be662a-f3ae-452a-adcf-b933a80f87d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:46:04.559625 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be662a-f3ae-452a-adcf-b933a80f87d2 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:04.559901 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be662a-f3ae-452a-adcf-b933a80f87d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:04.560164 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4be662a-f3ae-452a-adcf-b933a80f87d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:04.569791 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be662a-f3ae-452a-adcf-b933a80f87d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:46:04.571201 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4be662a-f3ae-452a-adcf-b933a80f87d2 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:46:04.581246 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 731/1455] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:46:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:46:06.894359 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298a5ec-038e-491b-9799-b0c315619c8f None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:06.895252 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298a5ec-038e-491b-9799-b0c315619c8f None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:06.895252 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298a5ec-038e-491b-9799-b0c315619c8f None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:06.898037 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:46:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:46:06.903607 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd382c-4e57-48d1-acea-10b03c727c30 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:06.904049 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd382c-4e57-48d1-acea-10b03c727c30 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:06.904152 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd382c-4e57-48d1-acea-10b03c727c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:06.922131 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-facd382c-4e57-48d1-acea-10b03c727c30 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:46:06.923312 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-facd382c-4e57-48d1-acea-10b03c727c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:46:06.931929 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:46:06.969566 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298a5ec-038e-491b-9799-b0c315619c8f None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:46:06.981941 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298a5ec-038e-491b-9799-b0c315619c8f None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:46:06.986301 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a0ec6-153b-4ede-b1fb-a46780e24915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:46:06.986936 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a0ec6-153b-4ede-b1fb-a46780e24915 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:06.987218 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a0ec6-153b-4ede-b1fb-a46780e24915 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:06.987487 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a0ec6-153b-4ede-b1fb-a46780e24915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:06.996863 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a0ec6-153b-4ede-b1fb-a46780e24915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:46:06.998326 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a0ec6-153b-4ede-b1fb-a46780e24915 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:46:07.008171 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 726/1458] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:46:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:46:09.410274 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4c3c4-3341-484e-9eae-8dbc87a6ce28 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:09.411084 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4c3c4-3341-484e-9eae-8dbc87a6ce28 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:09.411084 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4c3c4-3341-484e-9eae-8dbc87a6ce28 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:09.413941 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:46:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:46:09.420431 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933dc6f-d73d-4a0e-9a53-5af79c39832b None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:09.420901 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933dc6f-d73d-4a0e-9a53-5af79c39832b None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:09.421008 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933dc6f-d73d-4a0e-9a53-5af79c39832b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:09.439031 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-d933dc6f-d73d-4a0e-9a53-5af79c39832b None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:46:09.440193 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-d933dc6f-d73d-4a0e-9a53-5af79c39832b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:46:09.448535 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:46:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:46:09.487998 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4c3c4-3341-484e-9eae-8dbc87a6ce28 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:46:09.499428 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4c3c4-3341-484e-9eae-8dbc87a6ce28 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:46:09.503903 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2086e-4849-49a8-8aaa-5eedc03d7e57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:46:09.504046 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2086e-4849-49a8-8aaa-5eedc03d7e57 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:09.504315 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2086e-4849-49a8-8aaa-5eedc03d7e57 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:09.504635 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2086e-4849-49a8-8aaa-5eedc03d7e57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:09.513918 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2086e-4849-49a8-8aaa-5eedc03d7e57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:46:09.515358 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2086e-4849-49a8-8aaa-5eedc03d7e57 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:46:09.524640 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 734/1461] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:46:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:46:11.849923 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15d473-2b23-4979-8da6-eb48192ce60f None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:11.850468 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15d473-2b23-4979-8da6-eb48192ce60f None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:11.850468 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15d473-2b23-4979-8da6-eb48192ce60f None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:11.852186 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:46:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:46:11.858727 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2e198-be0d-40bb-b83c-39ea65c36e7c None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:11.859427 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2e198-be0d-40bb-b83c-39ea65c36e7c None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:11.859575 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2e198-be0d-40bb-b83c-39ea65c36e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:11.886228 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-48e2e198-be0d-40bb-b83c-39ea65c36e7c None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:46:11.887414 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-48e2e198-be0d-40bb-b83c-39ea65c36e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:46:11.895787 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:46:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:46:11.932519 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15d473-2b23-4979-8da6-eb48192ce60f None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:46:11.943787 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15d473-2b23-4979-8da6-eb48192ce60f None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:46:11.947976 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723fa962-8058-49ce-ba1d-5292d143fb50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:46:11.948609 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fa962-8058-49ce-ba1d-5292d143fb50 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:11.948883 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fa962-8058-49ce-ba1d-5292d143fb50 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:11.949151 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723fa962-8058-49ce-ba1d-5292d143fb50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:11.958521 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723fa962-8058-49ce-ba1d-5292d143fb50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:46:11.959933 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723fa962-8058-49ce-ba1d-5292d143fb50 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:46:11.969334 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 729/1464] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:46:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:46:14.290199 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d131e-487d-4072-8a58-8aaa9b9a3742 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:14.290797 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d131e-487d-4072-8a58-8aaa9b9a3742 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:14.290797 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d131e-487d-4072-8a58-8aaa9b9a3742 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:14.292517 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:46:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:46:14.299014 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40622c06-7015-487f-937a-f71ad13c3b47 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:14.299474 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40622c06-7015-487f-937a-f71ad13c3b47 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:14.299569 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40622c06-7015-487f-937a-f71ad13c3b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:14.320619 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-40622c06-7015-487f-937a-f71ad13c3b47 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:46:14.321841 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-40622c06-7015-487f-937a-f71ad13c3b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:46:14.331073 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:46:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:46:14.370727 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d131e-487d-4072-8a58-8aaa9b9a3742 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:46:14.384330 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d131e-487d-4072-8a58-8aaa9b9a3742 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:46:14.389394 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7705b2-f69d-4164-bc3a-daeca92f3780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:46:14.390014 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7705b2-f69d-4164-bc3a-daeca92f3780 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:14.390310 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7705b2-f69d-4164-bc3a-daeca92f3780 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:14.390549 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7705b2-f69d-4164-bc3a-daeca92f3780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:14.400766 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7705b2-f69d-4164-bc3a-daeca92f3780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:46:14.402193 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7705b2-f69d-4164-bc3a-daeca92f3780 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:46:14.411611 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 737/1467] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:46:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:46:16.674650 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fafc95-f507-448f-a1de-d8383bcab38a None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:16.675240 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fafc95-f507-448f-a1de-d8383bcab38a None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:16.675240 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fafc95-f507-448f-a1de-d8383bcab38a None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:16.678142 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:46:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:46:16.685649 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb508-a504-4542-826a-7ff6303f8cf5 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:16.686069 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb508-a504-4542-826a-7ff6303f8cf5 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:16.686219 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bb508-a504-4542-826a-7ff6303f8cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:16.715879 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-b90bb508-a504-4542-826a-7ff6303f8cf5 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:46:16.717104 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-b90bb508-a504-4542-826a-7ff6303f8cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:46:16.728999 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:46:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:46:16.770631 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fafc95-f507-448f-a1de-d8383bcab38a None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:46:16.783621 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fafc95-f507-448f-a1de-d8383bcab38a None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:46:16.788170 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ee2d0-9c3b-4eb9-977d-6f3bcb8689c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:46:16.788804 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ee2d0-9c3b-4eb9-977d-6f3bcb8689c5 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:16.789085 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ee2d0-9c3b-4eb9-977d-6f3bcb8689c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:16.789385 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ee2d0-9c3b-4eb9-977d-6f3bcb8689c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:16.800212 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ee2d0-9c3b-4eb9-977d-6f3bcb8689c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:46:16.801682 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ee2d0-9c3b-4eb9-977d-6f3bcb8689c5 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:46:16.811568 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 732/1470] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:46:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:46:19.139754 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa05659-518a-4496-bae2-355a42b4e9ef None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:19.140351 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa05659-518a-4496-bae2-355a42b4e9ef None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:19.140351 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa05659-518a-4496-bae2-355a42b4e9ef None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:19.142127 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 739/1471] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:46:19.148544 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441fcf7-23be-460c-aaae-faf5a4e541a5 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:19.149257 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441fcf7-23be-460c-aaae-faf5a4e541a5 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:19.149463 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4441fcf7-23be-460c-aaae-faf5a4e541a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:19.170310 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-4441fcf7-23be-460c-aaae-faf5a4e541a5 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:46:19.171481 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-4441fcf7-23be-460c-aaae-faf5a4e541a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:46:19.179719 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 733/1472] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:46:19.219931 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa05659-518a-4496-bae2-355a42b4e9ef None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:46:19.235761 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa05659-518a-4496-bae2-355a42b4e9ef None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:46:19.240481 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505c5c5-26bd-45b2-a850-7fce19e39215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:46:19.241118 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505c5c5-26bd-45b2-a850-7fce19e39215 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:19.241376 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505c5c5-26bd-45b2-a850-7fce19e39215 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:19.241695 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505c5c5-26bd-45b2-a850-7fce19e39215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:19.252758 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505c5c5-26bd-45b2-a850-7fce19e39215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:46:19.254202 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505c5c5-26bd-45b2-a850-7fce19e39215 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:46:19.264470 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 740/1473] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:46:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:46:39.636669 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596c147-cd01-4410-96f8-120b63938a59 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:39.637639 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596c147-cd01-4410-96f8-120b63938a59 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:39.637639 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596c147-cd01-4410-96f8-120b63938a59 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:39.640504 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 734/1474] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:46:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:46:39.649409 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82969734-4013-4392-8da1-8ff3f1bef6c3 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:39.650143 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82969734-4013-4392-8da1-8ff3f1bef6c3 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:39.650428 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82969734-4013-4392-8da1-8ff3f1bef6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:39.674172 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-82969734-4013-4392-8da1-8ff3f1bef6c3 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:46:39.675382 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-82969734-4013-4392-8da1-8ff3f1bef6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:46:39.684924 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 741/1475] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:46:39.740414 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7283021-eec6-44cb-a99c-27b7ec5a7bfe None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:39.740703 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7283021-eec6-44cb-a99c-27b7ec5a7bfe None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:39.740962 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7283021-eec6-44cb-a99c-27b7ec5a7bfe None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:39.742850 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 735/1476] 10.222.0.18 () {54 vars in 961 bytes} [Tue Mar 8 13:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:46:39.748491 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a1bd8-1f61-47bf-acad-d09013cb0764 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:39.748827 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a1bd8-1f61-47bf-acad-d09013cb0764 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:39.749566 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84a1bd8-1f61-47bf-acad-d09013cb0764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:39.771102 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-e84a1bd8-1f61-47bf-acad-d09013cb0764 None None] MFA Rules not processed for user `731b8e066deb49e6b48804cbbe5cd6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:46:39.772277 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-e84a1bd8-1f61-47bf-acad-d09013cb0764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:46:39.779761 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 742/1477] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Mar 8 13:46:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:46:39.787276 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7283021-eec6-44cb-a99c-27b7ec5a7bfe None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:46:39.799478 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7283021-eec6-44cb-a99c-27b7ec5a7bfe None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:46:39.803952 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9b44b-5468-44da-aa11-5ff01a41ce1e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b8e066deb49e6b48804cbbe5cd6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:46:39.804656 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9b44b-5468-44da-aa11-5ff01a41ce1e service glance] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:39.804936 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9b44b-5468-44da-aa11-5ff01a41ce1e service glance] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:39.805204 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9b44b-5468-44da-aa11-5ff01a41ce1e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:39.815366 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9b44b-5468-44da-aa11-5ff01a41ce1e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:46:39.816774 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9b44b-5468-44da-aa11-5ff01a41ce1e service glance] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:46:39.826578 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 736/1478] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:46:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:46:42.174200 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0e968-e3f8-44ff-9972-ae1cd72daf86 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:42.175120 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0e968-e3f8-44ff-9972-ae1cd72daf86 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:42.175120 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0e968-e3f8-44ff-9972-ae1cd72daf86 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:42.178029 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 743/1479] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:46:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:46:42.185005 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5f461-b6d1-4d28-90fd-1dd7b71b507d None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:42.185458 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5f461-b6d1-4d28-90fd-1dd7b71b507d None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:42.185580 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5f461-b6d1-4d28-90fd-1dd7b71b507d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:42.212638 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-f2f5f461-b6d1-4d28-90fd-1dd7b71b507d None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:46:42.213854 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f2f5f461-b6d1-4d28-90fd-1dd7b71b507d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:46:42.223207 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 737/1480] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:46:42.246332 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0e968-e3f8-44ff-9972-ae1cd72daf86 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:46:42.261143 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0e968-e3f8-44ff-9972-ae1cd72daf86 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:46:42.267282 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b09a66-1d95-48f8-9b09-1874cbb6641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:46:42.267924 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b09a66-1d95-48f8-9b09-1874cbb6641a admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:42.268212 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b09a66-1d95-48f8-9b09-1874cbb6641a admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:42.268489 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b09a66-1d95-48f8-9b09-1874cbb6641a admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:42.269229 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b09a66-1d95-48f8-9b09-1874cbb6641a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:46:42.271153 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b09a66-1d95-48f8-9b09-1874cbb6641a admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:46:42.284594 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 744/1481] 10.222.0.18 () {56 vars in 1108 bytes} [Tue Mar 8 13:46:42 2022] GET /identity/v3/projects => generated 2553 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:46:44.578778 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed0f4a-3e1d-4d3f-af00-46d1c53b6d44 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:44.579323 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed0f4a-3e1d-4d3f-af00-46d1c53b6d44 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:44.579323 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed0f4a-3e1d-4d3f-af00-46d1c53b6d44 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:44.582213 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 738/1482] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:46:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:46:44.590496 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c603f70-30a8-425f-a82c-165f0202a0f9 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:44.590961 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c603f70-30a8-425f-a82c-165f0202a0f9 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:44.591067 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c603f70-30a8-425f-a82c-165f0202a0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:44.610217 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-8c603f70-30a8-425f-a82c-165f0202a0f9 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:46:44.611404 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-8c603f70-30a8-425f-a82c-165f0202a0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:46:44.619951 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 745/1483] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:46:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:46:44.661248 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed0f4a-3e1d-4d3f-af00-46d1c53b6d44 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:46:44.677208 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed0f4a-3e1d-4d3f-af00-46d1c53b6d44 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:46:44.683311 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f54cbe7-73da-459a-8b8a-879565083260 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:46:44.683941 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54cbe7-73da-459a-8b8a-879565083260 service nova] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:44.684223 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54cbe7-73da-459a-8b8a-879565083260 service nova] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:44.684497 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f54cbe7-73da-459a-8b8a-879565083260 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:44.693328 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54cbe7-73da-459a-8b8a-879565083260 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:46:44.694991 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f54cbe7-73da-459a-8b8a-879565083260 service nova] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:46:44.704493 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 739/1484] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:46:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:46:47.120154 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f7019-7b2c-4f12-8653-5f0839f04a49 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:47.120996 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f7019-7b2c-4f12-8653-5f0839f04a49 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:47.120996 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f7019-7b2c-4f12-8653-5f0839f04a49 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:47.124247 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 746/1485] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:46:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:46:47.132641 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dec46f-e352-4015-9fc7-4ebf5b940242 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:47.133062 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dec46f-e352-4015-9fc7-4ebf5b940242 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:47.133193 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dec46f-e352-4015-9fc7-4ebf5b940242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:47.152090 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-06dec46f-e352-4015-9fc7-4ebf5b940242 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:46:47.153270 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-06dec46f-e352-4015-9fc7-4ebf5b940242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:46:47.162818 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 740/1486] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:46:47.204480 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f7019-7b2c-4f12-8653-5f0839f04a49 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:46:47.216910 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f7019-7b2c-4f12-8653-5f0839f04a49 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:46:47.221474 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d42e7-4486-44ed-8d54-840d3ae28f3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:46:47.222098 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d42e7-4486-44ed-8d54-840d3ae28f3f service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:47.222373 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d42e7-4486-44ed-8d54-840d3ae28f3f service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:47.222640 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d42e7-4486-44ed-8d54-840d3ae28f3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:47.232002 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d42e7-4486-44ed-8d54-840d3ae28f3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:46:47.233459 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d42e7-4486-44ed-8d54-840d3ae28f3f service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:46:47.243042 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 747/1487] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:46:49.545417 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ef2a3-04f0-47b5-a441-6ee932ba4256 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:49.545925 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ef2a3-04f0-47b5-a441-6ee932ba4256 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:49.546031 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ef2a3-04f0-47b5-a441-6ee932ba4256 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:49.547769 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 741/1488] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:46:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:46:49.553385 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfcef0-d872-49d9-b2b8-436ad4430a71 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:49.553829 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfcef0-d872-49d9-b2b8-436ad4430a71 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:49.553921 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cfcef0-d872-49d9-b2b8-436ad4430a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:49.573249 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-54cfcef0-d872-49d9-b2b8-436ad4430a71 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:46:49.574472 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-54cfcef0-d872-49d9-b2b8-436ad4430a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:46:49.582557 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 748/1489] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:46:49.620788 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ef2a3-04f0-47b5-a441-6ee932ba4256 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:46:49.638022 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ef2a3-04f0-47b5-a441-6ee932ba4256 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:46:49.643498 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12eec88-2d91-4a43-aea0-b7cb1c58c9d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:46:49.644164 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12eec88-2d91-4a43-aea0-b7cb1c58c9d3 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:49.644440 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12eec88-2d91-4a43-aea0-b7cb1c58c9d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:49.644710 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12eec88-2d91-4a43-aea0-b7cb1c58c9d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:49.655311 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12eec88-2d91-4a43-aea0-b7cb1c58c9d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:46:49.656777 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12eec88-2d91-4a43-aea0-b7cb1c58c9d3 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:46:49.666251 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 742/1490] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:46:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:46:52.059657 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba960f-eff5-4c96-a0ba-9afd66e6f229 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:52.060492 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba960f-eff5-4c96-a0ba-9afd66e6f229 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:52.060492 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba960f-eff5-4c96-a0ba-9afd66e6f229 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:52.063319 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 749/1491] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:46:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:46:52.069659 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27673e45-a1fe-4a96-b28e-be34c2cee124 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:52.070126 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27673e45-a1fe-4a96-b28e-be34c2cee124 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:52.070281 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27673e45-a1fe-4a96-b28e-be34c2cee124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:52.089807 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-27673e45-a1fe-4a96-b28e-be34c2cee124 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:46:52.091043 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-27673e45-a1fe-4a96-b28e-be34c2cee124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:46:52.101445 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 743/1492] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:46:52.142221 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba960f-eff5-4c96-a0ba-9afd66e6f229 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:46:52.153137 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba960f-eff5-4c96-a0ba-9afd66e6f229 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:46:52.156821 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ddaa8-8771-43ff-a696-307b5cf38e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:46:52.157471 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ddaa8-8771-43ff-a696-307b5cf38e15 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:52.157752 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ddaa8-8771-43ff-a696-307b5cf38e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:52.158016 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ddaa8-8771-43ff-a696-307b5cf38e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:52.166826 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ddaa8-8771-43ff-a696-307b5cf38e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:46:52.168246 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ddaa8-8771-43ff-a696-307b5cf38e15 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:46:52.177311 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 750/1493] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:46:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:46:54.654933 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b52d1-75a4-4266-b718-1785966d923a None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:54.655492 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b52d1-75a4-4266-b718-1785966d923a None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:54.655492 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b52d1-75a4-4266-b718-1785966d923a None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:54.657285 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 744/1494] 10.222.0.18 () {54 vars in 926 bytes} [Tue Mar 8 13:46:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:46:54.663190 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e2ab7-956c-4204-a37c-e53b4f6b7fa3 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:54.663727 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e2ab7-956c-4204-a37c-e53b4f6b7fa3 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:54.663727 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e2ab7-956c-4204-a37c-e53b4f6b7fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:54.684123 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-a32e2ab7-956c-4204-a37c-e53b4f6b7fa3 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:46:54.685326 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-a32e2ab7-956c-4204-a37c-e53b4f6b7fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:46:54.694310 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 751/1495] 10.222.0.18 () {58 vars in 1023 bytes} [Tue Mar 8 13:46:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:46:54.733340 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b52d1-75a4-4266-b718-1785966d923a None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:46:54.746739 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b52d1-75a4-4266-b718-1785966d923a None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:46:54.751046 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c1afa-9ec1-4a80-afbe-16020b9f41e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:46:54.751695 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c1afa-9ec1-4a80-afbe-16020b9f41e8 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:46:54.751969 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c1afa-9ec1-4a80-afbe-16020b9f41e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:46:54.752248 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c1afa-9ec1-4a80-afbe-16020b9f41e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:46:54.762099 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c1afa-9ec1-4a80-afbe-16020b9f41e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:46:54.763497 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c1afa-9ec1-4a80-afbe-16020b9f41e8 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:46:54.773740 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 745/1496] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:46:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:48:19.873857 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d492467-ebe4-40f1-9d05-4e2683a565cf None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:48:19.874455 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d492467-ebe4-40f1-9d05-4e2683a565cf None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:48:19.874455 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d492467-ebe4-40f1-9d05-4e2683a565cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:48:19.894415 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-8d492467-ebe4-40f1-9d05-4e2683a565cf None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:48:19.895606 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-8d492467-ebe4-40f1-9d05-4e2683a565cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:48:19.904848 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 752/1497] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:48:19.914162 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d83f2-a7ad-4321-9708-730cca1ff744 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:48:19.914694 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d83f2-a7ad-4321-9708-730cca1ff744 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:48:19.914694 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d83f2-a7ad-4321-9708-730cca1ff744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:48:19.934001 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-c10d83f2-a7ad-4321-9708-730cca1ff744 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:48:19.935285 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-c10d83f2-a7ad-4321-9708-730cca1ff744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:48:19.944690 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 746/1498] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:48:19.952515 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d492467-ebe4-40f1-9d05-4e2683a565cf None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:48:19.963494 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d492467-ebe4-40f1-9d05-4e2683a565cf None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:48:19.970268 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864bdd6-c464-4871-b61b-7fdbfee50f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:48:19.971112 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864bdd6-c464-4871-b61b-7fdbfee50f90 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:48:19.971401 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864bdd6-c464-4871-b61b-7fdbfee50f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:48:19.971648 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e864bdd6-c464-4871-b61b-7fdbfee50f90 admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:48:19.972392 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864bdd6-c464-4871-b61b-7fdbfee50f90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:48:19.972699 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864bdd6-c464-4871-b61b-7fdbfee50f90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:48:19.973755 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING py.warnings [None req-e864bdd6-c464-4871-b61b-7fdbfee50f90 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:48:19.973755 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: warnings.warn(msg) Mar 08 13:48:19.973755 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: Mar 08 13:48:19.974647 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e864bdd6-c464-4871-b61b-7fdbfee50f90 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:48:19.989525 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 753/1499] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:48:19.997935 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d83f2-a7ad-4321-9708-730cca1ff744 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:48:20.008308 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d83f2-a7ad-4321-9708-730cca1ff744 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:48:20.014666 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e816a5b-512d-4742-b9dd-a9e6098e7274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:48:20.015613 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e816a5b-512d-4742-b9dd-a9e6098e7274 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:48:20.016107 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e816a5b-512d-4742-b9dd-a9e6098e7274 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:48:20.016380 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e816a5b-512d-4742-b9dd-a9e6098e7274 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:48:20.017062 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e816a5b-512d-4742-b9dd-a9e6098e7274 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:48:20.018932 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING py.warnings [None req-5e816a5b-512d-4742-b9dd-a9e6098e7274 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:48:20.018932 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: warnings.warn(msg) Mar 08 13:48:20.018932 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: Mar 08 13:48:20.020138 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e816a5b-512d-4742-b9dd-a9e6098e7274 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:48:20.058024 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 747/1500] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:48:19 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:48:20.064501 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864bdd6-c464-4871-b61b-7fdbfee50f90 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:48:20.080198 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e864bdd6-c464-4871-b61b-7fdbfee50f90 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:48:20.136725 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a52aa4-9747-479b-b5f4-428ac6d466fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:48:20.137302 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a52aa4-9747-479b-b5f4-428ac6d466fe admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:48:20.137669 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a52aa4-9747-479b-b5f4-428ac6d466fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:48:20.137943 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a52aa4-9747-479b-b5f4-428ac6d466fe admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:48:20.138624 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a52aa4-9747-479b-b5f4-428ac6d466fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:48:20.139645 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING py.warnings [None req-82a52aa4-9747-479b-b5f4-428ac6d466fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:48:20.139645 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: warnings.warn(msg) Mar 08 13:48:20.139645 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: Mar 08 13:48:20.140855 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a52aa4-9747-479b-b5f4-428ac6d466fe admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:48:20.163410 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 754/1501] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:48:20 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:48:20.167876 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e816a5b-512d-4742-b9dd-a9e6098e7274 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:48:20.178644 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e816a5b-512d-4742-b9dd-a9e6098e7274 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:48:20.183478 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5eb37-8ed5-4932-be3c-102f7d942d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:48:20.184124 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5eb37-8ed5-4932-be3c-102f7d942d42 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:48:20.184399 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5eb37-8ed5-4932-be3c-102f7d942d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:48:20.184666 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5eb37-8ed5-4932-be3c-102f7d942d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:48:20.185416 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5eb37-8ed5-4932-be3c-102f7d942d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:48:20.186414 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING py.warnings [None req-77f5eb37-8ed5-4932-be3c-102f7d942d42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:48:20.186414 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: warnings.warn(msg) Mar 08 13:48:20.186414 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: Mar 08 13:48:20.187294 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f5eb37-8ed5-4932-be3c-102f7d942d42 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:48:20.199789 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 748/1502] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:48:20.203803 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a52aa4-9747-479b-b5f4-428ac6d466fe admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:48:20.214103 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a52aa4-9747-479b-b5f4-428ac6d466fe admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:48:20.219638 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d83e5-9c13-40d9-b17a-eba29f1105c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:48:20.220282 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d83e5-9c13-40d9-b17a-eba29f1105c6 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:48:20.220564 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d83e5-9c13-40d9-b17a-eba29f1105c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:48:20.220854 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d83e5-9c13-40d9-b17a-eba29f1105c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:48:20.221612 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d83e5-9c13-40d9-b17a-eba29f1105c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:48:20.222634 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING py.warnings [None req-a20d83e5-9c13-40d9-b17a-eba29f1105c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:48:20.222634 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: warnings.warn(msg) Mar 08 13:48:20.222634 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: Mar 08 13:48:20.223578 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d83e5-9c13-40d9-b17a-eba29f1105c6 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:48:20.237381 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 755/1503] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:48:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:48:20.241994 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5eb37-8ed5-4932-be3c-102f7d942d42 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:48:20.252214 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f5eb37-8ed5-4932-be3c-102f7d942d42 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:48:20.257738 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af600b2d-6b50-4385-a381-9b56b7d67475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:48:20.258656 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af600b2d-6b50-4385-a381-9b56b7d67475 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:48:20.258935 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af600b2d-6b50-4385-a381-9b56b7d67475 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:48:20.259206 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af600b2d-6b50-4385-a381-9b56b7d67475 admin admin] PATH_INFO: `/v3/projects/bb023ba58608485ba85f897954708b7a/users/8a835d34d1ae4dbda14eb25b92653de3/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:48:20.274765 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af600b2d-6b50-4385-a381-9b56b7d67475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb023ba58608485ba85f897954708b7a, user_id=8a835d34d1ae4dbda14eb25b92653de3, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:48:20.275929 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING py.warnings [None req-af600b2d-6b50-4385-a381-9b56b7d67475 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:48:20.275929 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: warnings.warn(msg) Mar 08 13:48:20.275929 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: Mar 08 13:48:20.277856 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af600b2d-6b50-4385-a381-9b56b7d67475 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:48:20.292842 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 749/1504] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:48:20 2022] PUT /identity/v3/projects/bb023ba58608485ba85f897954708b7a/users/8a835d34d1ae4dbda14eb25b92653de3/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:48:20.304596 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd67137-3d2c-4864-a8a1-7b97bdf8e723 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:48:20.304972 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd67137-3d2c-4864-a8a1-7b97bdf8e723 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:48:20.305191 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd67137-3d2c-4864-a8a1-7b97bdf8e723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:48:20.333909 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-4cd67137-3d2c-4864-a8a1-7b97bdf8e723 None None] MFA Rules not processed for user `8a835d34d1ae4dbda14eb25b92653de3`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:48:20.335098 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-4cd67137-3d2c-4864-a8a1-7b97bdf8e723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:48:20.405670 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 756/1505] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:48:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:48:20.417308 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af600b2d-6b50-4385-a381-9b56b7d67475 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:48:20.487730 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af600b2d-6b50-4385-a381-9b56b7d67475 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:48:20.493999 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66adbf-e9f0-4b28-9d5c-6c2f0b23c2a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:48:20.494668 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66adbf-e9f0-4b28-9d5c-6c2f0b23c2a9 service nova] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:48:20.494942 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66adbf-e9f0-4b28-9d5c-6c2f0b23c2a9 service nova] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:48:20.495219 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66adbf-e9f0-4b28-9d5c-6c2f0b23c2a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:48:20.503682 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66adbf-e9f0-4b28-9d5c-6c2f0b23c2a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:48:20.505253 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c66adbf-e9f0-4b28-9d5c-6c2f0b23c2a9 service nova] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:48:20.514676 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 750/1506] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:48:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:48:20.586641 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadd779-bab9-41a2-bc0e-67ee1c9bc033 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:48:20.586927 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadd779-bab9-41a2-bc0e-67ee1c9bc033 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:48:20.587200 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fadd779-bab9-41a2-bc0e-67ee1c9bc033 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:48:20.588912 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 757/1507] 10.222.0.18 () {52 vars in 829 bytes} [Tue Mar 8 13:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:48:20.592732 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66adbf-e9f0-4b28-9d5c-6c2f0b23c2a9 service nova] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:48:20.658977 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66adbf-e9f0-4b28-9d5c-6c2f0b23c2a9 service nova] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:48:20.665734 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766da570-9cec-445e-8920-d4e32bd278f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:48:20.667003 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766da570-9cec-445e-8920-d4e32bd278f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:48:20.667357 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766da570-9cec-445e-8920-d4e32bd278f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:48:20.667699 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766da570-9cec-445e-8920-d4e32bd278f7 admin admin] PATH_INFO: `/v3/users/8a835d34d1ae4dbda14eb25b92653de3` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:48:20.669811 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766da570-9cec-445e-8920-d4e32bd278f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a835d34d1ae4dbda14eb25b92653de3)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:48:20.671349 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING py.warnings [None req-766da570-9cec-445e-8920-d4e32bd278f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:48:20.671349 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: warnings.warn(msg) Mar 08 13:48:20.671349 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: Mar 08 13:48:20.672975 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766da570-9cec-445e-8920-d4e32bd278f7 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:48:20.743312 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-766da570-9cec-445e-8920-d4e32bd278f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a835d34d1ae4dbda14eb25b92653de3'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:48:20.744018 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-766da570-9cec-445e-8920-d4e32bd278f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a835d34d1ae4dbda14eb25b92653de3'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:48:20.755803 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-766da570-9cec-445e-8920-d4e32bd278f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a835d34d1ae4dbda14eb25b92653de3'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:48:20.774988 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-766da570-9cec-445e-8920-d4e32bd278f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a835d34d1ae4dbda14eb25b92653de3'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:48:20.789650 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-766da570-9cec-445e-8920-d4e32bd278f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a835d34d1ae4dbda14eb25b92653de3'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:48:20.796009 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 751/1508] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:48:20 2022] DELETE /identity/v3/users/8a835d34d1ae4dbda14eb25b92653de3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:48:20.800874 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95740d2-8f7a-4641-9fda-7a507d4f7e2f None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:48:20.801162 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95740d2-8f7a-4641-9fda-7a507d4f7e2f None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:48:20.801460 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95740d2-8f7a-4641-9fda-7a507d4f7e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:48:20.819541 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-c95740d2-8f7a-4641-9fda-7a507d4f7e2f None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:48:20.820767 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-c95740d2-8f7a-4641-9fda-7a507d4f7e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:48:20.878328 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 758/1509] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:48:20.889275 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766da570-9cec-445e-8920-d4e32bd278f7 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:48:20.891010 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-766da570-9cec-445e-8920-d4e32bd278f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:48:20.947881 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766da570-9cec-445e-8920-d4e32bd278f7 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:48:20.952434 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685037cf-4af8-46e6-8093-2af0d52cf959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:48:20.953066 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685037cf-4af8-46e6-8093-2af0d52cf959 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:48:20.953382 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685037cf-4af8-46e6-8093-2af0d52cf959 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:48:20.953630 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685037cf-4af8-46e6-8093-2af0d52cf959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:48:20.962912 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685037cf-4af8-46e6-8093-2af0d52cf959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:48:20.964323 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685037cf-4af8-46e6-8093-2af0d52cf959 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:48:20.973753 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 752/1510] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:48:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:48:21.311688 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95740d2-8f7a-4641-9fda-7a507d4f7e2f None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:48:21.313216 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-c95740d2-8f7a-4641-9fda-7a507d4f7e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:48:21.326258 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95740d2-8f7a-4641-9fda-7a507d4f7e2f None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:48:21.332323 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ade5d4-d9a0-4c96-a4bc-8aeb841ec927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:48:21.333201 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ade5d4-d9a0-4c96-a4bc-8aeb841ec927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:48:21.333895 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ade5d4-d9a0-4c96-a4bc-8aeb841ec927 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:48:21.334177 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ade5d4-d9a0-4c96-a4bc-8aeb841ec927 admin admin] PATH_INFO: `/v3/projects/bb023ba58608485ba85f897954708b7a` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:48:21.335903 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ade5d4-d9a0-4c96-a4bc-8aeb841ec927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb023ba58608485ba85f897954708b7a)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:48:21.336963 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING py.warnings [None req-52ade5d4-d9a0-4c96-a4bc-8aeb841ec927 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:48:21.336963 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: warnings.warn(msg) Mar 08 13:48:21.336963 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: Mar 08 13:48:21.338205 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ade5d4-d9a0-4c96-a4bc-8aeb841ec927 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:48:21.398261 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-52ade5d4-d9a0-4c96-a4bc-8aeb841ec927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb023ba58608485ba85f897954708b7a', 'request_id': 'req-52ade5d4-d9a0-4c96-a4bc-8aeb841ec927'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:48:21.411820 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-52ade5d4-d9a0-4c96-a4bc-8aeb841ec927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb023ba58608485ba85f897954708b7a', 'request_id': 'req-52ade5d4-d9a0-4c96-a4bc-8aeb841ec927'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:48:21.423739 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-52ade5d4-d9a0-4c96-a4bc-8aeb841ec927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb023ba58608485ba85f897954708b7a', 'request_id': 'req-52ade5d4-d9a0-4c96-a4bc-8aeb841ec927'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:48:21.434752 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-52ade5d4-d9a0-4c96-a4bc-8aeb841ec927 admin admin] The token cache is being invalidate because project bb023ba58608485ba85f897954708b7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:48:21.435020 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-52ade5d4-d9a0-4c96-a4bc-8aeb841ec927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:48:21.435637 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-52ade5d4-d9a0-4c96-a4bc-8aeb841ec927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:48:21.437294 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 759/1511] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:48:21 2022] DELETE /identity/v3/projects/bb023ba58608485ba85f897954708b7a => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:50:01.819563 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0de430-73b0-4e96-a370-79f0cb2b5266 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:01.820178 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0de430-73b0-4e96-a370-79f0cb2b5266 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:01.820178 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0de430-73b0-4e96-a370-79f0cb2b5266 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:01.821878 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 753/1512] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 13:50:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:50:01.827954 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdf757-5123-4184-aee6-25fe27f5a3b5 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:01.828689 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdf757-5123-4184-aee6-25fe27f5a3b5 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:01.828860 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdf757-5123-4184-aee6-25fe27f5a3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:01.855100 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-d7bdf757-5123-4184-aee6-25fe27f5a3b5 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:50:01.856306 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-d7bdf757-5123-4184-aee6-25fe27f5a3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:50:01.919624 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 760/1513] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 13:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:50:02.063868 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e9248-1236-4d1a-8fec-a2d5e3e831df None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:02.064250 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e9248-1236-4d1a-8fec-a2d5e3e831df None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:02.064611 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e9248-1236-4d1a-8fec-a2d5e3e831df None None] PATH_INFO: `/v3` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:02.065935 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 754/1514] 10.222.0.32 () {54 vars in 925 bytes} [Tue Mar 8 13:50:02 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:50:02.072394 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249d7ff-d01f-496d-bb1b-e4081262fcc6 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:02.072617 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249d7ff-d01f-496d-bb1b-e4081262fcc6 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:02.072889 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249d7ff-d01f-496d-bb1b-e4081262fcc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:02.075726 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e9248-1236-4d1a-8fec-a2d5e3e831df None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:50:02.077589 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-158e9248-1236-4d1a-8fec-a2d5e3e831df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:50:02.099918 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-c249d7ff-d01f-496d-bb1b-e4081262fcc6 None None] MFA Rules not processed for user `6e2e8458589b45fa8c91b0d95840e45e`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:50:02.101127 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-c249d7ff-d01f-496d-bb1b-e4081262fcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:50:02.151212 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e9248-1236-4d1a-8fec-a2d5e3e831df None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:50:02.156689 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c01ae6-6ca9-49c4-b059-6565485a8775 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:50:02.157652 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c01ae6-6ca9-49c4-b059-6565485a8775 service nova] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:02.158025 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c01ae6-6ca9-49c4-b059-6565485a8775 service nova] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:02.158304 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c01ae6-6ca9-49c4-b059-6565485a8775 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:02.163155 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 761/1515] 10.222.0.32 () {58 vars in 1015 bytes} [Tue Mar 8 13:50:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:50:02.166701 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c01ae6-6ca9-49c4-b059-6565485a8775 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:50:02.168313 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c01ae6-6ca9-49c4-b059-6565485a8775 service nova] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:50:02.177787 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 755/1516] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:50:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:50:03.464178 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce6960-e5f8-49c6-a9dd-1cdf5da54cd8 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:03.465009 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce6960-e5f8-49c6-a9dd-1cdf5da54cd8 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:03.465009 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce6960-e5f8-49c6-a9dd-1cdf5da54cd8 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:03.467674 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 762/1517] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 13:50:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:50:03.473954 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a66370-376d-40fd-912a-be76f0859796 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:03.474658 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a66370-376d-40fd-912a-be76f0859796 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:03.474832 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a66370-376d-40fd-912a-be76f0859796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:03.500659 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-94a66370-376d-40fd-912a-be76f0859796 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:50:03.501892 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-94a66370-376d-40fd-912a-be76f0859796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:50:03.510882 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 756/1518] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 13:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:50:03.666245 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce6960-e5f8-49c6-a9dd-1cdf5da54cd8 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:50:03.685640 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce6960-e5f8-49c6-a9dd-1cdf5da54cd8 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:50:03.691489 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103d88e-74d8-47b3-bf74-7a9054f91025 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:50:03.692115 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103d88e-74d8-47b3-bf74-7a9054f91025 service nova] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:03.692400 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103d88e-74d8-47b3-bf74-7a9054f91025 service nova] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:03.692670 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103d88e-74d8-47b3-bf74-7a9054f91025 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:03.700926 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103d88e-74d8-47b3-bf74-7a9054f91025 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:50:03.702562 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103d88e-74d8-47b3-bf74-7a9054f91025 service nova] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:50:03.711963 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 763/1519] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:50:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:50:06.198854 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40648c-3299-4000-9e4a-21a5fe482bd1 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:06.199762 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40648c-3299-4000-9e4a-21a5fe482bd1 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:06.199762 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40648c-3299-4000-9e4a-21a5fe482bd1 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:06.202789 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 757/1520] 10.222.0.18 () {54 vars in 960 bytes} [Tue Mar 8 13:50:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:50:06.209271 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50460e1-a2b2-41a7-8250-581cf882695f None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:06.210055 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50460e1-a2b2-41a7-8250-581cf882695f None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:06.210226 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50460e1-a2b2-41a7-8250-581cf882695f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:06.231536 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-c50460e1-a2b2-41a7-8250-581cf882695f None None] MFA Rules not processed for user `6e2e8458589b45fa8c91b0d95840e45e`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:50:06.232725 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-c50460e1-a2b2-41a7-8250-581cf882695f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:50:06.241310 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 764/1521] 10.222.0.18 () {58 vars in 1057 bytes} [Tue Mar 8 13:50:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:50:06.248922 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40648c-3299-4000-9e4a-21a5fe482bd1 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:50:06.262976 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40648c-3299-4000-9e4a-21a5fe482bd1 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:50:06.268336 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d943cf-de3b-41a9-911c-9731dc00feb9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2e8458589b45fa8c91b0d95840e45e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:50:06.268959 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d943cf-de3b-41a9-911c-9731dc00feb9 service placement] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:06.269231 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d943cf-de3b-41a9-911c-9731dc00feb9 service placement] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:06.269533 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d943cf-de3b-41a9-911c-9731dc00feb9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:06.277800 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d943cf-de3b-41a9-911c-9731dc00feb9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:50:06.279366 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d943cf-de3b-41a9-911c-9731dc00feb9 service placement] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:50:06.288702 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 758/1522] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:50:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:50:15.378139 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc918378-014d-4d14-9458-17fc70cf2cc5 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:15.379029 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc918378-014d-4d14-9458-17fc70cf2cc5 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:15.379029 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc918378-014d-4d14-9458-17fc70cf2cc5 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:15.381888 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 765/1523] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 13:50:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:50:15.390151 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af3e0f-9031-4176-a227-e1fe395b5ec5 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:15.390594 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af3e0f-9031-4176-a227-e1fe395b5ec5 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:15.390715 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af3e0f-9031-4176-a227-e1fe395b5ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:15.413635 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-05af3e0f-9031-4176-a227-e1fe395b5ec5 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:50:15.414851 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-05af3e0f-9031-4176-a227-e1fe395b5ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:50:15.424366 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 759/1524] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 13:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:50:15.577875 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc918378-014d-4d14-9458-17fc70cf2cc5 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:50:15.594180 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc918378-014d-4d14-9458-17fc70cf2cc5 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:50:15.600314 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9c4236-1c26-4d25-a1c6-d53787112aff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:50:15.600950 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c4236-1c26-4d25-a1c6-d53787112aff service nova] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:15.601225 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c4236-1c26-4d25-a1c6-d53787112aff service nova] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:15.601528 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9c4236-1c26-4d25-a1c6-d53787112aff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:15.610040 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c4236-1c26-4d25-a1c6-d53787112aff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:50:15.611622 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9c4236-1c26-4d25-a1c6-d53787112aff service nova] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:50:15.621328 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 766/1525] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:50:16.889044 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad76aca-404b-494c-9639-d58ad642c150 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:16.889647 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad76aca-404b-494c-9639-d58ad642c150 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:16.889647 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad76aca-404b-494c-9639-d58ad642c150 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:16.891363 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 760/1526] 127.0.0.1 () {54 vars in 901 bytes} [Tue Mar 8 13:50:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:50:16.899342 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c44c3-52bd-4ca1-98cd-2494a3b5346e None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:16.899822 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c44c3-52bd-4ca1-98cd-2494a3b5346e None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:16.899933 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c44c3-52bd-4ca1-98cd-2494a3b5346e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:16.920687 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-570c44c3-52bd-4ca1-98cd-2494a3b5346e None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:50:16.921908 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-570c44c3-52bd-4ca1-98cd-2494a3b5346e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:50:16.932157 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 767/1527] 127.0.0.1 () {58 vars in 998 bytes} [Tue Mar 8 13:50:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:50:17.081614 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad76aca-404b-494c-9639-d58ad642c150 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:50:17.096970 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad76aca-404b-494c-9639-d58ad642c150 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:50:17.102646 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0a75e-4322-4169-ba6f-e3b7de583abc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:50:17.103280 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0a75e-4322-4169-ba6f-e3b7de583abc service nova] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:17.103561 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0a75e-4322-4169-ba6f-e3b7de583abc service nova] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:17.103833 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0a75e-4322-4169-ba6f-e3b7de583abc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:17.112599 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0a75e-4322-4169-ba6f-e3b7de583abc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:50:17.114213 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0a75e-4322-4169-ba6f-e3b7de583abc service nova] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:50:17.124012 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 761/1528] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:50:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:50:21.675380 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502a16e-f808-4442-83ff-15ca6b48689e None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:21.675974 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502a16e-f808-4442-83ff-15ca6b48689e None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:21.675974 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1502a16e-f808-4442-83ff-15ca6b48689e None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:21.677733 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 768/1529] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:50:21.684373 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58c86b-71be-4024-a2c2-4c5b63672bba None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:21.685152 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58c86b-71be-4024-a2c2-4c5b63672bba None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:21.685318 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58c86b-71be-4024-a2c2-4c5b63672bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:21.710073 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-6e58c86b-71be-4024-a2c2-4c5b63672bba None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:50:21.711264 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-6e58c86b-71be-4024-a2c2-4c5b63672bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:50:21.719841 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 762/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:50:21.756930 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502a16e-f808-4442-83ff-15ca6b48689e None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:50:21.758972 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-1502a16e-f808-4442-83ff-15ca6b48689e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:50:21.820498 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1502a16e-f808-4442-83ff-15ca6b48689e None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:50:21.825153 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af8c3c-43ae-4898-914a-386e7df94cdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:50:21.825846 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af8c3c-43ae-4898-914a-386e7df94cdd service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:21.826133 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af8c3c-43ae-4898-914a-386e7df94cdd service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:21.826436 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af8c3c-43ae-4898-914a-386e7df94cdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:21.836508 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af8c3c-43ae-4898-914a-386e7df94cdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:50:21.838041 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af8c3c-43ae-4898-914a-386e7df94cdd service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:50:21.848665 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 769/1531] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:50:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:50:24.127858 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c014b54-1048-42fe-84a7-44d924de7144 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:24.128476 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c014b54-1048-42fe-84a7-44d924de7144 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:24.128476 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c014b54-1048-42fe-84a7-44d924de7144 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:24.130237 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 763/1532] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:50:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:50:24.136663 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1260ed-8403-41bf-84b3-0ef9cdb0b239 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:24.137423 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1260ed-8403-41bf-84b3-0ef9cdb0b239 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:24.137605 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1260ed-8403-41bf-84b3-0ef9cdb0b239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:24.163549 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-5d1260ed-8403-41bf-84b3-0ef9cdb0b239 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:50:24.164744 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-5d1260ed-8403-41bf-84b3-0ef9cdb0b239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:50:24.173121 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 770/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:50:24.208728 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c014b54-1048-42fe-84a7-44d924de7144 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:50:24.220994 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c014b54-1048-42fe-84a7-44d924de7144 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:50:24.225094 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091a362-5136-4e67-ae7b-86a7bc153ff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:50:24.225759 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091a362-5136-4e67-ae7b-86a7bc153ff7 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:24.226034 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091a362-5136-4e67-ae7b-86a7bc153ff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:24.226301 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091a362-5136-4e67-ae7b-86a7bc153ff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:24.235424 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091a362-5136-4e67-ae7b-86a7bc153ff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:50:24.236845 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091a362-5136-4e67-ae7b-86a7bc153ff7 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:50:24.246031 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 764/1534] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:50:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:50:28.305058 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fd515-df1d-4ac2-9489-2094da0ee0e9 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:28.306001 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fd515-df1d-4ac2-9489-2094da0ee0e9 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:28.306001 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fd515-df1d-4ac2-9489-2094da0ee0e9 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:28.309158 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 771/1535] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:50:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:50:28.314676 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca292ecf-1794-4213-8f34-c1637a05e49b None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:28.315124 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca292ecf-1794-4213-8f34-c1637a05e49b None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:28.315230 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca292ecf-1794-4213-8f34-c1637a05e49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:28.333704 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-ca292ecf-1794-4213-8f34-c1637a05e49b None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:50:28.334893 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-ca292ecf-1794-4213-8f34-c1637a05e49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:50:28.343706 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 765/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:50:28.592200 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fd515-df1d-4ac2-9489-2094da0ee0e9 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:50:28.595333 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-320fd515-df1d-4ac2-9489-2094da0ee0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:50:28.665822 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fd515-df1d-4ac2-9489-2094da0ee0e9 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:50:28.670304 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1842e00-8c28-4df2-b309-8d54ebe2e386 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:50:28.670948 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1842e00-8c28-4df2-b309-8d54ebe2e386 service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:28.671228 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1842e00-8c28-4df2-b309-8d54ebe2e386 service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:28.671501 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1842e00-8c28-4df2-b309-8d54ebe2e386 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:28.681322 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1842e00-8c28-4df2-b309-8d54ebe2e386 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:50:28.682766 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1842e00-8c28-4df2-b309-8d54ebe2e386 service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:50:28.692841 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 772/1537] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:50:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:50:31.001713 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042a103-7cb7-49dd-9abb-66206070d1cc None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:31.002698 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042a103-7cb7-49dd-9abb-66206070d1cc None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:31.002698 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042a103-7cb7-49dd-9abb-66206070d1cc None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:31.005432 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 766/1538] 127.0.0.1 () {54 vars in 916 bytes} [Tue Mar 8 13:50:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:50:31.014128 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca05a2a-a206-4413-8b1c-7908b636589c None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:31.014623 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca05a2a-a206-4413-8b1c-7908b636589c None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:31.014983 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca05a2a-a206-4413-8b1c-7908b636589c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:31.034792 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-7ca05a2a-a206-4413-8b1c-7908b636589c None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:50:31.035988 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-7ca05a2a-a206-4413-8b1c-7908b636589c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:50:31.045129 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 773/1539] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Mar 8 13:50:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:50:31.296647 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9d97d-7c5c-4d78-b7f4-abef20c3b5a6 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:31.296930 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9d97d-7c5c-4d78-b7f4-abef20c3b5a6 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:31.297166 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c9d97d-7c5c-4d78-b7f4-abef20c3b5a6 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:31.299193 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 767/1540] 10.222.0.18 () {54 vars in 963 bytes} [Tue Mar 8 13:50:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:50:31.307050 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d405e-0f85-44f9-a670-8eb1d863efe1 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:31.307562 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d405e-0f85-44f9-a670-8eb1d863efe1 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:31.307880 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d405e-0f85-44f9-a670-8eb1d863efe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:31.329657 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-8c9d405e-0f85-44f9-a670-8eb1d863efe1 None None] MFA Rules not processed for user `56ddb15832b048f5a19d7d3887e088b3`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:50:31.330839 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-8c9d405e-0f85-44f9-a670-8eb1d863efe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:50:31.338622 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 774/1541] 10.222.0.18 () {58 vars in 1060 bytes} [Tue Mar 8 13:50:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:50:31.346136 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9d97d-7c5c-4d78-b7f4-abef20c3b5a6 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:50:31.358082 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c9d97d-7c5c-4d78-b7f4-abef20c3b5a6 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:50:31.362636 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d2c93d-cb52-4b1e-a5e7-6f8630dac7e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:50:31.363259 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2c93d-cb52-4b1e-a5e7-6f8630dac7e9 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:50:31.363532 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2c93d-cb52-4b1e-a5e7-6f8630dac7e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:50:31.363797 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d2c93d-cb52-4b1e-a5e7-6f8630dac7e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:50:31.373521 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2c93d-cb52-4b1e-a5e7-6f8630dac7e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:50:31.374928 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d2c93d-cb52-4b1e-a5e7-6f8630dac7e9 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:50:31.384720 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 768/1542] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:50:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:51:59.911524 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40a209-2f7f-47dc-a60b-72d72877482b None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:51:59.912197 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40a209-2f7f-47dc-a60b-72d72877482b None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:51:59.912197 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40a209-2f7f-47dc-a60b-72d72877482b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:51:59.945816 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-db40a209-2f7f-47dc-a60b-72d72877482b None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:51:59.947258 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-db40a209-2f7f-47dc-a60b-72d72877482b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:51:59.960586 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 775/1543] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:51:59.969680 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b925002-8bbd-48db-8ce2-71021f724d07 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:51:59.970288 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b925002-8bbd-48db-8ce2-71021f724d07 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:51:59.970288 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b925002-8bbd-48db-8ce2-71021f724d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:51:59.998115 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-2b925002-8bbd-48db-8ce2-71021f724d07 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:00.002477 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-2b925002-8bbd-48db-8ce2-71021f724d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:00.015112 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 769/1544] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:00.020130 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40a209-2f7f-47dc-a60b-72d72877482b None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:00.031042 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40a209-2f7f-47dc-a60b-72d72877482b None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:00.041399 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ee190-15c6-4f7d-b66e-a82d8faaadd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:00.042393 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ee190-15c6-4f7d-b66e-a82d8faaadd0 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.042847 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ee190-15c6-4f7d-b66e-a82d8faaadd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.043281 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ee190-15c6-4f7d-b66e-a82d8faaadd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.044178 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ee190-15c6-4f7d-b66e-a82d8faaadd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:00.044651 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ee190-15c6-4f7d-b66e-a82d8faaadd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:00.046513 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ee190-15c6-4f7d-b66e-a82d8faaadd0 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:00.065818 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 776/1545] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:52:00.074929 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b925002-8bbd-48db-8ce2-71021f724d07 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:00.092072 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b925002-8bbd-48db-8ce2-71021f724d07 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:00.100545 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe9d623-322d-4715-84fe-6adbed750569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:00.101246 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9d623-322d-4715-84fe-6adbed750569 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.101564 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9d623-322d-4715-84fe-6adbed750569 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.101843 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe9d623-322d-4715-84fe-6adbed750569 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.102572 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9d623-322d-4715-84fe-6adbed750569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:00.104546 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe9d623-322d-4715-84fe-6adbed750569 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:00.162330 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 770/1546] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:00 2022] POST /identity/v3/projects => generated 391 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:00.166655 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ee190-15c6-4f7d-b66e-a82d8faaadd0 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:00.178221 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ee190-15c6-4f7d-b66e-a82d8faaadd0 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:00.186399 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb1908-a5a2-4514-8157-8bc80a50ac1a None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.187015 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb1908-a5a2-4514-8157-8bc80a50ac1a None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.187508 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb1908-a5a2-4514-8157-8bc80a50ac1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.222671 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-96cb1908-a5a2-4514-8157-8bc80a50ac1a None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:00.224344 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-96cb1908-a5a2-4514-8157-8bc80a50ac1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:00.260313 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1b762-6249-48c1-a3eb-5bcbf86ab1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:00.261311 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1b762-6249-48c1-a3eb-5bcbf86ab1ae admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.261814 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1b762-6249-48c1-a3eb-5bcbf86ab1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.262246 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1b762-6249-48c1-a3eb-5bcbf86ab1ae admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.263208 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1b762-6249-48c1-a3eb-5bcbf86ab1ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:00.265406 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1b762-6249-48c1-a3eb-5bcbf86ab1ae admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:00.299915 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 777/1547] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:00 2022] POST /identity/v3/users => generated 296 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:00.301847 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff57630-543a-439f-843e-13473f894555 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.302403 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff57630-543a-439f-843e-13473f894555 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.302878 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff57630-543a-439f-843e-13473f894555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.310557 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 771/1548] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:00.312287 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21bb8b-794f-4323-a940-b1b9086ebc3a None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.312644 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21bb8b-794f-4323-a940-b1b9086ebc3a None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.312987 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f21bb8b-794f-4323-a940-b1b9086ebc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.338034 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-4f21bb8b-794f-4323-a940-b1b9086ebc3a None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:00.338653 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-9ff57630-543a-439f-843e-13473f894555 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:00.339919 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-4f21bb8b-794f-4323-a940-b1b9086ebc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:00.340148 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-9ff57630-543a-439f-843e-13473f894555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:00.348852 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 772/1549] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:00.351862 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddef4e7-0cb9-447c-a264-dbaa1dbb928e None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.351862 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddef4e7-0cb9-447c-a264-dbaa1dbb928e None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.351862 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddef4e7-0cb9-447c-a264-dbaa1dbb928e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.352211 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 778/1550] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:00.352925 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149831a-8731-4946-8b9b-a026776ad97d None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.359980 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149831a-8731-4946-8b9b-a026776ad97d None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.359980 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149831a-8731-4946-8b9b-a026776ad97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.375490 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-f149831a-8731-4946-8b9b-a026776ad97d None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:00.376860 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-f149831a-8731-4946-8b9b-a026776ad97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:00.378659 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-7ddef4e7-0cb9-447c-a264-dbaa1dbb928e None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:00.379838 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-7ddef4e7-0cb9-447c-a264-dbaa1dbb928e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:00.389399 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 779/1551] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:00.389399 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149831a-8731-4946-8b9b-a026776ad97d None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:00.394238 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 773/1552] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:00.395824 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d2637-2fa3-46e0-8764-2d606ada19d8 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.396145 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d2637-2fa3-46e0-8764-2d606ada19d8 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.396425 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d2637-2fa3-46e0-8764-2d606ada19d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.401875 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149831a-8731-4946-8b9b-a026776ad97d None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:00.406924 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef943be0-c3e0-425a-8ce3-314b17f708df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:00.407598 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef943be0-c3e0-425a-8ce3-314b17f708df admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.407875 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef943be0-c3e0-425a-8ce3-314b17f708df admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.408149 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef943be0-c3e0-425a-8ce3-314b17f708df admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.408910 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef943be0-c3e0-425a-8ce3-314b17f708df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:00.410575 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef943be0-c3e0-425a-8ce3-314b17f708df admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:00.416389 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-cc9d2637-2fa3-46e0-8764-2d606ada19d8 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:00.417774 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-cc9d2637-2fa3-46e0-8764-2d606ada19d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:00.421469 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 780/1553] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:00.422246 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe41fc-a98c-42bd-8076-e721b1694282 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.422572 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe41fc-a98c-42bd-8076-e721b1694282 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.422904 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fe41fc-a98c-42bd-8076-e721b1694282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.428642 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 774/1554] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:00.433976 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e6e7f-86f2-443b-b9c6-4520b713cf95 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.434264 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e6e7f-86f2-443b-b9c6-4520b713cf95 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.434541 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e6e7f-86f2-443b-b9c6-4520b713cf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.446256 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-90fe41fc-a98c-42bd-8076-e721b1694282 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:00.447454 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-90fe41fc-a98c-42bd-8076-e721b1694282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:00.454183 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-9f0e6e7f-86f2-443b-b9c6-4520b713cf95 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:00.455325 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-9f0e6e7f-86f2-443b-b9c6-4520b713cf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:00.455753 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 781/1555] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:00.457066 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05a649-b4ac-41d8-b8e8-242609e3fe27 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.457309 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05a649-b4ac-41d8-b8e8-242609e3fe27 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.457617 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff05a649-b4ac-41d8-b8e8-242609e3fe27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.467083 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 775/1556] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:00.468579 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b00a8-2075-4904-b948-1f286be09087 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.469059 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b00a8-2075-4904-b948-1f286be09087 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.469554 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581b00a8-2075-4904-b948-1f286be09087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.476722 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-ff05a649-b4ac-41d8-b8e8-242609e3fe27 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:00.477950 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-ff05a649-b4ac-41d8-b8e8-242609e3fe27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:00.485765 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 782/1557] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:00.487037 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e8af5-c6b1-4f3f-8e46-818f53c7f69d None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.487323 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e8af5-c6b1-4f3f-8e46-818f53c7f69d None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.487598 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e8af5-c6b1-4f3f-8e46-818f53c7f69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.490404 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-581b00a8-2075-4904-b948-1f286be09087 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:00.491571 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-581b00a8-2075-4904-b948-1f286be09087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:00.499386 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 776/1558] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:00.500232 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b00a8-2075-4904-b948-1f286be09087 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:00.509138 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-333e8af5-c6b1-4f3f-8e46-818f53c7f69d None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:00.509575 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581b00a8-2075-4904-b948-1f286be09087 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:00.510365 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-333e8af5-c6b1-4f3f-8e46-818f53c7f69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:00.514043 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681a0a2-2285-4ed1-9bf4-e0f2decd555b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:00.514695 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681a0a2-2285-4ed1-9bf4-e0f2decd555b admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.514978 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681a0a2-2285-4ed1-9bf4-e0f2decd555b admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.515255 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681a0a2-2285-4ed1-9bf4-e0f2decd555b admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.515984 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681a0a2-2285-4ed1-9bf4-e0f2decd555b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:00.517617 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681a0a2-2285-4ed1-9bf4-e0f2decd555b admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:00.518310 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 783/1559] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:00.519057 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e8af5-c6b1-4f3f-8e46-818f53c7f69d None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:00.530755 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 777/1560] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:00.530933 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e8af5-c6b1-4f3f-8e46-818f53c7f69d None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:00.531045 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fbf88-aafb-43d8-bd3a-9c04b5472428 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.531045 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fbf88-aafb-43d8-bd3a-9c04b5472428 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.531045 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fbf88-aafb-43d8-bd3a-9c04b5472428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.534989 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e1bf69-47d7-49ef-a110-6d4b2aa86d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:00.535608 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1bf69-47d7-49ef-a110-6d4b2aa86d5e admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.535887 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1bf69-47d7-49ef-a110-6d4b2aa86d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.536159 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e1bf69-47d7-49ef-a110-6d4b2aa86d5e admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.536946 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1bf69-47d7-49ef-a110-6d4b2aa86d5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:00.537271 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1bf69-47d7-49ef-a110-6d4b2aa86d5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:00.538902 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e1bf69-47d7-49ef-a110-6d4b2aa86d5e admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:00.547445 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-9f8fbf88-aafb-43d8-bd3a-9c04b5472428 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:00.548637 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-9f8fbf88-aafb-43d8-bd3a-9c04b5472428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:00.550499 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 784/1561] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:52:00.551662 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ef6e3-1855-42cc-8155-ec1472a5f5db None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.551950 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ef6e3-1855-42cc-8155-ec1472a5f5db None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.552213 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ef6e3-1855-42cc-8155-ec1472a5f5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.558972 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 778/1562] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:00.559769 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fbf88-aafb-43d8-bd3a-9c04b5472428 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:00.569378 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fbf88-aafb-43d8-bd3a-9c04b5472428 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:00.573929 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-fd7ef6e3-1855-42cc-8155-ec1472a5f5db None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:00.574384 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c14acf-68db-41d2-8a9e-0d4b743116f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:00.575033 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c14acf-68db-41d2-8a9e-0d4b743116f5 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.575146 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-fd7ef6e3-1855-42cc-8155-ec1472a5f5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:00.575310 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c14acf-68db-41d2-8a9e-0d4b743116f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.575581 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c14acf-68db-41d2-8a9e-0d4b743116f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.576661 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c14acf-68db-41d2-8a9e-0d4b743116f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:00.576965 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c14acf-68db-41d2-8a9e-0d4b743116f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:00.578012 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING py.warnings [None req-d2c14acf-68db-41d2-8a9e-0d4b743116f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:52:00.578012 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: warnings.warn(msg) Mar 08 13:52:00.578012 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: Mar 08 13:52:00.578894 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c14acf-68db-41d2-8a9e-0d4b743116f5 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:00.584158 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 785/1563] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:00.584922 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ef6e3-1855-42cc-8155-ec1472a5f5db None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:00.597240 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 779/1564] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:52:00.597240 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c14acf-68db-41d2-8a9e-0d4b743116f5 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:00.597543 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ef6e3-1855-42cc-8155-ec1472a5f5db None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:00.601607 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02acad20-3a3b-4d7f-8104-b46e574e5224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:00.602255 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acad20-3a3b-4d7f-8104-b46e574e5224 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.602533 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acad20-3a3b-4d7f-8104-b46e574e5224 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.602804 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acad20-3a3b-4d7f-8104-b46e574e5224 admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.603520 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02acad20-3a3b-4d7f-8104-b46e574e5224 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:00.603684 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c14acf-68db-41d2-8a9e-0d4b743116f5 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:00.603814 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02acad20-3a3b-4d7f-8104-b46e574e5224 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:00.605586 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02acad20-3a3b-4d7f-8104-b46e574e5224 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:00.608153 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb6460-2d06-4cf7-a4ae-882a05d66669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:00.608828 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb6460-2d06-4cf7-a4ae-882a05d66669 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.609113 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb6460-2d06-4cf7-a4ae-882a05d66669 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.609413 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb6460-2d06-4cf7-a4ae-882a05d66669 admin admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.610127 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb6460-2d06-4cf7-a4ae-882a05d66669 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:00.610435 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb6460-2d06-4cf7-a4ae-882a05d66669 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:00.611990 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb6460-2d06-4cf7-a4ae-882a05d66669 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:00.616814 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 786/1565] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:52:00.617611 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02acad20-3a3b-4d7f-8104-b46e574e5224 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:00.629445 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 780/1566] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:52:00.629445 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb6460-2d06-4cf7-a4ae-882a05d66669 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:00.629733 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02acad20-3a3b-4d7f-8104-b46e574e5224 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:00.631401 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e0077-bc56-4f3c-9db0-fdff23067de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:00.632039 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e0077-bc56-4f3c-9db0-fdff23067de2 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.632319 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e0077-bc56-4f3c-9db0-fdff23067de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.632583 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e0077-bc56-4f3c-9db0-fdff23067de2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.633295 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e0077-bc56-4f3c-9db0-fdff23067de2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:00.633626 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e0077-bc56-4f3c-9db0-fdff23067de2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:00.635197 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e0077-bc56-4f3c-9db0-fdff23067de2 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:00.635310 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb6460-2d06-4cf7-a4ae-882a05d66669 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:00.639975 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f1737-0956-4cf9-bf71-4aa8508f64be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:00.640860 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f1737-0956-4cf9-bf71-4aa8508f64be admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.641169 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f1737-0956-4cf9-bf71-4aa8508f64be admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.641471 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f1737-0956-4cf9-bf71-4aa8508f64be admin admin] PATH_INFO: `/v3/projects/3512e4115024491fb07c2a5defc7916e/users/a1978f4585704f7c880269de546c7055/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.647517 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 787/1567] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:52:00.648456 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e0077-bc56-4f3c-9db0-fdff23067de2 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:00.656812 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f1737-0956-4cf9-bf71-4aa8508f64be admin admin] RBAC: Authorizing `identity:create_grant(project_id=3512e4115024491fb07c2a5defc7916e, user_id=a1978f4585704f7c880269de546c7055, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:00.659489 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f1737-0956-4cf9-bf71-4aa8508f64be admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:00.659627 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e0077-bc56-4f3c-9db0-fdff23067de2 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:00.664090 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c619619-7c00-4d8d-9491-17651abfd6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:00.664803 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c619619-7c00-4d8d-9491-17651abfd6bb admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.665112 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c619619-7c00-4d8d-9491-17651abfd6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.665416 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c619619-7c00-4d8d-9491-17651abfd6bb admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.666141 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c619619-7c00-4d8d-9491-17651abfd6bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:00.667285 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING py.warnings [None req-1c619619-7c00-4d8d-9491-17651abfd6bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:52:00.667285 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: warnings.warn(msg) Mar 08 13:52:00.667285 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: Mar 08 13:52:00.668402 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c619619-7c00-4d8d-9491-17651abfd6bb admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:00.673431 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 781/1568] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:00 2022] PUT /identity/v3/projects/3512e4115024491fb07c2a5defc7916e/users/a1978f4585704f7c880269de546c7055/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:00.674687 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009fb2d-02c5-48aa-8a8f-3396d67141a5 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.674977 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009fb2d-02c5-48aa-8a8f-3396d67141a5 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.675276 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009fb2d-02c5-48aa-8a8f-3396d67141a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.696551 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 788/1569] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:00 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:00.697718 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c619619-7c00-4d8d-9491-17651abfd6bb admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:00.704105 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-f009fb2d-02c5-48aa-8a8f-3396d67141a5 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:00.705286 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f009fb2d-02c5-48aa-8a8f-3396d67141a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:00.756511 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c619619-7c00-4d8d-9491-17651abfd6bb admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:00.761228 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a451ff3-f575-4966-86ab-e1cf802b1923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:00.761926 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a451ff3-f575-4966-86ab-e1cf802b1923 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.762210 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a451ff3-f575-4966-86ab-e1cf802b1923 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.762485 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a451ff3-f575-4966-86ab-e1cf802b1923 admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.763215 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a451ff3-f575-4966-86ab-e1cf802b1923 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:00.763528 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a451ff3-f575-4966-86ab-e1cf802b1923 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:00.764551 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 782/1570] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:00.765223 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009fb2d-02c5-48aa-8a8f-3396d67141a5 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:00.765497 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a451ff3-f575-4966-86ab-e1cf802b1923 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:00.773951 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009fb2d-02c5-48aa-8a8f-3396d67141a5 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:00.777406 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 789/1571] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:52:00.778187 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a451ff3-f575-4966-86ab-e1cf802b1923 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:00.785704 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0060429-813d-4262-be0c-a7200d32734e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:00.786371 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0060429-813d-4262-be0c-a7200d32734e admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.786950 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0060429-813d-4262-be0c-a7200d32734e admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.787123 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0060429-813d-4262-be0c-a7200d32734e admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.787839 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0060429-813d-4262-be0c-a7200d32734e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:00.790047 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0060429-813d-4262-be0c-a7200d32734e admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:00.794168 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a451ff3-f575-4966-86ab-e1cf802b1923 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:00.799131 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb5925-0b24-45d8-8637-86d2f398265b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:00.799910 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb5925-0b24-45d8-8637-86d2f398265b admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.800174 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb5925-0b24-45d8-8637-86d2f398265b admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.800520 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb5925-0b24-45d8-8637-86d2f398265b admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.801325 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb5925-0b24-45d8-8637-86d2f398265b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:00.803515 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb5925-0b24-45d8-8637-86d2f398265b admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:00.817824 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 783/1572] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:00 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:00.818453 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0060429-813d-4262-be0c-a7200d32734e admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:00.834529 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 790/1573] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:00 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:00.835331 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb5925-0b24-45d8-8637-86d2f398265b admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:00.878747 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0060429-813d-4262-be0c-a7200d32734e admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:00.894271 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb5925-0b24-45d8-8637-86d2f398265b admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:00.899322 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749f2b3-6c6d-4ea6-acd1-7b7fe91a76cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:00.899969 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749f2b3-6c6d-4ea6-acd1-7b7fe91a76cd admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.900250 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749f2b3-6c6d-4ea6-acd1-7b7fe91a76cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.900516 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749f2b3-6c6d-4ea6-acd1-7b7fe91a76cd admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.901185 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749f2b3-6c6d-4ea6-acd1-7b7fe91a76cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:00.903168 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749f2b3-6c6d-4ea6-acd1-7b7fe91a76cd admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:00.931733 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 791/1574] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:00 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:00.931733 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e149822-ca04-4e01-bf76-4bd08bfc2550 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.931733 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e149822-ca04-4e01-bf76-4bd08bfc2550 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.931733 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e149822-ca04-4e01-bf76-4bd08bfc2550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.937310 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c0ee4-e51f-4e68-9e1d-924f7b6e837f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:00.937515 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c0ee4-e51f-4e68-9e1d-924f7b6e837f admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:00.937845 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c0ee4-e51f-4e68-9e1d-924f7b6e837f admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:00.938129 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912c0ee4-e51f-4e68-9e1d-924f7b6e837f admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:00.938887 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c0ee4-e51f-4e68-9e1d-924f7b6e837f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:00.940781 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912c0ee4-e51f-4e68-9e1d-924f7b6e837f admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:00.956272 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-2e149822-ca04-4e01-bf76-4bd08bfc2550 None None] MFA Rules not processed for user `a1978f4585704f7c880269de546c7055`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:00.957518 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-2e149822-ca04-4e01-bf76-4bd08bfc2550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:00.968723 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 784/1575] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:00 2022] POST /identity/v3/projects => generated 393 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:00.969487 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c0ee4-e51f-4e68-9e1d-924f7b6e837f admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.023383 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 792/1576] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:01.024351 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e149822-ca04-4e01-bf76-4bd08bfc2550 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.026681 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912c0ee4-e51f-4e68-9e1d-924f7b6e837f admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.031480 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a5ba5-2115-42dc-b08a-ce373b8b979e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.032146 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a5ba5-2115-42dc-b08a-ce373b8b979e admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.032422 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a5ba5-2115-42dc-b08a-ce373b8b979e admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.032695 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a5ba5-2115-42dc-b08a-ce373b8b979e admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.033390 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a5ba5-2115-42dc-b08a-ce373b8b979e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.034523 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING py.warnings [None req-050a5ba5-2115-42dc-b08a-ce373b8b979e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:52:01.034523 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: warnings.warn(msg) Mar 08 13:52:01.034523 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: Mar 08 13:52:01.035726 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a5ba5-2115-42dc-b08a-ce373b8b979e admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.057327 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 785/1577] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:00 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:01.058135 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a5ba5-2115-42dc-b08a-ce373b8b979e admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.067252 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a5ba5-2115-42dc-b08a-ce373b8b979e admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.071828 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15ed1c-69e2-4672-8f21-b96c90789712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.072457 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15ed1c-69e2-4672-8f21-b96c90789712 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.072735 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15ed1c-69e2-4672-8f21-b96c90789712 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.073007 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15ed1c-69e2-4672-8f21-b96c90789712 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.073723 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15ed1c-69e2-4672-8f21-b96c90789712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.075600 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15ed1c-69e2-4672-8f21-b96c90789712 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.084339 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e149822-ca04-4e01-bf76-4bd08bfc2550 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.089133 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2463d45-7e33-4157-b15e-9c8b5206d6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.089856 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2463d45-7e33-4157-b15e-9c8b5206d6ab admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.090139 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2463d45-7e33-4157-b15e-9c8b5206d6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.090415 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2463d45-7e33-4157-b15e-9c8b5206d6ab admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.091194 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2463d45-7e33-4157-b15e-9c8b5206d6ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:01.091513 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2463d45-7e33-4157-b15e-9c8b5206d6ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.093139 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2463d45-7e33-4157-b15e-9c8b5206d6ab admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.102077 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 786/1578] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:01 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:01.102077 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15ed1c-69e2-4672-8f21-b96c90789712 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.105462 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 793/1579] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:52:01.105750 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2463d45-7e33-4157-b15e-9c8b5206d6ab admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.118435 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2463d45-7e33-4157-b15e-9c8b5206d6ab admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.167439 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15ed1c-69e2-4672-8f21-b96c90789712 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.171194 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad040d2-0b73-49f1-8ed0-1acb8a526b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.171868 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad040d2-0b73-49f1-8ed0-1acb8a526b22 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.172025 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03a642-67e9-43af-ad97-147cf25fc05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.172144 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad040d2-0b73-49f1-8ed0-1acb8a526b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.172402 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad040d2-0b73-49f1-8ed0-1acb8a526b22 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.172561 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03a642-67e9-43af-ad97-147cf25fc05f admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.172841 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03a642-67e9-43af-ad97-147cf25fc05f admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.173088 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad040d2-0b73-49f1-8ed0-1acb8a526b22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.173228 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03a642-67e9-43af-ad97-147cf25fc05f admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.173810 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03a642-67e9-43af-ad97-147cf25fc05f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.175036 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad040d2-0b73-49f1-8ed0-1acb8a526b22 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.175673 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03a642-67e9-43af-ad97-147cf25fc05f admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.200577 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 794/1580] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:01 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:01.200774 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 787/1581] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:01 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:01.200865 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad040d2-0b73-49f1-8ed0-1acb8a526b22 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.200951 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03a642-67e9-43af-ad97-147cf25fc05f admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.210193 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad040d2-0b73-49f1-8ed0-1acb8a526b22 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.210373 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03a642-67e9-43af-ad97-147cf25fc05f admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.214732 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4963b-f6b4-4848-9232-16b54b548c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.215377 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4963b-f6b4-4848-9232-16b54b548c00 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.215626 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d07353-57b3-4439-a53d-b7b71639ffda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.215765 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4963b-f6b4-4848-9232-16b54b548c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.215934 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4963b-f6b4-4848-9232-16b54b548c00 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.216282 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d07353-57b3-4439-a53d-b7b71639ffda admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.216641 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4963b-f6b4-4848-9232-16b54b548c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.216747 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d07353-57b3-4439-a53d-b7b71639ffda admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.216944 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d07353-57b3-4439-a53d-b7b71639ffda admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.217670 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d07353-57b3-4439-a53d-b7b71639ffda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.218591 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4963b-f6b4-4848-9232-16b54b548c00 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.219579 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d07353-57b3-4439-a53d-b7b71639ffda admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.243864 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 795/1582] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:01 2022] POST /identity/v3/users => generated 283 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:01.243864 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4963b-f6b4-4848-9232-16b54b548c00 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.244184 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 788/1583] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:01 2022] POST /identity/v3/users => generated 297 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:01.244184 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d07353-57b3-4439-a53d-b7b71639ffda admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.254431 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d07353-57b3-4439-a53d-b7b71639ffda admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.255859 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4963b-f6b4-4848-9232-16b54b548c00 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.259053 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2bc1da-7fdd-47d2-89d6-3bb3cd7a5bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.259702 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bc1da-7fdd-47d2-89d6-3bb3cd7a5bcf admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.259972 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bc1da-7fdd-47d2-89d6-3bb3cd7a5bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.260240 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bc1da-7fdd-47d2-89d6-3bb3cd7a5bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.260481 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf792c-2309-4328-8579-33e403f566bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.261012 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2bc1da-7fdd-47d2-89d6-3bb3cd7a5bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.261137 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf792c-2309-4328-8579-33e403f566bd admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.261420 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf792c-2309-4328-8579-33e403f566bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.261699 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf792c-2309-4328-8579-33e403f566bd admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.262391 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf792c-2309-4328-8579-33e403f566bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.262586 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2bc1da-7fdd-47d2-89d6-3bb3cd7a5bcf admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.264602 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf792c-2309-4328-8579-33e403f566bd admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.272144 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 789/1584] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:01.275757 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2bc1da-7fdd-47d2-89d6-3bb3cd7a5bcf admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.284612 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2bc1da-7fdd-47d2-89d6-3bb3cd7a5bcf admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.289403 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf81f80-b047-4569-ab64-eaae2849d420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.290054 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf81f80-b047-4569-ab64-eaae2849d420 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.290336 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf81f80-b047-4569-ab64-eaae2849d420 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.290613 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf81f80-b047-4569-ab64-eaae2849d420 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.291305 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf81f80-b047-4569-ab64-eaae2849d420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.295630 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 796/1585] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:01 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:01.295795 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf81f80-b047-4569-ab64-eaae2849d420 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.295890 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf792c-2309-4328-8579-33e403f566bd admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.314215 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 790/1586] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:01 2022] POST /identity/v3/users => generated 291 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:01.315019 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf81f80-b047-4569-ab64-eaae2849d420 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.324313 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf81f80-b047-4569-ab64-eaae2849d420 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.357853 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf792c-2309-4328-8579-33e403f566bd admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.362755 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e75d6a-4a03-456b-a576-6bddf30acd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.363419 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e75d6a-4a03-456b-a576-6bddf30acd4f admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.363703 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e75d6a-4a03-456b-a576-6bddf30acd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.363979 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e75d6a-4a03-456b-a576-6bddf30acd4f admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.364667 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e75d6a-4a03-456b-a576-6bddf30acd4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.366645 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e75d6a-4a03-456b-a576-6bddf30acd4f admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.377348 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab4ee1-59dd-498e-b784-ab9fade4b576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.378043 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab4ee1-59dd-498e-b784-ab9fade4b576 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.378323 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab4ee1-59dd-498e-b784-ab9fade4b576 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.378598 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab4ee1-59dd-498e-b784-ab9fade4b576 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.379325 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab4ee1-59dd-498e-b784-ab9fade4b576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.380966 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab4ee1-59dd-498e-b784-ab9fade4b576 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.390724 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 791/1587] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:01.391528 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab4ee1-59dd-498e-b784-ab9fade4b576 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.395867 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 797/1588] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:01 2022] POST /identity/v3/projects => generated 389 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:01.395867 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e75d6a-4a03-456b-a576-6bddf30acd4f admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.401328 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab4ee1-59dd-498e-b784-ab9fade4b576 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.456363 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ad455-ad25-496c-9776-89a15a32ce1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.456642 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e75d6a-4a03-456b-a576-6bddf30acd4f admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.456977 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ad455-ad25-496c-9776-89a15a32ce1c admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.457260 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ad455-ad25-496c-9776-89a15a32ce1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.457569 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ad455-ad25-496c-9776-89a15a32ce1c admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.458300 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ad455-ad25-496c-9776-89a15a32ce1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.459930 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ad455-ad25-496c-9776-89a15a32ce1c admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.461566 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3705e-39c9-47f9-9c8f-6bc12d8f4fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.462226 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3705e-39c9-47f9-9c8f-6bc12d8f4fcc admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.462503 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3705e-39c9-47f9-9c8f-6bc12d8f4fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.462783 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3705e-39c9-47f9-9c8f-6bc12d8f4fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.463547 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3705e-39c9-47f9-9c8f-6bc12d8f4fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.465119 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3705e-39c9-47f9-9c8f-6bc12d8f4fcc admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.472529 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 792/1589] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:01.473384 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ad455-ad25-496c-9776-89a15a32ce1c admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.478153 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 798/1590] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:01.478153 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3705e-39c9-47f9-9c8f-6bc12d8f4fcc admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.483229 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ad455-ad25-496c-9776-89a15a32ce1c admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.485117 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3705e-39c9-47f9-9c8f-6bc12d8f4fcc admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.487863 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541f0b6-2611-4f72-af55-bc0efc203d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.488520 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541f0b6-2611-4f72-af55-bc0efc203d2e admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.488800 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541f0b6-2611-4f72-af55-bc0efc203d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.489158 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541f0b6-2611-4f72-af55-bc0efc203d2e admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.489850 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24d88b-9e10-4f97-a65c-9236c6a3490f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.489992 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541f0b6-2611-4f72-af55-bc0efc203d2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.490474 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24d88b-9e10-4f97-a65c-9236c6a3490f admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.490751 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24d88b-9e10-4f97-a65c-9236c6a3490f admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.491021 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24d88b-9e10-4f97-a65c-9236c6a3490f admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.491507 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541f0b6-2611-4f72-af55-bc0efc203d2e admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.491728 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24d88b-9e10-4f97-a65c-9236c6a3490f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.493296 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24d88b-9e10-4f97-a65c-9236c6a3490f admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.505894 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 793/1591] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:01.505894 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541f0b6-2611-4f72-af55-bc0efc203d2e admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.510199 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 799/1592] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:01.510199 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24d88b-9e10-4f97-a65c-9236c6a3490f admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.514279 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541f0b6-2611-4f72-af55-bc0efc203d2e admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.517725 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24d88b-9e10-4f97-a65c-9236c6a3490f admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.519334 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5f8c1-b6c7-4cb9-a468-a790ad41ff83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.520044 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5f8c1-b6c7-4cb9-a468-a790ad41ff83 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.520458 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5f8c1-b6c7-4cb9-a468-a790ad41ff83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.520710 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5f8c1-b6c7-4cb9-a468-a790ad41ff83 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.521502 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5f8c1-b6c7-4cb9-a468-a790ad41ff83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.523450 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5f8c1-b6c7-4cb9-a468-a790ad41ff83 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.523573 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144537b6-524d-44ae-a300-8579931e6e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.524131 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144537b6-524d-44ae-a300-8579931e6e0d admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.524432 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144537b6-524d-44ae-a300-8579931e6e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.524704 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144537b6-524d-44ae-a300-8579931e6e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.525461 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144537b6-524d-44ae-a300-8579931e6e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.527037 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144537b6-524d-44ae-a300-8579931e6e0d admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.536704 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 800/1593] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:01.537742 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144537b6-524d-44ae-a300-8579931e6e0d admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.545214 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 794/1594] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:01 2022] POST /identity/v3/users => generated 303 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:01.546046 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5f8c1-b6c7-4cb9-a468-a790ad41ff83 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.547739 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144537b6-524d-44ae-a300-8579931e6e0d admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.553483 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176f34d-ba29-48bb-aef2-9b91997183f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.554135 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176f34d-ba29-48bb-aef2-9b91997183f0 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.554539 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176f34d-ba29-48bb-aef2-9b91997183f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.554872 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176f34d-ba29-48bb-aef2-9b91997183f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.555497 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5f8c1-b6c7-4cb9-a468-a790ad41ff83 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.555609 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176f34d-ba29-48bb-aef2-9b91997183f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.557201 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176f34d-ba29-48bb-aef2-9b91997183f0 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.560042 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44a08e-c96c-4d91-8b27-5851598bbbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.560687 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44a08e-c96c-4d91-8b27-5851598bbbd3 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.560971 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44a08e-c96c-4d91-8b27-5851598bbbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.561247 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44a08e-c96c-4d91-8b27-5851598bbbd3 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.561963 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44a08e-c96c-4d91-8b27-5851598bbbd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.563858 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44a08e-c96c-4d91-8b27-5851598bbbd3 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.567314 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 801/1595] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:01.568107 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176f34d-ba29-48bb-aef2-9b91997183f0 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.578453 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176f34d-ba29-48bb-aef2-9b91997183f0 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.584032 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c60a4-5ac5-493e-9ddf-399e85a4ac5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.584674 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c60a4-5ac5-493e-9ddf-399e85a4ac5f admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.584950 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c60a4-5ac5-493e-9ddf-399e85a4ac5f admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.585214 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c60a4-5ac5-493e-9ddf-399e85a4ac5f admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.585952 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c60a4-5ac5-493e-9ddf-399e85a4ac5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.589402 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 795/1596] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:01 2022] POST /identity/v3/users => generated 295 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:01.589402 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44a08e-c96c-4d91-8b27-5851598bbbd3 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.589637 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c60a4-5ac5-493e-9ddf-399e85a4ac5f admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.596795 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44a08e-c96c-4d91-8b27-5851598bbbd3 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.600691 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 802/1597] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:01.600691 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c60a4-5ac5-493e-9ddf-399e85a4ac5f admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.601717 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1087481-261d-4f80-850f-730f7dea152e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.602361 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1087481-261d-4f80-850f-730f7dea152e admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.602693 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1087481-261d-4f80-850f-730f7dea152e admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.602964 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1087481-261d-4f80-850f-730f7dea152e admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.603729 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1087481-261d-4f80-850f-730f7dea152e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.605333 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1087481-261d-4f80-850f-730f7dea152e admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.607615 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c60a4-5ac5-493e-9ddf-399e85a4ac5f admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.612091 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58caa32a-7334-4375-87aa-8f7e65559461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.612717 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caa32a-7334-4375-87aa-8f7e65559461 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.613000 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caa32a-7334-4375-87aa-8f7e65559461 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.613283 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caa32a-7334-4375-87aa-8f7e65559461 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.614032 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58caa32a-7334-4375-87aa-8f7e65559461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.618265 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 796/1598] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:01.618404 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58caa32a-7334-4375-87aa-8f7e65559461 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.618490 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1087481-261d-4f80-850f-730f7dea152e admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.628507 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 803/1599] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:01.628507 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58caa32a-7334-4375-87aa-8f7e65559461 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.628745 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1087481-261d-4f80-850f-730f7dea152e admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.632514 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf924543-8cae-4edc-a788-84fbce0e6edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.633396 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf924543-8cae-4edc-a788-84fbce0e6edd admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.633671 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf924543-8cae-4edc-a788-84fbce0e6edd admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.633942 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf924543-8cae-4edc-a788-84fbce0e6edd admin admin] PATH_INFO: `/v3/projects/e3f5752b78974423ab169a772d26d27a/users/14bb5a0d28894d4fb2642d00f0832cbf/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.637336 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58caa32a-7334-4375-87aa-8f7e65559461 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.641981 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe97271-8e05-45e5-b01b-e5eeb8b066b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.642613 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe97271-8e05-45e5-b01b-e5eeb8b066b0 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.642893 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe97271-8e05-45e5-b01b-e5eeb8b066b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.643197 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe97271-8e05-45e5-b01b-e5eeb8b066b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.643868 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe97271-8e05-45e5-b01b-e5eeb8b066b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.645470 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe97271-8e05-45e5-b01b-e5eeb8b066b0 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.647843 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf924543-8cae-4edc-a788-84fbce0e6edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3f5752b78974423ab169a772d26d27a, user_id=14bb5a0d28894d4fb2642d00f0832cbf, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.650435 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf924543-8cae-4edc-a788-84fbce0e6edd admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.655342 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 804/1600] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:01.656343 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe97271-8e05-45e5-b01b-e5eeb8b066b0 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.665105 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 797/1601] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:01 2022] PUT /identity/v3/projects/e3f5752b78974423ab169a772d26d27a/users/14bb5a0d28894d4fb2642d00f0832cbf/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:01.666152 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf924543-8cae-4edc-a788-84fbce0e6edd admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.667109 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe97271-8e05-45e5-b01b-e5eeb8b066b0 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.721956 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920e710-4339-490c-97ff-c2598be18fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.722537 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920e710-4339-490c-97ff-c2598be18fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.722820 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920e710-4339-490c-97ff-c2598be18fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.723093 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920e710-4339-490c-97ff-c2598be18fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.723817 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920e710-4339-490c-97ff-c2598be18fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.725473 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920e710-4339-490c-97ff-c2598be18fc7 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.726070 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf924543-8cae-4edc-a788-84fbce0e6edd admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.730504 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99c4b5-d908-4cc4-9ed5-c85de51d5f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.731381 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99c4b5-d908-4cc4-9ed5-c85de51d5f36 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.731655 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99c4b5-d908-4cc4-9ed5-c85de51d5f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.731922 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99c4b5-d908-4cc4-9ed5-c85de51d5f36 admin admin] PATH_INFO: `/v3/projects/85b5d38df8e1448a8413767e35b96059/users/2fa3328befad4dc2a6ca63ee466dabbd/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.735035 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 805/1602] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:01.735895 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920e710-4339-490c-97ff-c2598be18fc7 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.746511 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99c4b5-d908-4cc4-9ed5-c85de51d5f36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85b5d38df8e1448a8413767e35b96059, user_id=2fa3328befad4dc2a6ca63ee466dabbd, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.747804 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920e710-4339-490c-97ff-c2598be18fc7 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.749121 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99c4b5-d908-4cc4-9ed5-c85de51d5f36 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.753834 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72ad5f-3018-4b85-8263-afda963b6b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.754530 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72ad5f-3018-4b85-8263-afda963b6b91 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.754826 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72ad5f-3018-4b85-8263-afda963b6b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.755277 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72ad5f-3018-4b85-8263-afda963b6b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.756073 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72ad5f-3018-4b85-8263-afda963b6b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.757820 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72ad5f-3018-4b85-8263-afda963b6b91 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.763818 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 798/1603] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:01 2022] PUT /identity/v3/projects/85b5d38df8e1448a8413767e35b96059/users/2fa3328befad4dc2a6ca63ee466dabbd/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:01.764657 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99c4b5-d908-4cc4-9ed5-c85de51d5f36 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.769387 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 806/1604] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:01.769387 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72ad5f-3018-4b85-8263-afda963b6b91 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.782797 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72ad5f-3018-4b85-8263-afda963b6b91 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.831177 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99c4b5-d908-4cc4-9ed5-c85de51d5f36 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.835676 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076572e-dad5-46d5-a8e9-bd6b0cecfe96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.835840 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babf8ae-6286-4b6e-9d08-a358c1761714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.836561 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076572e-dad5-46d5-a8e9-bd6b0cecfe96 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.836707 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babf8ae-6286-4b6e-9d08-a358c1761714 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.836840 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076572e-dad5-46d5-a8e9-bd6b0cecfe96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.836951 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babf8ae-6286-4b6e-9d08-a358c1761714 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.837111 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076572e-dad5-46d5-a8e9-bd6b0cecfe96 admin admin] PATH_INFO: `/v3/projects/d28c418d3a754eaf96737e31d1880818/users/6f10c9a6369247a6a53bb4552fabea8c/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.837277 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9babf8ae-6286-4b6e-9d08-a358c1761714 admin admin] PATH_INFO: `/v3/projects/c7acfedcdc124d9f9cebb8fdf43a7197/users/56a087b3138a4cb3be99fe8625152a72/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.851526 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076572e-dad5-46d5-a8e9-bd6b0cecfe96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d28c418d3a754eaf96737e31d1880818, user_id=6f10c9a6369247a6a53bb4552fabea8c, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.852590 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babf8ae-6286-4b6e-9d08-a358c1761714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7acfedcdc124d9f9cebb8fdf43a7197, user_id=56a087b3138a4cb3be99fe8625152a72, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.853754 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING py.warnings [None req-9babf8ae-6286-4b6e-9d08-a358c1761714 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:52:01.853754 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: warnings.warn(msg) Mar 08 13:52:01.853754 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: Mar 08 13:52:01.854345 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076572e-dad5-46d5-a8e9-bd6b0cecfe96 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.855813 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9babf8ae-6286-4b6e-9d08-a358c1761714 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.872122 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 799/1605] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:01 2022] PUT /identity/v3/projects/d28c418d3a754eaf96737e31d1880818/users/6f10c9a6369247a6a53bb4552fabea8c/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:01.872122 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076572e-dad5-46d5-a8e9-bd6b0cecfe96 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.872412 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 807/1606] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:01 2022] PUT /identity/v3/projects/c7acfedcdc124d9f9cebb8fdf43a7197/users/56a087b3138a4cb3be99fe8625152a72/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:01.872412 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babf8ae-6286-4b6e-9d08-a358c1761714 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.929036 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076572e-dad5-46d5-a8e9-bd6b0cecfe96 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.929380 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9babf8ae-6286-4b6e-9d08-a358c1761714 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:01.933699 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379768fb-6b6a-4d1f-a22c-4fd0e514ec8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.934448 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85883ccb-a7e3-40be-804c-dbc1cddbe2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:01.934923 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379768fb-6b6a-4d1f-a22c-4fd0e514ec8a admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.934923 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379768fb-6b6a-4d1f-a22c-4fd0e514ec8a admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.935086 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379768fb-6b6a-4d1f-a22c-4fd0e514ec8a admin admin] PATH_INFO: `/v3/projects/3a28c3e8d2dc4d46905bd41157532fd9/users/8d63599c0ea547408d2d9d1d886431db/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.935328 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85883ccb-a7e3-40be-804c-dbc1cddbe2d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.935603 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85883ccb-a7e3-40be-804c-dbc1cddbe2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.935856 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85883ccb-a7e3-40be-804c-dbc1cddbe2d9 admin admin] PATH_INFO: `/v3/projects/d5cce59f4fa34c97845a66af9d0d50b7/users/96c513ac69974de5a92297213bbb0e8a/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.950860 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85883ccb-a7e3-40be-804c-dbc1cddbe2d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5cce59f4fa34c97845a66af9d0d50b7, user_id=96c513ac69974de5a92297213bbb0e8a, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.951700 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379768fb-6b6a-4d1f-a22c-4fd0e514ec8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a28c3e8d2dc4d46905bd41157532fd9, user_id=8d63599c0ea547408d2d9d1d886431db, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:01.953871 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85883ccb-a7e3-40be-804c-dbc1cddbe2d9 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.954373 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379768fb-6b6a-4d1f-a22c-4fd0e514ec8a admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:01.969708 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 808/1607] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:01 2022] PUT /identity/v3/projects/d5cce59f4fa34c97845a66af9d0d50b7/users/96c513ac69974de5a92297213bbb0e8a/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:01.970216 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 800/1608] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:01 2022] PUT /identity/v3/projects/3a28c3e8d2dc4d46905bd41157532fd9/users/8d63599c0ea547408d2d9d1d886431db/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:01.970868 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379768fb-6b6a-4d1f-a22c-4fd0e514ec8a admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:01.971030 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25df2f6-2ef1-4ba8-b69d-fb32d10249b9 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:01.971237 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25df2f6-2ef1-4ba8-b69d-fb32d10249b9 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:01.971498 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25df2f6-2ef1-4ba8-b69d-fb32d10249b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:01.989553 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-b25df2f6-2ef1-4ba8-b69d-fb32d10249b9 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:01.990748 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-b25df2f6-2ef1-4ba8-b69d-fb32d10249b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:02.040494 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379768fb-6b6a-4d1f-a22c-4fd0e514ec8a admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:02.045595 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a654f3c-bec9-4493-af5b-de3b1cc8ba74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:02.046498 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a654f3c-bec9-4493-af5b-de3b1cc8ba74 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:02.046778 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a654f3c-bec9-4493-af5b-de3b1cc8ba74 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:02.047050 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a654f3c-bec9-4493-af5b-de3b1cc8ba74 admin admin] PATH_INFO: `/v3/projects/2d6f9bea276b432db444630bf6e25992/users/902497a0a2b44a2c9176b9443a313414/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:02.047162 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 809/1609] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:02.048011 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25df2f6-2ef1-4ba8-b69d-fb32d10249b9 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:02.057562 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25df2f6-2ef1-4ba8-b69d-fb32d10249b9 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:02.062402 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178db587-f438-434d-a77a-12e4423d0a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:02.062581 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a654f3c-bec9-4493-af5b-de3b1cc8ba74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d6f9bea276b432db444630bf6e25992, user_id=902497a0a2b44a2c9176b9443a313414, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:02.063210 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178db587-f438-434d-a77a-12e4423d0a4f admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:02.063524 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178db587-f438-434d-a77a-12e4423d0a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:02.063796 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178db587-f438-434d-a77a-12e4423d0a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:02.064564 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178db587-f438-434d-a77a-12e4423d0a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:02.065211 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a654f3c-bec9-4493-af5b-de3b1cc8ba74 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:02.066225 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178db587-f438-434d-a77a-12e4423d0a4f admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:02.077242 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 810/1610] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:02.078574 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f90aa-e16b-4637-8d80-7a312d2cee5f None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:02.078890 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f90aa-e16b-4637-8d80-7a312d2cee5f None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:02.079167 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f90aa-e16b-4637-8d80-7a312d2cee5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:02.084859 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 801/1611] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:01 2022] PUT /identity/v3/projects/2d6f9bea276b432db444630bf6e25992/users/902497a0a2b44a2c9176b9443a313414/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:02.086590 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2108f-7164-44b1-8fae-55fe0d2a2a7f None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:02.086908 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2108f-7164-44b1-8fae-55fe0d2a2a7f None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:02.087186 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2108f-7164-44b1-8fae-55fe0d2a2a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:02.103830 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-31a2108f-7164-44b1-8fae-55fe0d2a2a7f None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:02.105438 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-31a2108f-7164-44b1-8fae-55fe0d2a2a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:02.108802 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-755f90aa-e16b-4637-8d80-7a312d2cee5f None None] MFA Rules not processed for user `2fa3328befad4dc2a6ca63ee466dabbd`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:02.110017 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-755f90aa-e16b-4637-8d80-7a312d2cee5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:02.162383 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 802/1612] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:02.163945 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb0308-acf5-449b-8aeb-79a825d4902b None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:02.164520 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb0308-acf5-449b-8aeb-79a825d4902b None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:02.164952 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb0308-acf5-449b-8aeb-79a825d4902b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:02.176089 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 811/1613] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:02.177427 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c469d8-9ed9-4a60-8ef8-8cb2b29f78fb None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:02.178227 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c469d8-9ed9-4a60-8ef8-8cb2b29f78fb None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:02.178227 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c469d8-9ed9-4a60-8ef8-8cb2b29f78fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:02.191385 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-61eb0308-acf5-449b-8aeb-79a825d4902b None None] MFA Rules not processed for user `56a087b3138a4cb3be99fe8625152a72`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:02.192576 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-61eb0308-acf5-449b-8aeb-79a825d4902b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:02.195453 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-26c469d8-9ed9-4a60-8ef8-8cb2b29f78fb None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:02.196598 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-26c469d8-9ed9-4a60-8ef8-8cb2b29f78fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:02.204436 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 812/1614] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:02.205642 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f49f83-54a0-4860-8ce6-d23765e9de54 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:02.205899 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f49f83-54a0-4860-8ce6-d23765e9de54 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:02.206183 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f49f83-54a0-4860-8ce6-d23765e9de54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:02.231549 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-d4f49f83-54a0-4860-8ce6-d23765e9de54 None None] MFA Rules not processed for user `96c513ac69974de5a92297213bbb0e8a`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:02.232720 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-d4f49f83-54a0-4860-8ce6-d23765e9de54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:02.254013 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 803/1615] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:02.258252 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb0308-acf5-449b-8aeb-79a825d4902b None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:02.294776 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 813/1616] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:02.295656 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f49f83-54a0-4860-8ce6-d23765e9de54 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:02.307644 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f49f83-54a0-4860-8ce6-d23765e9de54 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:02.309808 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb0308-acf5-449b-8aeb-79a825d4902b None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:02.312673 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657aeb8e-d591-476c-a39a-2549944373ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:02.313603 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657aeb8e-d591-476c-a39a-2549944373ce admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:02.313778 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35408891-8d2b-4a4e-830e-6b7b7b3f30f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:02.313898 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657aeb8e-d591-476c-a39a-2549944373ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:02.314135 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657aeb8e-d591-476c-a39a-2549944373ce admin admin] PATH_INFO: `/v3/projects/98537a177d784e0cb148e3f73688f0c0/users/3f7d37d467324d88ae189dc8d89c314a/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:02.314431 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35408891-8d2b-4a4e-830e-6b7b7b3f30f2 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:02.314710 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35408891-8d2b-4a4e-830e-6b7b7b3f30f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:02.314984 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35408891-8d2b-4a4e-830e-6b7b7b3f30f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:02.326014 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35408891-8d2b-4a4e-830e-6b7b7b3f30f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:02.327854 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35408891-8d2b-4a4e-830e-6b7b7b3f30f2 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:02.329864 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657aeb8e-d591-476c-a39a-2549944373ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=98537a177d784e0cb148e3f73688f0c0, user_id=3f7d37d467324d88ae189dc8d89c314a, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:02.332524 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657aeb8e-d591-476c-a39a-2549944373ce admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:02.338318 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 804/1617] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:02.339301 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35408891-8d2b-4a4e-830e-6b7b7b3f30f2 service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:02.348808 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35408891-8d2b-4a4e-830e-6b7b7b3f30f2 service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:02.349420 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 814/1618] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:02 2022] PUT /identity/v3/projects/98537a177d784e0cb148e3f73688f0c0/users/3f7d37d467324d88ae189dc8d89c314a/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:02.351312 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657aeb8e-d591-476c-a39a-2549944373ce admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:02.406618 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df49ee7-0cc8-4a49-828a-e7e2b88baf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:02.407958 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df49ee7-0cc8-4a49-828a-e7e2b88baf62 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:02.407958 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df49ee7-0cc8-4a49-828a-e7e2b88baf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:02.407958 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df49ee7-0cc8-4a49-828a-e7e2b88baf62 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:02.408552 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df49ee7-0cc8-4a49-828a-e7e2b88baf62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:02.410193 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df49ee7-0cc8-4a49-828a-e7e2b88baf62 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:02.412087 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657aeb8e-d591-476c-a39a-2549944373ce admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:02.418154 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ebcd5-f685-4222-bf5a-ac0216b98e5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:02.418939 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ebcd5-f685-4222-bf5a-ac0216b98e5a service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:02.419217 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ebcd5-f685-4222-bf5a-ac0216b98e5a service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:02.419539 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ebcd5-f685-4222-bf5a-ac0216b98e5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:02.421076 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 805/1619] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:02.424501 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df49ee7-0cc8-4a49-828a-e7e2b88baf62 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:02.432682 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ebcd5-f685-4222-bf5a-ac0216b98e5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:02.434495 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1ebcd5-f685-4222-bf5a-ac0216b98e5a service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:02.445485 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 815/1620] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:02.446333 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ebcd5-f685-4222-bf5a-ac0216b98e5a service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:02.454764 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1ebcd5-f685-4222-bf5a-ac0216b98e5a service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:02.459126 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26042d-3796-44cc-9869-91c0c129d64c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:02.459744 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26042d-3796-44cc-9869-91c0c129d64c service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:02.460024 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26042d-3796-44cc-9869-91c0c129d64c service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:02.460299 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26042d-3796-44cc-9869-91c0c129d64c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:02.474100 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26042d-3796-44cc-9869-91c0c129d64c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:02.475661 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26042d-3796-44cc-9869-91c0c129d64c service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:02.483301 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df49ee7-0cc8-4a49-828a-e7e2b88baf62 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:02.487739 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770d1f4-70e3-459c-9345-e2e6a32cb727 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:02.488580 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770d1f4-70e3-459c-9345-e2e6a32cb727 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:02.488837 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770d1f4-70e3-459c-9345-e2e6a32cb727 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:02.489124 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770d1f4-70e3-459c-9345-e2e6a32cb727 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:02.491026 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 816/1621] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:02.492069 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26042d-3796-44cc-9869-91c0c129d64c service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:02.506942 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26042d-3796-44cc-9869-91c0c129d64c service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:02.512326 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888906f-f183-42eb-a30d-348663f2081a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:02.513122 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888906f-f183-42eb-a30d-348663f2081a admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:02.513443 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888906f-f183-42eb-a30d-348663f2081a admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:02.513719 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888906f-f183-42eb-a30d-348663f2081a admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:02.514445 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888906f-f183-42eb-a30d-348663f2081a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:02.516393 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888906f-f183-42eb-a30d-348663f2081a admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:02.548364 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 817/1622] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:02 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:02.551065 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770d1f4-70e3-459c-9345-e2e6a32cb727 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:02.551527 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80643c8-1469-49dc-aeb8-92c647d72e9d None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:02.551943 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80643c8-1469-49dc-aeb8-92c647d72e9d None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:02.552447 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770d1f4-70e3-459c-9345-e2e6a32cb727 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:02.552693 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80643c8-1469-49dc-aeb8-92c647d72e9d None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:02.555217 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 818/1623] 10.222.0.18 () {54 vars in 961 bytes} [Tue Mar 8 13:52:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:52:02.556836 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38b6d7-c089-4c74-ba83-626553fcb94b None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:02.557635 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38b6d7-c089-4c74-ba83-626553fcb94b None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:02.557635 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38b6d7-c089-4c74-ba83-626553fcb94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:02.565417 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 806/1624] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:02 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:02.566193 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770d1f4-70e3-459c-9345-e2e6a32cb727 service cinder] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:02.576926 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-ce38b6d7-c089-4c74-ba83-626553fcb94b None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:02.578242 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-ce38b6d7-c089-4c74-ba83-626553fcb94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:02.578921 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770d1f4-70e3-459c-9345-e2e6a32cb727 service cinder] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:02.657442 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 819/1625] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:02.658593 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38b6d7-c089-4c74-ba83-626553fcb94b None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:02.668836 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1058339-9418-41e7-b9a8-70b4295c1c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:02.669867 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1058339-9418-41e7-b9a8-70b4295c1c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:02.670168 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1058339-9418-41e7-b9a8-70b4295c1c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:02.671286 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1058339-9418-41e7-b9a8-70b4295c1c63 admin admin] PATH_INFO: `/v3/projects/2d6f9bea276b432db444630bf6e25992/users/902497a0a2b44a2c9176b9443a313414/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:02.673330 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1058339-9418-41e7-b9a8-70b4295c1c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d6f9bea276b432db444630bf6e25992, user_id=902497a0a2b44a2c9176b9443a313414, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:02.676305 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1058339-9418-41e7-b9a8-70b4295c1c63 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:02.681578 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38b6d7-c089-4c74-ba83-626553fcb94b None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:02.688158 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7e743-631c-4549-a51a-f5bfa19c108d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:02.689082 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7e743-631c-4549-a51a-f5bfa19c108d admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:02.689547 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7e743-631c-4549-a51a-f5bfa19c108d admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:02.690177 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7e743-631c-4549-a51a-f5bfa19c108d admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:02.691327 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7e743-631c-4549-a51a-f5bfa19c108d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:02.692383 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 807/1626] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:02 2022] PUT /identity/v3/projects/2d6f9bea276b432db444630bf6e25992/users/902497a0a2b44a2c9176b9443a313414/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:02.694099 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193ffa5-2288-4ae2-9a58-f5a8f6afbbc8 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:02.694554 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7e743-631c-4549-a51a-f5bfa19c108d admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:02.694695 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193ffa5-2288-4ae2-9a58-f5a8f6afbbc8 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:02.695103 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193ffa5-2288-4ae2-9a58-f5a8f6afbbc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:02.722153 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 820/1627] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:02 2022] POST /identity/v3/users => generated 289 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:02.725589 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7e743-631c-4549-a51a-f5bfa19c108d admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:02.726633 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-a3d7e743-631c-4549-a51a-f5bfa19c108d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:02.729870 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-7193ffa5-2288-4ae2-9a58-f5a8f6afbbc8 None None] MFA Rules not processed for user `21ec894123044d4382995791c74c587b`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:02.731144 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-7193ffa5-2288-4ae2-9a58-f5a8f6afbbc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:02.805598 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7e743-631c-4549-a51a-f5bfa19c108d admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:02.840630 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 808/1628] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Mar 8 13:52:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:02.843798 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5bda5-0802-420a-8217-ef3659831734 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:02.844125 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5bda5-0802-420a-8217-ef3659831734 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:02.844401 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5bda5-0802-420a-8217-ef3659831734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:02.872027 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc801704-065c-4a29-8bf0-29f8ed96adbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:02.872917 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc801704-065c-4a29-8bf0-29f8ed96adbd service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:02.873399 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc801704-065c-4a29-8bf0-29f8ed96adbd service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:02.873775 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc801704-065c-4a29-8bf0-29f8ed96adbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:02.893943 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-d1d5bda5-0802-420a-8217-ef3659831734 None None] MFA Rules not processed for user `902497a0a2b44a2c9176b9443a313414`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:02.900147 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-d1d5bda5-0802-420a-8217-ef3659831734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:02.981886 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc801704-065c-4a29-8bf0-29f8ed96adbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:02.984479 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc801704-065c-4a29-8bf0-29f8ed96adbd service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:03.003080 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 821/1629] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:03.004710 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc801704-065c-4a29-8bf0-29f8ed96adbd service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:03.018064 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc801704-065c-4a29-8bf0-29f8ed96adbd service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:03.025019 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47728c-eedb-4d25-b3ff-e64c5cdbc9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:03.025798 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47728c-eedb-4d25-b3ff-e64c5cdbc9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:03.026078 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47728c-eedb-4d25-b3ff-e64c5cdbc9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:03.026484 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47728c-eedb-4d25-b3ff-e64c5cdbc9b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:03.027428 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47728c-eedb-4d25-b3ff-e64c5cdbc9b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:03.029186 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47728c-eedb-4d25-b3ff-e64c5cdbc9b2 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:03.044267 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 822/1630] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:03.045681 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47728c-eedb-4d25-b3ff-e64c5cdbc9b2 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:03.074229 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47728c-eedb-4d25-b3ff-e64c5cdbc9b2 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:03.079285 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 809/1631] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:03.080636 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5bda5-0802-420a-8217-ef3659831734 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:03.085193 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c776dc-a665-4a13-a94d-ff7ef9ac45aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:03.086057 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c776dc-a665-4a13-a94d-ff7ef9ac45aa service nova] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:03.086389 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c776dc-a665-4a13-a94d-ff7ef9ac45aa service nova] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:03.086857 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c776dc-a665-4a13-a94d-ff7ef9ac45aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:03.106969 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5bda5-0802-420a-8217-ef3659831734 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:03.114434 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e66e74-7356-4c22-bbc3-827e91ca5cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:03.115668 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e66e74-7356-4c22-bbc3-827e91ca5cac admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:03.116204 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e66e74-7356-4c22-bbc3-827e91ca5cac admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:03.116706 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e66e74-7356-4c22-bbc3-827e91ca5cac admin admin] PATH_INFO: `/v3/projects/9f15c3808aac456a9b30b842d11e3508/users/23cc5d71fc264d5d9a7c601f8a21c064/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:03.146258 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c776dc-a665-4a13-a94d-ff7ef9ac45aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:03.148377 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e66e74-7356-4c22-bbc3-827e91ca5cac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f15c3808aac456a9b30b842d11e3508, user_id=23cc5d71fc264d5d9a7c601f8a21c064, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:03.149005 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c776dc-a665-4a13-a94d-ff7ef9ac45aa service nova] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:03.152339 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e66e74-7356-4c22-bbc3-827e91ca5cac admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:03.170551 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 823/1632] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:03.171519 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c776dc-a665-4a13-a94d-ff7ef9ac45aa service nova] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:03.196365 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 810/1633] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:03 2022] PUT /identity/v3/projects/9f15c3808aac456a9b30b842d11e3508/users/23cc5d71fc264d5d9a7c601f8a21c064/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:03.200430 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e66e74-7356-4c22-bbc3-827e91ca5cac admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:03.285943 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c776dc-a665-4a13-a94d-ff7ef9ac45aa service nova] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:03.378521 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e66e74-7356-4c22-bbc3-827e91ca5cac admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:03.394374 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed49ac-168d-4409-9f9a-032b1118d17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:03.395075 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed49ac-168d-4409-9f9a-032b1118d17e admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:03.395353 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed49ac-168d-4409-9f9a-032b1118d17e admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:03.395624 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed49ac-168d-4409-9f9a-032b1118d17e admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:03.395745 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd7444-7bc4-48b9-9e75-2f95e2007de6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:03.396276 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd7444-7bc4-48b9-9e75-2f95e2007de6 service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:03.396462 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed49ac-168d-4409-9f9a-032b1118d17e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:03.396619 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd7444-7bc4-48b9-9e75-2f95e2007de6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:03.396893 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd7444-7bc4-48b9-9e75-2f95e2007de6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:03.400232 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed49ac-168d-4409-9f9a-032b1118d17e admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:03.448391 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 811/1634] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:03.450419 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed49ac-168d-4409-9f9a-032b1118d17e admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:03.479438 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed49ac-168d-4409-9f9a-032b1118d17e admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:03.495186 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff35583-91fd-4218-b5e1-0f1dfc5c521b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:03.495910 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff35583-91fd-4218-b5e1-0f1dfc5c521b admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:03.496049 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff35583-91fd-4218-b5e1-0f1dfc5c521b admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:03.496212 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff35583-91fd-4218-b5e1-0f1dfc5c521b admin admin] PATH_INFO: `/v3/projects/9f15c3808aac456a9b30b842d11e3508/users/23cc5d71fc264d5d9a7c601f8a21c064/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:03.502886 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff35583-91fd-4218-b5e1-0f1dfc5c521b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f15c3808aac456a9b30b842d11e3508, user_id=23cc5d71fc264d5d9a7c601f8a21c064, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:03.509051 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff35583-91fd-4218-b5e1-0f1dfc5c521b admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:03.513795 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd7444-7bc4-48b9-9e75-2f95e2007de6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:03.515244 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd7444-7bc4-48b9-9e75-2f95e2007de6 service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:03.532452 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 812/1635] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:03 2022] PUT /identity/v3/projects/9f15c3808aac456a9b30b842d11e3508/users/23cc5d71fc264d5d9a7c601f8a21c064/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:03.542277 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11f6f1-ba59-4330-869e-284679000b64 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:03.543301 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11f6f1-ba59-4330-869e-284679000b64 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:03.543770 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11f6f1-ba59-4330-869e-284679000b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:03.545024 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 824/1636] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:03.585701 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-bf11f6f1-ba59-4330-869e-284679000b64 None None] MFA Rules not processed for user `23cc5d71fc264d5d9a7c601f8a21c064`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:03.587129 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-bf11f6f1-ba59-4330-869e-284679000b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:03.636823 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241da87-fbc4-4621-ad3a-02e4f9514341 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:03.637410 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241da87-fbc4-4621-ad3a-02e4f9514341 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:03.637832 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241da87-fbc4-4621-ad3a-02e4f9514341 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:03.639949 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 825/1637] 10.222.0.18 () {54 vars in 912 bytes} [Tue Mar 8 13:52:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:52:03.646988 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7321354-b7e3-4448-a947-782f4e30f522 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:03.647548 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7321354-b7e3-4448-a947-782f4e30f522 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:03.648240 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7321354-b7e3-4448-a947-782f4e30f522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:03.684142 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-e7321354-b7e3-4448-a947-782f4e30f522 None None] MFA Rules not processed for user `21ec894123044d4382995791c74c587b`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:03.686693 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-e7321354-b7e3-4448-a947-782f4e30f522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:03.709449 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 813/1638] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:03 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:03.709449 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11f6f1-ba59-4330-869e-284679000b64 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:03.770793 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11f6f1-ba59-4330-869e-284679000b64 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:03.774711 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaceb7d-882e-4153-bdf9-8431ed57aba6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:03.775452 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaceb7d-882e-4153-bdf9-8431ed57aba6 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:03.775793 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaceb7d-882e-4153-bdf9-8431ed57aba6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:03.776124 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaceb7d-882e-4153-bdf9-8431ed57aba6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:03.777813 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 826/1639] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Mar 8 13:52:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:03.778665 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7321354-b7e3-4448-a947-782f4e30f522 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:03.788499 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7321354-b7e3-4448-a947-782f4e30f522 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:03.792924 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138a105-2f16-4dbf-9fd6-f21cab726b77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:03.793417 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138a105-2f16-4dbf-9fd6-f21cab726b77 service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:03.794233 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138a105-2f16-4dbf-9fd6-f21cab726b77 service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:03.794233 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f138a105-2f16-4dbf-9fd6-f21cab726b77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:03.805619 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138a105-2f16-4dbf-9fd6-f21cab726b77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:03.807576 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f138a105-2f16-4dbf-9fd6-f21cab726b77 service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:03.831482 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 827/1640] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:03 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:03.849279 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaceb7d-882e-4153-bdf9-8431ed57aba6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:03.852561 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaceb7d-882e-4153-bdf9-8431ed57aba6 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:03.863892 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 814/1641] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:03.917234 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138a105-2f16-4dbf-9fd6-f21cab726b77 service cinder] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:03.927772 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f138a105-2f16-4dbf-9fd6-f21cab726b77 service cinder] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:03.932582 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d5bc53-df59-42ad-a395-4ecbba92b7bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:03.933235 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5bc53-df59-42ad-a395-4ecbba92b7bf service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:03.933624 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5bc53-df59-42ad-a395-4ecbba92b7bf service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:03.933993 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d5bc53-df59-42ad-a395-4ecbba92b7bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:03.947059 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5bc53-df59-42ad-a395-4ecbba92b7bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:03.948926 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d5bc53-df59-42ad-a395-4ecbba92b7bf service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:03.975104 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 828/1642] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:04.916107 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaceb7d-882e-4153-bdf9-8431ed57aba6 service cinder] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:05.026004 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaceb7d-882e-4153-bdf9-8431ed57aba6 service cinder] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:05.031197 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096baa0a-6691-46b1-be0a-93970126b412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:05.032625 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096baa0a-6691-46b1-be0a-93970126b412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:05.033050 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096baa0a-6691-46b1-be0a-93970126b412 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:05.033495 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096baa0a-6691-46b1-be0a-93970126b412 admin admin] PATH_INFO: `/v3/users/56a087b3138a4cb3be99fe8625152a72` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:05.035180 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096baa0a-6691-46b1-be0a-93970126b412 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56a087b3138a4cb3be99fe8625152a72)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:05.037282 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096baa0a-6691-46b1-be0a-93970126b412 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:05.102830 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236bb79-c14c-43f4-8142-c97a8caacf82 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:05.103562 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236bb79-c14c-43f4-8142-c97a8caacf82 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:05.103562 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236bb79-c14c-43f4-8142-c97a8caacf82 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:05.105223 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 829/1643] 10.222.0.18 () {54 vars in 961 bytes} [Tue Mar 8 13:52:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:52:05.112275 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdd57d-07df-42bd-a7c7-55f55c70acf5 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:05.112902 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdd57d-07df-42bd-a7c7-55f55c70acf5 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:05.113462 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdd57d-07df-42bd-a7c7-55f55c70acf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:05.127228 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-096baa0a-6691-46b1-be0a-93970126b412 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56a087b3138a4cb3be99fe8625152a72'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:05.128998 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-096baa0a-6691-46b1-be0a-93970126b412 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56a087b3138a4cb3be99fe8625152a72'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:05.136943 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-24fdd57d-07df-42bd-a7c7-55f55c70acf5 None None] MFA Rules not processed for user `21ec894123044d4382995791c74c587b`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:05.138909 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-24fdd57d-07df-42bd-a7c7-55f55c70acf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:05.148622 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-096baa0a-6691-46b1-be0a-93970126b412 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56a087b3138a4cb3be99fe8625152a72'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:05.156349 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 830/1644] 10.222.0.18 () {58 vars in 1058 bytes} [Tue Mar 8 13:52:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:05.158246 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d88674-fb9d-4144-b8d7-c7802fe7f06f None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:05.158935 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d88674-fb9d-4144-b8d7-c7802fe7f06f None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:05.159499 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d88674-fb9d-4144-b8d7-c7802fe7f06f None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:05.167218 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 831/1645] 10.222.0.18 () {54 vars in 912 bytes} [Tue Mar 8 13:52:05 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:52:05.169323 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b26c54-9ce9-40af-8f7c-565724bb2150 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:05.169842 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b26c54-9ce9-40af-8f7c-565724bb2150 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:05.169965 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-096baa0a-6691-46b1-be0a-93970126b412 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56a087b3138a4cb3be99fe8625152a72'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:05.170548 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b26c54-9ce9-40af-8f7c-565724bb2150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:05.192755 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-06b26c54-9ce9-40af-8f7c-565724bb2150 None None] MFA Rules not processed for user `21ec894123044d4382995791c74c587b`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:05.194584 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-06b26c54-9ce9-40af-8f7c-565724bb2150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:05.195281 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-096baa0a-6691-46b1-be0a-93970126b412 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56a087b3138a4cb3be99fe8625152a72'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:05.213713 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 815/1646] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:04 2022] DELETE /identity/v3/users/56a087b3138a4cb3be99fe8625152a72 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:05.214910 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cbd2a-89ef-4399-8c38-c52e2a5e826c None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:05.218874 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 832/1647] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Mar 8 13:52:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:05.219252 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cbd2a-89ef-4399-8c38-c52e2a5e826c None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:05.219610 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cbd2a-89ef-4399-8c38-c52e2a5e826c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:05.222129 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e831a-0d6c-4a68-9758-ba6a09069489 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:05.222694 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e831a-0d6c-4a68-9758-ba6a09069489 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:05.223182 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127e831a-0d6c-4a68-9758-ba6a09069489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:05.242669 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-127e831a-0d6c-4a68-9758-ba6a09069489 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:05.244316 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-127e831a-0d6c-4a68-9758-ba6a09069489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:05.280602 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-c47cbd2a-89ef-4399-8c38-c52e2a5e826c None None] MFA Rules not processed for user `6f10c9a6369247a6a53bb4552fabea8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:05.285192 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-c47cbd2a-89ef-4399-8c38-c52e2a5e826c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:05.315255 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 833/1648] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:05.316322 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e831a-0d6c-4a68-9758-ba6a09069489 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:05.318961 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-127e831a-0d6c-4a68-9758-ba6a09069489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:05.380252 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127e831a-0d6c-4a68-9758-ba6a09069489 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:05.385051 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b01a88-4ec6-4370-a3e7-1317a0ec5404 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:05.385924 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b01a88-4ec6-4370-a3e7-1317a0ec5404 service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:05.386370 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b01a88-4ec6-4370-a3e7-1317a0ec5404 service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:05.386823 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b01a88-4ec6-4370-a3e7-1317a0ec5404 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:05.426622 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 816/1649] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:05.427743 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cbd2a-89ef-4399-8c38-c52e2a5e826c None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:05.432951 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-c47cbd2a-89ef-4399-8c38-c52e2a5e826c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:05.488726 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b01a88-4ec6-4370-a3e7-1317a0ec5404 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:05.492815 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b01a88-4ec6-4370-a3e7-1317a0ec5404 service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:05.518652 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 834/1650] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:05.520204 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97d3f5-583d-4dc0-b20b-5e57212a39b7 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:05.520489 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97d3f5-583d-4dc0-b20b-5e57212a39b7 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:05.520760 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97d3f5-583d-4dc0-b20b-5e57212a39b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:05.553675 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-4b97d3f5-583d-4dc0-b20b-5e57212a39b7 None None] MFA Rules not processed for user `6f10c9a6369247a6a53bb4552fabea8c`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:05.558034 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cbd2a-89ef-4399-8c38-c52e2a5e826c None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:05.561405 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-4b97d3f5-583d-4dc0-b20b-5e57212a39b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:05.565941 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41965e1-97fe-4396-a1b9-2c2b2c39a404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:05.566616 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41965e1-97fe-4396-a1b9-2c2b2c39a404 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:05.566893 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41965e1-97fe-4396-a1b9-2c2b2c39a404 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:05.567161 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41965e1-97fe-4396-a1b9-2c2b2c39a404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:05.583301 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 835/1651] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:05.588105 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41965e1-97fe-4396-a1b9-2c2b2c39a404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:05.590065 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41965e1-97fe-4396-a1b9-2c2b2c39a404 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:05.597218 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97d3f5-583d-4dc0-b20b-5e57212a39b7 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:05.601697 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 817/1652] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:05.602252 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-4b97d3f5-583d-4dc0-b20b-5e57212a39b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:05.638250 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97d3f5-583d-4dc0-b20b-5e57212a39b7 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:05.655594 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023bdcd9-8451-446a-9bb9-542793bf26db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:05.656552 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bdcd9-8451-446a-9bb9-542793bf26db service nova] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:05.657054 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bdcd9-8451-446a-9bb9-542793bf26db service nova] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:05.657462 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023bdcd9-8451-446a-9bb9-542793bf26db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:05.690665 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bdcd9-8451-446a-9bb9-542793bf26db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:05.692468 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023bdcd9-8451-446a-9bb9-542793bf26db service nova] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:05.732840 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 836/1653] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:06.410230 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adba19-acce-483b-8b68-b7cadb6d8247 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:06.410815 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adba19-acce-483b-8b68-b7cadb6d8247 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:06.410895 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adba19-acce-483b-8b68-b7cadb6d8247 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:06.413012 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 818/1654] 10.222.0.18 () {54 vars in 912 bytes} [Tue Mar 8 13:52:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:52:06.424818 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17b563-00b4-4ca3-997f-7232bdb34a32 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:06.425343 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17b563-00b4-4ca3-997f-7232bdb34a32 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:06.425343 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17b563-00b4-4ca3-997f-7232bdb34a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:06.551582 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-1b17b563-00b4-4ca3-997f-7232bdb34a32 None None] MFA Rules not processed for user `4c610d719b3049f98b95cc8e9bd56834`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:06.553133 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-1b17b563-00b4-4ca3-997f-7232bdb34a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:06.577666 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 837/1655] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Mar 8 13:52:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:06.591609 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32adba19-acce-483b-8b68-b7cadb6d8247 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:06.595058 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-32adba19-acce-483b-8b68-b7cadb6d8247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:06.615815 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32adba19-acce-483b-8b68-b7cadb6d8247 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:06.627184 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976ecd32-efa4-4388-9921-02aa596a9877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:06.627904 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ecd32-efa4-4388-9921-02aa596a9877 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:06.628188 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ecd32-efa4-4388-9921-02aa596a9877 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:06.628463 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976ecd32-efa4-4388-9921-02aa596a9877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:06.650963 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ecd32-efa4-4388-9921-02aa596a9877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:06.652427 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976ecd32-efa4-4388-9921-02aa596a9877 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:06.674298 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 819/1656] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:07.740297 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17b563-00b4-4ca3-997f-7232bdb34a32 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:07.743564 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-1b17b563-00b4-4ca3-997f-7232bdb34a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:07.824693 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17b563-00b4-4ca3-997f-7232bdb34a32 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:07.857760 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3a08d-951d-44a2-8ffd-673adc064865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:07.860447 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3a08d-951d-44a2-8ffd-673adc064865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:07.860807 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3a08d-951d-44a2-8ffd-673adc064865 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:07.862336 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3a08d-951d-44a2-8ffd-673adc064865 admin admin] PATH_INFO: `/v3/projects/c7acfedcdc124d9f9cebb8fdf43a7197` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:07.870729 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3a08d-951d-44a2-8ffd-673adc064865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7acfedcdc124d9f9cebb8fdf43a7197)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:07.884673 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3a08d-951d-44a2-8ffd-673adc064865 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:08.002800 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945a2d6-dacc-477a-8678-973fced01ae1 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:08.003359 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945a2d6-dacc-477a-8678-973fced01ae1 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:08.003441 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945a2d6-dacc-477a-8678-973fced01ae1 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:08.007040 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 820/1657] 10.222.0.18 () {54 vars in 960 bytes} [Tue Mar 8 13:52:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:52:08.017997 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f06164-d3ff-4e4f-912c-fa90f5aac07a None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:08.018623 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f06164-d3ff-4e4f-912c-fa90f5aac07a None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:08.019133 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f06164-d3ff-4e4f-912c-fa90f5aac07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:08.049604 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-14f06164-d3ff-4e4f-912c-fa90f5aac07a None None] MFA Rules not processed for user `6e2e8458589b45fa8c91b0d95840e45e`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:08.051331 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-14f06164-d3ff-4e4f-912c-fa90f5aac07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:08.060988 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-0cd3a08d-951d-44a2-8ffd-673adc064865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7acfedcdc124d9f9cebb8fdf43a7197', 'request_id': 'req-0cd3a08d-951d-44a2-8ffd-673adc064865'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:08.080236 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-0cd3a08d-951d-44a2-8ffd-673adc064865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7acfedcdc124d9f9cebb8fdf43a7197', 'request_id': 'req-0cd3a08d-951d-44a2-8ffd-673adc064865'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:08.105917 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-0cd3a08d-951d-44a2-8ffd-673adc064865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7acfedcdc124d9f9cebb8fdf43a7197', 'request_id': 'req-0cd3a08d-951d-44a2-8ffd-673adc064865'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:08.135295 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-0cd3a08d-951d-44a2-8ffd-673adc064865 admin admin] The token cache is being invalidate because project c7acfedcdc124d9f9cebb8fdf43a7197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:08.135496 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-0cd3a08d-951d-44a2-8ffd-673adc064865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:08.137234 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-0cd3a08d-951d-44a2-8ffd-673adc064865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:08.141969 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 838/1658] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:07 2022] DELETE /identity/v3/projects/c7acfedcdc124d9f9cebb8fdf43a7197 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:08.146269 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3a08d-951d-44a2-8ffd-673adc064865 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:08.147946 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-0cd3a08d-951d-44a2-8ffd-673adc064865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:08.173792 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 821/1659] 10.222.0.18 () {58 vars in 1057 bytes} [Tue Mar 8 13:52:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:08.182975 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f06164-d3ff-4e4f-912c-fa90f5aac07a None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:08.196413 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f06164-d3ff-4e4f-912c-fa90f5aac07a None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:08.207208 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6a856-9263-4b38-aaa5-d10f1a801dd7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2e8458589b45fa8c91b0d95840e45e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:08.210223 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6a856-9263-4b38-aaa5-d10f1a801dd7 service placement] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:08.211419 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6a856-9263-4b38-aaa5-d10f1a801dd7 service placement] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:08.212961 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6a856-9263-4b38-aaa5-d10f1a801dd7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:08.218978 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-9bc6a856-9263-4b38-aaa5-d10f1a801dd7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:08.253300 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6a856-9263-4b38-aaa5-d10f1a801dd7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:08.254925 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6a856-9263-4b38-aaa5-d10f1a801dd7 service placement] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:08.264523 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3a08d-951d-44a2-8ffd-673adc064865 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:08.273585 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b536036-2d0e-453c-9c3d-408fda15a7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:08.274707 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 822/1660] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:52:08.275084 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b536036-2d0e-453c-9c3d-408fda15a7d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:08.275569 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b536036-2d0e-453c-9c3d-408fda15a7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:08.276046 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b536036-2d0e-453c-9c3d-408fda15a7d2 admin admin] PATH_INFO: `/v3/users/23cc5d71fc264d5d9a7c601f8a21c064` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:08.277573 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b536036-2d0e-453c-9c3d-408fda15a7d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23cc5d71fc264d5d9a7c601f8a21c064)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:08.279909 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: WARNING py.warnings [None req-8b536036-2d0e-453c-9c3d-408fda15a7d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:52:08.279909 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: warnings.warn(msg) Mar 08 13:52:08.279909 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: Mar 08 13:52:08.285167 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b536036-2d0e-453c-9c3d-408fda15a7d2 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:08.404222 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8b536036-2d0e-453c-9c3d-408fda15a7d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23cc5d71fc264d5d9a7c601f8a21c064'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:08.404925 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8b536036-2d0e-453c-9c3d-408fda15a7d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23cc5d71fc264d5d9a7c601f8a21c064'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:08.420311 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8b536036-2d0e-453c-9c3d-408fda15a7d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23cc5d71fc264d5d9a7c601f8a21c064'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:08.490095 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8b536036-2d0e-453c-9c3d-408fda15a7d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23cc5d71fc264d5d9a7c601f8a21c064'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:08.544389 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8b536036-2d0e-453c-9c3d-408fda15a7d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23cc5d71fc264d5d9a7c601f8a21c064'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:08.557692 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 839/1661] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:08 2022] DELETE /identity/v3/users/23cc5d71fc264d5d9a7c601f8a21c064 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:09.476375 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6a856-9263-4b38-aaa5-d10f1a801dd7 service placement] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:09.496913 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6a856-9263-4b38-aaa5-d10f1a801dd7 service placement] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:09.649192 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64feb497-0419-486a-bbd2-4b56f8a4c7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:09.650022 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64feb497-0419-486a-bbd2-4b56f8a4c7b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:09.650297 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64feb497-0419-486a-bbd2-4b56f8a4c7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:09.650567 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64feb497-0419-486a-bbd2-4b56f8a4c7b5 admin admin] PATH_INFO: `/v3/projects/9f15c3808aac456a9b30b842d11e3508` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:09.658251 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64feb497-0419-486a-bbd2-4b56f8a4c7b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f15c3808aac456a9b30b842d11e3508)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:09.659303 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: WARNING py.warnings [None req-64feb497-0419-486a-bbd2-4b56f8a4c7b5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Mar 08 13:52:09.659303 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: warnings.warn(msg) Mar 08 13:52:09.659303 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: Mar 08 13:52:09.660490 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64feb497-0419-486a-bbd2-4b56f8a4c7b5 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:09.778267 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-64feb497-0419-486a-bbd2-4b56f8a4c7b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f15c3808aac456a9b30b842d11e3508', 'request_id': 'req-64feb497-0419-486a-bbd2-4b56f8a4c7b5'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:09.803358 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-64feb497-0419-486a-bbd2-4b56f8a4c7b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f15c3808aac456a9b30b842d11e3508', 'request_id': 'req-64feb497-0419-486a-bbd2-4b56f8a4c7b5'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:09.821805 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-64feb497-0419-486a-bbd2-4b56f8a4c7b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f15c3808aac456a9b30b842d11e3508', 'request_id': 'req-64feb497-0419-486a-bbd2-4b56f8a4c7b5'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:09.863738 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-64feb497-0419-486a-bbd2-4b56f8a4c7b5 admin admin] The token cache is being invalidate because project 9f15c3808aac456a9b30b842d11e3508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:09.864396 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-64feb497-0419-486a-bbd2-4b56f8a4c7b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:09.865463 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-64feb497-0419-486a-bbd2-4b56f8a4c7b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:09.867246 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 823/1662] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:09 2022] DELETE /identity/v3/projects/9f15c3808aac456a9b30b842d11e3508 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:09.873265 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877f844-0130-405c-a43b-833a5e60e107 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:09.873759 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877f844-0130-405c-a43b-833a5e60e107 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:09.874596 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877f844-0130-405c-a43b-833a5e60e107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:09.926702 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-9877f844-0130-405c-a43b-833a5e60e107 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:09.930327 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-9877f844-0130-405c-a43b-833a5e60e107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:10.173202 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e9139-018d-4d7c-9bfc-a22f4ea0d35f None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:10.173735 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e9139-018d-4d7c-9bfc-a22f4ea0d35f None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:10.174233 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e9139-018d-4d7c-9bfc-a22f4ea0d35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:10.184698 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 840/1663] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:10.258400 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-ff1e9139-018d-4d7c-9bfc-a22f4ea0d35f None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:10.258400 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-ff1e9139-018d-4d7c-9bfc-a22f4ea0d35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:10.258400 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 824/1664] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:10.261442 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877f844-0130-405c-a43b-833a5e60e107 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:10.277585 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877f844-0130-405c-a43b-833a5e60e107 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:10.296054 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6724b-fccf-4ed6-af6a-9362b3de176e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:10.296988 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6724b-fccf-4ed6-af6a-9362b3de176e admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:10.308218 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6724b-fccf-4ed6-af6a-9362b3de176e admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:10.309125 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6724b-fccf-4ed6-af6a-9362b3de176e admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:10.310572 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6724b-fccf-4ed6-af6a-9362b3de176e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:10.313169 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6724b-fccf-4ed6-af6a-9362b3de176e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:10.316447 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6724b-fccf-4ed6-af6a-9362b3de176e admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:10.359918 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 841/1665] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:52:10.366532 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e9139-018d-4d7c-9bfc-a22f4ea0d35f None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:10.379343 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e9139-018d-4d7c-9bfc-a22f4ea0d35f None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:10.387743 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29978f63-48c8-485b-86ce-9a9cd9f8b56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:10.388568 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29978f63-48c8-485b-86ce-9a9cd9f8b56c admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:10.388919 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29978f63-48c8-485b-86ce-9a9cd9f8b56c admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:10.389327 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29978f63-48c8-485b-86ce-9a9cd9f8b56c admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:10.390141 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29978f63-48c8-485b-86ce-9a9cd9f8b56c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:10.392395 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29978f63-48c8-485b-86ce-9a9cd9f8b56c admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:10.441809 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 825/1666] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:10 2022] POST /identity/v3/projects => generated 363 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:10.446818 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6724b-fccf-4ed6-af6a-9362b3de176e admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:10.468675 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6724b-fccf-4ed6-af6a-9362b3de176e admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:10.696620 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d146c57-2b3a-4874-89cd-752daa0c9937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:10.698655 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d146c57-2b3a-4874-89cd-752daa0c9937 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:10.698872 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d146c57-2b3a-4874-89cd-752daa0c9937 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:10.699154 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d146c57-2b3a-4874-89cd-752daa0c9937 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:10.700776 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d146c57-2b3a-4874-89cd-752daa0c9937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:10.706811 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d146c57-2b3a-4874-89cd-752daa0c9937 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:10.751820 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 842/1667] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:10 2022] POST /identity/v3/users => generated 282 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:10.753241 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29978f63-48c8-485b-86ce-9a9cd9f8b56c admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:10.766114 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29978f63-48c8-485b-86ce-9a9cd9f8b56c admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:10.777899 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ad4e5-b904-41d5-881e-a1b969f5de4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:10.778593 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ad4e5-b904-41d5-881e-a1b969f5de4a admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:10.778871 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ad4e5-b904-41d5-881e-a1b969f5de4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:10.781234 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ad4e5-b904-41d5-881e-a1b969f5de4a admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:10.782236 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ad4e5-b904-41d5-881e-a1b969f5de4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:10.786552 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ad4e5-b904-41d5-881e-a1b969f5de4a admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:10.787949 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d146c57-2b3a-4874-89cd-752daa0c9937 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:10.790238 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-0d146c57-2b3a-4874-89cd-752daa0c9937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:10.823646 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d146c57-2b3a-4874-89cd-752daa0c9937 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:10.844244 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d6eef0-0c55-4f68-8efd-00320e6ffc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:10.847074 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6eef0-0c55-4f68-8efd-00320e6ffc1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:10.847304 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6eef0-0c55-4f68-8efd-00320e6ffc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:10.847738 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 826/1668] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:10.848026 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d6eef0-0c55-4f68-8efd-00320e6ffc1f admin admin] PATH_INFO: `/v3/users/a1978f4585704f7c880269de546c7055` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:10.851458 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ad4e5-b904-41d5-881e-a1b969f5de4a admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:10.863056 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6eef0-0c55-4f68-8efd-00320e6ffc1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1978f4585704f7c880269de546c7055)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:10.865032 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d6eef0-0c55-4f68-8efd-00320e6ffc1f admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:10.880895 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ad4e5-b904-41d5-881e-a1b969f5de4a admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:10.898828 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6214c8e-bd91-4428-ae8c-ac6e7face4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:10.899722 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6214c8e-bd91-4428-ae8c-ac6e7face4ad admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:10.900843 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6214c8e-bd91-4428-ae8c-ac6e7face4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:10.901261 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6214c8e-bd91-4428-ae8c-ac6e7face4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:10.906172 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6214c8e-bd91-4428-ae8c-ac6e7face4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:10.908823 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6214c8e-bd91-4428-ae8c-ac6e7face4ad admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:10.927375 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 827/1669] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:52:10.931638 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6214c8e-bd91-4428-ae8c-ac6e7face4ad admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:10.950243 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6214c8e-bd91-4428-ae8c-ac6e7face4ad admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:10.958214 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c836e46-138c-4e6d-b9b8-3f70df2702bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:10.959520 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c836e46-138c-4e6d-b9b8-3f70df2702bc admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:10.972323 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c836e46-138c-4e6d-b9b8-3f70df2702bc admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:10.973310 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c836e46-138c-4e6d-b9b8-3f70df2702bc admin admin] PATH_INFO: `/v3/projects/d4949dc37a8e4cd4b13b18c83cb19543/users/cc798af469a94b559a53d6ea30096d1a/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:10.987731 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-b1d6eef0-0c55-4f68-8efd-00320e6ffc1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1978f4585704f7c880269de546c7055'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:10.991700 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-b1d6eef0-0c55-4f68-8efd-00320e6ffc1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1978f4585704f7c880269de546c7055'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:11.014065 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-b1d6eef0-0c55-4f68-8efd-00320e6ffc1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1978f4585704f7c880269de546c7055'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:11.024659 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-b1d6eef0-0c55-4f68-8efd-00320e6ffc1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1978f4585704f7c880269de546c7055'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:11.025110 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c836e46-138c-4e6d-b9b8-3f70df2702bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4949dc37a8e4cd4b13b18c83cb19543, user_id=cc798af469a94b559a53d6ea30096d1a, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:11.032479 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c836e46-138c-4e6d-b9b8-3f70df2702bc admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:11.051958 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-b1d6eef0-0c55-4f68-8efd-00320e6ffc1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1978f4585704f7c880269de546c7055'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:11.069458 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 828/1670] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:10 2022] PUT /identity/v3/projects/d4949dc37a8e4cd4b13b18c83cb19543/users/cc798af469a94b559a53d6ea30096d1a/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:11.080256 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9281fd-d864-461a-b6d2-c8983e78bd91 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:11.080945 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9281fd-d864-461a-b6d2-c8983e78bd91 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:11.081636 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9281fd-d864-461a-b6d2-c8983e78bd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:11.090543 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 843/1671] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:10 2022] DELETE /identity/v3/users/a1978f4585704f7c880269de546c7055 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:11.098986 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d4f09-1c37-46ca-8465-7553b10e6d13 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:11.100416 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d4f09-1c37-46ca-8465-7553b10e6d13 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:11.102249 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d4f09-1c37-46ca-8465-7553b10e6d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:11.176357 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-091d4f09-1c37-46ca-8465-7553b10e6d13 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:11.182248 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-091d4f09-1c37-46ca-8465-7553b10e6d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:11.192834 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-cc9281fd-d864-461a-b6d2-c8983e78bd91 None None] MFA Rules not processed for user `cc798af469a94b559a53d6ea30096d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:11.197143 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-cc9281fd-d864-461a-b6d2-c8983e78bd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:11.358163 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 844/1672] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:11.383103 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 829/1673] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:11 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:11.387781 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d4f09-1c37-46ca-8465-7553b10e6d13 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:11.390311 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-091d4f09-1c37-46ca-8465-7553b10e6d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:11.415587 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d4f09-1c37-46ca-8465-7553b10e6d13 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:11.430827 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e02c58-4576-4b9d-9772-2675cdf613dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:11.431916 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e02c58-4576-4b9d-9772-2675cdf613dd admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:11.432337 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e02c58-4576-4b9d-9772-2675cdf613dd admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:11.432752 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e02c58-4576-4b9d-9772-2675cdf613dd admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:11.434968 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e02c58-4576-4b9d-9772-2675cdf613dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:11.438631 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e02c58-4576-4b9d-9772-2675cdf613dd admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:11.491815 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9281fd-d864-461a-b6d2-c8983e78bd91 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:11.495224 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-cc9281fd-d864-461a-b6d2-c8983e78bd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:11.535518 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 845/1674] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:11 2022] POST /identity/v3/projects => generated 363 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:11.538790 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e02c58-4576-4b9d-9772-2675cdf613dd admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:11.756409 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9281fd-d864-461a-b6d2-c8983e78bd91 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:11.831473 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e02c58-4576-4b9d-9772-2675cdf613dd admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:11.856947 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a6c3d-6dc8-49ee-ba59-4e46d58580a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:11.862456 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a6c3d-6dc8-49ee-ba59-4e46d58580a8 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:11.862772 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a6c3d-6dc8-49ee-ba59-4e46d58580a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:11.863121 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a6c3d-6dc8-49ee-ba59-4e46d58580a8 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:11.863776 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a6c3d-6dc8-49ee-ba59-4e46d58580a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:11.865781 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9a6c3d-6dc8-49ee-ba59-4e46d58580a8 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:11.940706 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 846/1675] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:11 2022] POST /identity/v3/users => generated 288 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:11.944400 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf9dff-d79a-4abc-9bf6-4cc4f13ca84d None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:11.944692 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf9dff-d79a-4abc-9bf6-4cc4f13ca84d None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:11.944965 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf9dff-d79a-4abc-9bf6-4cc4f13ca84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:11.953487 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2efa9e-2d9a-4e3b-b5ae-76e3d64ee8d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:11.954512 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2efa9e-2d9a-4e3b-b5ae-76e3d64ee8d6 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:11.956427 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2efa9e-2d9a-4e3b-b5ae-76e3d64ee8d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:11.956846 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2efa9e-2d9a-4e3b-b5ae-76e3d64ee8d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:11.978740 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2efa9e-2d9a-4e3b-b5ae-76e3d64ee8d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:11.980593 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2efa9e-2d9a-4e3b-b5ae-76e3d64ee8d6 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:11.988374 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-f7cf9dff-d79a-4abc-9bf6-4cc4f13ca84d None None] MFA Rules not processed for user `817bcd2c5f6e4bceb049eeb122d4e432`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:11.989680 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-f7cf9dff-d79a-4abc-9bf6-4cc4f13ca84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:12.003726 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 830/1676] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:12.004938 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2efa9e-2d9a-4e3b-b5ae-76e3d64ee8d6 service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:12.027971 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2efa9e-2d9a-4e3b-b5ae-76e3d64ee8d6 service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:12.040463 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52914708-5470-4925-ae90-82a87c377394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:12.041153 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52914708-5470-4925-ae90-82a87c377394 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:12.041460 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52914708-5470-4925-ae90-82a87c377394 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:12.041739 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52914708-5470-4925-ae90-82a87c377394 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:12.042778 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52914708-5470-4925-ae90-82a87c377394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:12.044556 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52914708-5470-4925-ae90-82a87c377394 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:12.070963 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 831/1677] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:12.072040 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52914708-5470-4925-ae90-82a87c377394 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:12.101982 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52914708-5470-4925-ae90-82a87c377394 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:12.120351 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64401a81-977b-4e68-af2e-d76f7983d6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:12.122711 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 847/1678] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Mar 8 13:52:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:12.123097 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64401a81-977b-4e68-af2e-d76f7983d6f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:12.123572 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64401a81-977b-4e68-af2e-d76f7983d6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:12.124022 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64401a81-977b-4e68-af2e-d76f7983d6f7 admin admin] PATH_INFO: `/v3/projects/f14bf70ccaca4e63b315aaa9492cf0e2/users/c15fba2ea50b4bb4b5ca91c296c493a4/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:12.176844 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64401a81-977b-4e68-af2e-d76f7983d6f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14bf70ccaca4e63b315aaa9492cf0e2, user_id=c15fba2ea50b4bb4b5ca91c296c493a4, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:12.183734 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64401a81-977b-4e68-af2e-d76f7983d6f7 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:12.213522 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 832/1679] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:12 2022] PUT /identity/v3/projects/f14bf70ccaca4e63b315aaa9492cf0e2/users/c15fba2ea50b4bb4b5ca91c296c493a4/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:12.217129 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf9dff-d79a-4abc-9bf6-4cc4f13ca84d None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:12.238586 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf9dff-d79a-4abc-9bf6-4cc4f13ca84d None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:12.422064 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf694e-0822-4ab1-baaf-08d903b44707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:12.423046 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf694e-0822-4ab1-baaf-08d903b44707 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:12.423638 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf694e-0822-4ab1-baaf-08d903b44707 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:12.424083 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf694e-0822-4ab1-baaf-08d903b44707 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:12.425068 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf694e-0822-4ab1-baaf-08d903b44707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:12.427201 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf694e-0822-4ab1-baaf-08d903b44707 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:12.447173 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 848/1680] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:12 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:12.451030 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64401a81-977b-4e68-af2e-d76f7983d6f7 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:12.468922 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64401a81-977b-4e68-af2e-d76f7983d6f7 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:12.483110 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890848c1-1472-47b6-a485-95bba67075db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:12.484143 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890848c1-1472-47b6-a485-95bba67075db admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:12.484348 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890848c1-1472-47b6-a485-95bba67075db admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:12.484647 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890848c1-1472-47b6-a485-95bba67075db admin admin] PATH_INFO: `/v3/projects/f14bf70ccaca4e63b315aaa9492cf0e2/users/c15fba2ea50b4bb4b5ca91c296c493a4/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:12.486870 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890848c1-1472-47b6-a485-95bba67075db admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14bf70ccaca4e63b315aaa9492cf0e2, user_id=c15fba2ea50b4bb4b5ca91c296c493a4, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:12.489599 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890848c1-1472-47b6-a485-95bba67075db admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:12.513258 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf694e-0822-4ab1-baaf-08d903b44707 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:12.516564 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-01bf694e-0822-4ab1-baaf-08d903b44707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:12.543601 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 833/1681] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:12 2022] PUT /identity/v3/projects/f14bf70ccaca4e63b315aaa9492cf0e2/users/c15fba2ea50b4bb4b5ca91c296c493a4/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:12.561379 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9262e10-15a4-4201-92cc-c35de3f89a58 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:12.561379 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9262e10-15a4-4201-92cc-c35de3f89a58 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:12.561379 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9262e10-15a4-4201-92cc-c35de3f89a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:12.655214 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-c9262e10-15a4-4201-92cc-c35de3f89a58 None None] MFA Rules not processed for user `c15fba2ea50b4bb4b5ca91c296c493a4`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:12.668684 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-c9262e10-15a4-4201-92cc-c35de3f89a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:12.751007 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf694e-0822-4ab1-baaf-08d903b44707 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:12.868375 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 834/1682] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:12 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:12.884431 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9262e10-15a4-4201-92cc-c35de3f89a58 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:12.890484 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-c9262e10-15a4-4201-92cc-c35de3f89a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:12.974275 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac7f2d-a4f2-4b41-b742-ba572902b83f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0f442666d0459aa9a34fc2f91228e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:12.974959 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac7f2d-a4f2-4b41-b742-ba572902b83f service swift] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:12.975238 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac7f2d-a4f2-4b41-b742-ba572902b83f service swift] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:12.975547 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac7f2d-a4f2-4b41-b742-ba572902b83f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:13.055939 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9262e10-15a4-4201-92cc-c35de3f89a58 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:13.074770 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa02f2b-a928-44dd-a47f-b0fec02c7cb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:13.075670 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa02f2b-a928-44dd-a47f-b0fec02c7cb2 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:13.076590 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa02f2b-a928-44dd-a47f-b0fec02c7cb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:13.079308 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa02f2b-a928-44dd-a47f-b0fec02c7cb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:13.098650 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa02f2b-a928-44dd-a47f-b0fec02c7cb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:13.100104 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa02f2b-a928-44dd-a47f-b0fec02c7cb2 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:13.117457 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac7f2d-a4f2-4b41-b742-ba572902b83f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:13.119098 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac7f2d-a4f2-4b41-b742-ba572902b83f service swift] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:13.126712 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 835/1683] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:12 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:52:13.127579 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa02f2b-a928-44dd-a47f-b0fec02c7cb2 service cinder] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:13.128974 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-8fa02f2b-a928-44dd-a47f-b0fec02c7cb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:13.137904 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 849/1684] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Mar 8 13:52:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 13:52:13.274402 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac7f2d-a4f2-4b41-b742-ba572902b83f service swift] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:13.286666 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac7f2d-a4f2-4b41-b742-ba572902b83f service swift] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:13.304016 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ccf89-0898-4a82-a6d0-f6dd552fd14d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:13.306302 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ccf89-0898-4a82-a6d0-f6dd552fd14d service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:13.306605 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ccf89-0898-4a82-a6d0-f6dd552fd14d service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:13.306884 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ccf89-0898-4a82-a6d0-f6dd552fd14d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:13.308696 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa02f2b-a928-44dd-a47f-b0fec02c7cb2 service cinder] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:13.326677 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a21bf-1bad-46f0-ba01-3fcabb2bab99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:13.328200 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a21bf-1bad-46f0-ba01-3fcabb2bab99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:13.329728 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a21bf-1bad-46f0-ba01-3fcabb2bab99 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:13.330149 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a21bf-1bad-46f0-ba01-3fcabb2bab99 admin admin] PATH_INFO: `/v3/users/96c513ac69974de5a92297213bbb0e8a` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:13.333782 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a21bf-1bad-46f0-ba01-3fcabb2bab99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96c513ac69974de5a92297213bbb0e8a)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:13.338945 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784a21bf-1bad-46f0-ba01-3fcabb2bab99 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:13.444943 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-784a21bf-1bad-46f0-ba01-3fcabb2bab99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96c513ac69974de5a92297213bbb0e8a'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:13.446324 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ccf89-0898-4a82-a6d0-f6dd552fd14d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:13.447763 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-784a21bf-1bad-46f0-ba01-3fcabb2bab99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96c513ac69974de5a92297213bbb0e8a'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:13.451536 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ccf89-0898-4a82-a6d0-f6dd552fd14d service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:13.473200 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-784a21bf-1bad-46f0-ba01-3fcabb2bab99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96c513ac69974de5a92297213bbb0e8a'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:13.479936 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 850/1685] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:13 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:52:13.509410 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-784a21bf-1bad-46f0-ba01-3fcabb2bab99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96c513ac69974de5a92297213bbb0e8a'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:13.524808 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-784a21bf-1bad-46f0-ba01-3fcabb2bab99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96c513ac69974de5a92297213bbb0e8a'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:13.541866 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 836/1686] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:13 2022] DELETE /identity/v3/users/96c513ac69974de5a92297213bbb0e8a => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:13.543558 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac61b2-8125-40e9-baf5-9cba1108fa33 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:13.544113 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac61b2-8125-40e9-baf5-9cba1108fa33 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:13.544456 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac61b2-8125-40e9-baf5-9cba1108fa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:13.580749 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-5aac61b2-8125-40e9-baf5-9cba1108fa33 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:13.582059 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-5aac61b2-8125-40e9-baf5-9cba1108fa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:13.634127 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f850576-931c-469d-9762-b181805dfca5 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:13.634447 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f850576-931c-469d-9762-b181805dfca5 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:13.634742 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f850576-931c-469d-9762-b181805dfca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:13.743026 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-1f850576-931c-469d-9762-b181805dfca5 None None] MFA Rules not processed for user `8d63599c0ea547408d2d9d1d886431db`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:13.744486 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-1f850576-931c-469d-9762-b181805dfca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:13.832630 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 851/1687] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:13.835290 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac61b2-8125-40e9-baf5-9cba1108fa33 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:13.838510 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-5aac61b2-8125-40e9-baf5-9cba1108fa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:13.886206 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac61b2-8125-40e9-baf5-9cba1108fa33 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:13.911915 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c168730-3374-4a99-8834-9fd64b988047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:13.917167 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c168730-3374-4a99-8834-9fd64b988047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:13.917523 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c168730-3374-4a99-8834-9fd64b988047 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:13.917958 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c168730-3374-4a99-8834-9fd64b988047 admin admin] PATH_INFO: `/v3/projects/3512e4115024491fb07c2a5defc7916e` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:13.924522 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c168730-3374-4a99-8834-9fd64b988047 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3512e4115024491fb07c2a5defc7916e)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:13.932300 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c168730-3374-4a99-8834-9fd64b988047 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:13.990898 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 837/1688] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:13.990898 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f850576-931c-469d-9762-b181805dfca5 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:13.990898 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-1f850576-931c-469d-9762-b181805dfca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:14.088827 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-4c168730-3374-4a99-8834-9fd64b988047 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3512e4115024491fb07c2a5defc7916e', 'request_id': 'req-4c168730-3374-4a99-8834-9fd64b988047'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:14.096333 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-4c168730-3374-4a99-8834-9fd64b988047 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3512e4115024491fb07c2a5defc7916e', 'request_id': 'req-4c168730-3374-4a99-8834-9fd64b988047'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:14.108756 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-4c168730-3374-4a99-8834-9fd64b988047 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3512e4115024491fb07c2a5defc7916e', 'request_id': 'req-4c168730-3374-4a99-8834-9fd64b988047'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:14.149518 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-4c168730-3374-4a99-8834-9fd64b988047 admin admin] The token cache is being invalidate because project 3512e4115024491fb07c2a5defc7916e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:14.150808 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-4c168730-3374-4a99-8834-9fd64b988047 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:14.152436 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-4c168730-3374-4a99-8834-9fd64b988047 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:14.155831 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 852/1689] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:13 2022] DELETE /identity/v3/projects/3512e4115024491fb07c2a5defc7916e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:14.156966 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a24ed3-1217-4c6e-87c4-332ee1647d71 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:14.160364 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a24ed3-1217-4c6e-87c4-332ee1647d71 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:14.160609 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a24ed3-1217-4c6e-87c4-332ee1647d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:14.211661 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f850576-931c-469d-9762-b181805dfca5 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:14.213774 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-19a24ed3-1217-4c6e-87c4-332ee1647d71 None None] MFA Rules not processed for user `8d63599c0ea547408d2d9d1d886431db`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:14.215043 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-19a24ed3-1217-4c6e-87c4-332ee1647d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:14.367271 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1502010-5948-4ba2-b563-c8b30ffbc023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:14.367742 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1502010-5948-4ba2-b563-c8b30ffbc023 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:14.368035 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1502010-5948-4ba2-b563-c8b30ffbc023 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:14.368284 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1502010-5948-4ba2-b563-c8b30ffbc023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:14.377294 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f1502010-5948-4ba2-b563-c8b30ffbc023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:14.414484 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 853/1690] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:14.414484 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a24ed3-1217-4c6e-87c4-332ee1647d71 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:14.416297 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-19a24ed3-1217-4c6e-87c4-332ee1647d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:14.587662 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a24ed3-1217-4c6e-87c4-332ee1647d71 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:14.596890 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e00cf-430e-4978-bafa-175ff86578ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:14.598184 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e00cf-430e-4978-bafa-175ff86578ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:14.599361 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e00cf-430e-4978-bafa-175ff86578ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:14.600553 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e00cf-430e-4978-bafa-175ff86578ab admin admin] PATH_INFO: `/v3/users/902497a0a2b44a2c9176b9443a313414` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:14.602142 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e00cf-430e-4978-bafa-175ff86578ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=902497a0a2b44a2c9176b9443a313414)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:14.607934 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e00cf-430e-4978-bafa-175ff86578ab admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:14.712114 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1502010-5948-4ba2-b563-c8b30ffbc023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:14.733187 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1502010-5948-4ba2-b563-c8b30ffbc023 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:14.750545 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-649e00cf-430e-4978-bafa-175ff86578ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '902497a0a2b44a2c9176b9443a313414'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:14.760245 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-649e00cf-430e-4978-bafa-175ff86578ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '902497a0a2b44a2c9176b9443a313414'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:14.771614 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-649e00cf-430e-4978-bafa-175ff86578ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '902497a0a2b44a2c9176b9443a313414'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:14.783282 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-649e00cf-430e-4978-bafa-175ff86578ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '902497a0a2b44a2c9176b9443a313414'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:14.790997 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 838/1691] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 808 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:14.791925 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1502010-5948-4ba2-b563-c8b30ffbc023 service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:14.807900 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f1502010-5948-4ba2-b563-c8b30ffbc023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:14.821159 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-649e00cf-430e-4978-bafa-175ff86578ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '902497a0a2b44a2c9176b9443a313414'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:14.835233 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 854/1692] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:14 2022] DELETE /identity/v3/users/902497a0a2b44a2c9176b9443a313414 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:15.119756 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1502010-5948-4ba2-b563-c8b30ffbc023 service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:15.421736 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcebf0-9e3a-4807-8d8a-31b3213820ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:15.422457 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcebf0-9e3a-4807-8d8a-31b3213820ba service nova] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:15.422744 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcebf0-9e3a-4807-8d8a-31b3213820ba service nova] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:15.423037 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcebf0-9e3a-4807-8d8a-31b3213820ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:15.436142 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-befcebf0-9e3a-4807-8d8a-31b3213820ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:15.623149 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befcebf0-9e3a-4807-8d8a-31b3213820ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:15.624949 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befcebf0-9e3a-4807-8d8a-31b3213820ba service nova] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:15.657397 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 839/1693] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 865 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:15.926533 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2e373-2ce2-4ded-aa61-5e662bacbf2e None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:15.927526 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2e373-2ce2-4ded-aa61-5e662bacbf2e None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:15.928625 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2e373-2ce2-4ded-aa61-5e662bacbf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:15.990318 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-fdf2e373-2ce2-4ded-aa61-5e662bacbf2e None None] MFA Rules not processed for user `4c610d719b3049f98b95cc8e9bd56834`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:15.994450 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-fdf2e373-2ce2-4ded-aa61-5e662bacbf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:16.205036 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 855/1694] 10.222.0.32 () {58 vars in 1015 bytes} [Tue Mar 8 13:52:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:16.230392 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcebf0-9e3a-4807-8d8a-31b3213820ba service nova] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:16.233483 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-befcebf0-9e3a-4807-8d8a-31b3213820ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:16.258639 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcebf0-9e3a-4807-8d8a-31b3213820ba service nova] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:16.281425 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223f440-7ca3-42b0-b0d0-259c16d9098c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:16.283893 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223f440-7ca3-42b0-b0d0-259c16d9098c service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:16.284851 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223f440-7ca3-42b0-b0d0-259c16d9098c service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:16.285143 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223f440-7ca3-42b0-b0d0-259c16d9098c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:16.325910 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223f440-7ca3-42b0-b0d0-259c16d9098c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:16.328372 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223f440-7ca3-42b0-b0d0-259c16d9098c service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:16.357965 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 840/1695] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:16.433114 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2e373-2ce2-4ded-aa61-5e662bacbf2e None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:16.435303 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-fdf2e373-2ce2-4ded-aa61-5e662bacbf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:16.528844 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223f440-7ca3-42b0-b0d0-259c16d9098c service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:16.530355 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-7223f440-7ca3-42b0-b0d0-259c16d9098c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:16.647734 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2e373-2ce2-4ded-aa61-5e662bacbf2e None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:16.664662 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff3a09-24df-4563-abbf-cc81c412abe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:16.669393 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff3a09-24df-4563-abbf-cc81c412abe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:16.669697 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff3a09-24df-4563-abbf-cc81c412abe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:16.671229 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff3a09-24df-4563-abbf-cc81c412abe9 admin admin] PATH_INFO: `/v3/users/2fa3328befad4dc2a6ca63ee466dabbd` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:16.675573 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff3a09-24df-4563-abbf-cc81c412abe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fa3328befad4dc2a6ca63ee466dabbd)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:16.681393 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff3a09-24df-4563-abbf-cc81c412abe9 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:16.706032 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223f440-7ca3-42b0-b0d0-259c16d9098c service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:16.717685 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cda3e-d578-4c42-895e-9059b17b330e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:16.721246 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cda3e-d578-4c42-895e-9059b17b330e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:16.721559 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cda3e-d578-4c42-895e-9059b17b330e admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:16.721843 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cda3e-d578-4c42-895e-9059b17b330e admin admin] PATH_INFO: `/v3/projects/d5cce59f4fa34c97845a66af9d0d50b7` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:16.727501 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cda3e-d578-4c42-895e-9059b17b330e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5cce59f4fa34c97845a66af9d0d50b7)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:16.729644 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cda3e-d578-4c42-895e-9059b17b330e admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:16.805549 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-5fff3a09-24df-4563-abbf-cc81c412abe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fa3328befad4dc2a6ca63ee466dabbd'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:16.806538 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-5fff3a09-24df-4563-abbf-cc81c412abe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fa3328befad4dc2a6ca63ee466dabbd'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:16.821693 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-5fff3a09-24df-4563-abbf-cc81c412abe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fa3328befad4dc2a6ca63ee466dabbd'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:16.837558 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-5fff3a09-24df-4563-abbf-cc81c412abe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fa3328befad4dc2a6ca63ee466dabbd'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:16.839267 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a91cda3e-d578-4c42-895e-9059b17b330e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5cce59f4fa34c97845a66af9d0d50b7', 'request_id': 'req-a91cda3e-d578-4c42-895e-9059b17b330e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:16.862551 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a91cda3e-d578-4c42-895e-9059b17b330e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5cce59f4fa34c97845a66af9d0d50b7', 'request_id': 'req-a91cda3e-d578-4c42-895e-9059b17b330e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:16.877610 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-5fff3a09-24df-4563-abbf-cc81c412abe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fa3328befad4dc2a6ca63ee466dabbd'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:16.880076 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a91cda3e-d578-4c42-895e-9059b17b330e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5cce59f4fa34c97845a66af9d0d50b7', 'request_id': 'req-a91cda3e-d578-4c42-895e-9059b17b330e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:16.891125 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 856/1696] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:16 2022] DELETE /identity/v3/users/2fa3328befad4dc2a6ca63ee466dabbd => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:16.896306 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dfb17-ef02-4533-9897-68e4a2e28620 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:16.896758 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dfb17-ef02-4533-9897-68e4a2e28620 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:16.897722 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dfb17-ef02-4533-9897-68e4a2e28620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:16.906734 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a91cda3e-d578-4c42-895e-9059b17b330e admin admin] The token cache is being invalidate because project d5cce59f4fa34c97845a66af9d0d50b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:16.908317 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a91cda3e-d578-4c42-895e-9059b17b330e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:16.910681 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a91cda3e-d578-4c42-895e-9059b17b330e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:16.918642 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 841/1697] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:16 2022] DELETE /identity/v3/projects/d5cce59f4fa34c97845a66af9d0d50b7 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:52:16.921621 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ae8d7-cf03-4eaa-b532-b033ee8d5e46 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:16.924621 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ae8d7-cf03-4eaa-b532-b033ee8d5e46 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:16.924797 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ae8d7-cf03-4eaa-b532-b033ee8d5e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:16.945505 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-5d6dfb17-ef02-4533-9897-68e4a2e28620 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:16.946783 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-5d6dfb17-ef02-4533-9897-68e4a2e28620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:16.978627 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-a01ae8d7-cf03-4eaa-b532-b033ee8d5e46 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:16.981419 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-a01ae8d7-cf03-4eaa-b532-b033ee8d5e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:17.101458 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 857/1698] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:17.135359 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717dcd4-528e-4234-9a7a-1d1ec00022f5 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:17.135658 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717dcd4-528e-4234-9a7a-1d1ec00022f5 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:17.135930 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717dcd4-528e-4234-9a7a-1d1ec00022f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:17.141375 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 842/1699] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:17.174172 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-6717dcd4-528e-4234-9a7a-1d1ec00022f5 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:17.176849 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-6717dcd4-528e-4234-9a7a-1d1ec00022f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:17.199821 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 858/1700] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:17.204313 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ae8d7-cf03-4eaa-b532-b033ee8d5e46 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:17.217094 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ae8d7-cf03-4eaa-b532-b033ee8d5e46 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:17.227955 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853f3ab-890d-4bc8-b6a8-0e7ed2e4abd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:17.228666 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853f3ab-890d-4bc8-b6a8-0e7ed2e4abd0 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:17.228933 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853f3ab-890d-4bc8-b6a8-0e7ed2e4abd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:17.229211 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853f3ab-890d-4bc8-b6a8-0e7ed2e4abd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:17.230011 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853f3ab-890d-4bc8-b6a8-0e7ed2e4abd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:17.235646 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853f3ab-890d-4bc8-b6a8-0e7ed2e4abd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:17.238183 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853f3ab-890d-4bc8-b6a8-0e7ed2e4abd0 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:17.242550 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717dcd4-528e-4234-9a7a-1d1ec00022f5 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:17.244406 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-6717dcd4-528e-4234-9a7a-1d1ec00022f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:17.339938 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 843/1701] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:52:17.341258 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853f3ab-890d-4bc8-b6a8-0e7ed2e4abd0 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:17.381165 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853f3ab-890d-4bc8-b6a8-0e7ed2e4abd0 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:17.411272 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db1702-01e4-467c-bf41-bcf07279a506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:17.413544 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db1702-01e4-467c-bf41-bcf07279a506 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:17.417036 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db1702-01e4-467c-bf41-bcf07279a506 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:17.417808 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db1702-01e4-467c-bf41-bcf07279a506 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:17.424763 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db1702-01e4-467c-bf41-bcf07279a506 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:17.426964 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5db1702-01e4-467c-bf41-bcf07279a506 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:17.535898 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717dcd4-528e-4234-9a7a-1d1ec00022f5 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:17.549618 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aceb03d-926a-4371-bc9d-c3b7f3c3abe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:17.551989 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 844/1702] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:17 2022] POST /identity/v3/projects => generated 373 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:17.555830 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aceb03d-926a-4371-bc9d-c3b7f3c3abe9 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:17.556327 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aceb03d-926a-4371-bc9d-c3b7f3c3abe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:17.556583 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aceb03d-926a-4371-bc9d-c3b7f3c3abe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:17.559734 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db1702-01e4-467c-bf41-bcf07279a506 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:17.606347 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aceb03d-926a-4371-bc9d-c3b7f3c3abe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:17.614468 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aceb03d-926a-4371-bc9d-c3b7f3c3abe9 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:17.646565 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 859/1703] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:17.783234 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db1702-01e4-467c-bf41-bcf07279a506 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:17.793632 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad8645-373c-421b-9182-ef9d9471cc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:17.796677 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad8645-373c-421b-9182-ef9d9471cc16 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:17.796943 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad8645-373c-421b-9182-ef9d9471cc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:17.797225 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad8645-373c-421b-9182-ef9d9471cc16 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:17.804163 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad8645-373c-421b-9182-ef9d9471cc16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:17.812280 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad8645-373c-421b-9182-ef9d9471cc16 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:17.888033 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 845/1704] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:17 2022] POST /identity/v3/users => generated 287 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:17.893291 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aceb03d-926a-4371-bc9d-c3b7f3c3abe9 service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:17.906859 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aceb03d-926a-4371-bc9d-c3b7f3c3abe9 service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:17.940867 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1a8a2-ff47-4b93-b906-25d0ff649804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:17.941594 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1a8a2-ff47-4b93-b906-25d0ff649804 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:17.941882 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1a8a2-ff47-4b93-b906-25d0ff649804 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:17.942159 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c1a8a2-ff47-4b93-b906-25d0ff649804 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:17.942901 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1a8a2-ff47-4b93-b906-25d0ff649804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:17.966610 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c1a8a2-ff47-4b93-b906-25d0ff649804 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:18.014500 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 860/1705] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:18.015739 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad8645-373c-421b-9182-ef9d9471cc16 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:18.030965 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad8645-373c-421b-9182-ef9d9471cc16 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:18.043672 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466828d-2bed-4dab-bf30-e0e8982e57fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:18.044362 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466828d-2bed-4dab-bf30-e0e8982e57fa admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:18.044645 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466828d-2bed-4dab-bf30-e0e8982e57fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:18.044921 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466828d-2bed-4dab-bf30-e0e8982e57fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:18.045703 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466828d-2bed-4dab-bf30-e0e8982e57fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:18.053304 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466828d-2bed-4dab-bf30-e0e8982e57fa admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:18.094324 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1a8a2-ff47-4b93-b906-25d0ff649804 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:18.105647 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 846/1706] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:18.107534 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c1a8a2-ff47-4b93-b906-25d0ff649804 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:18.120833 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51af0a-1031-4afa-8991-478308969cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:18.121748 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51af0a-1031-4afa-8991-478308969cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:18.125314 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51af0a-1031-4afa-8991-478308969cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:18.125667 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51af0a-1031-4afa-8991-478308969cf5 admin admin] PATH_INFO: `/v3/projects/4dbc0bdc9692457b971774c79e0d7a9b/users/695eb0506dfa4588bde6fc5551bf9b21/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:18.211815 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51af0a-1031-4afa-8991-478308969cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dbc0bdc9692457b971774c79e0d7a9b, user_id=695eb0506dfa4588bde6fc5551bf9b21, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:18.215694 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51af0a-1031-4afa-8991-478308969cf5 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:18.274260 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c086664-028a-400d-977b-d99290934618 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:18.275122 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c086664-028a-400d-977b-d99290934618 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:18.275570 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c086664-028a-400d-977b-d99290934618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:18.276271 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 861/1707] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:18 2022] PUT /identity/v3/projects/4dbc0bdc9692457b971774c79e0d7a9b/users/695eb0506dfa4588bde6fc5551bf9b21/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:18.410561 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-5c086664-028a-400d-977b-d99290934618 None None] MFA Rules not processed for user `695eb0506dfa4588bde6fc5551bf9b21`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:18.414620 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-5c086664-028a-400d-977b-d99290934618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:18.565069 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 847/1708] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:18.578780 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51af0a-1031-4afa-8991-478308969cf5 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:18.581285 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-0d51af0a-1031-4afa-8991-478308969cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:18.913841 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c086664-028a-400d-977b-d99290934618 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:18.915372 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-5c086664-028a-400d-977b-d99290934618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:18.965099 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51af0a-1031-4afa-8991-478308969cf5 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:18.977537 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac17e7e-193c-4964-907a-9bcf2c297e64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:18.978351 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac17e7e-193c-4964-907a-9bcf2c297e64 service nova] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:18.978534 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac17e7e-193c-4964-907a-9bcf2c297e64 service nova] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:18.978805 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac17e7e-193c-4964-907a-9bcf2c297e64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:19.010453 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac17e7e-193c-4964-907a-9bcf2c297e64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:19.012201 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac17e7e-193c-4964-907a-9bcf2c297e64 service nova] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:19.048898 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 862/1709] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:19.106040 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c086664-028a-400d-977b-d99290934618 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:19.123343 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02f487-bdcd-43f7-a2a5-29d2baf9a0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:19.124289 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02f487-bdcd-43f7-a2a5-29d2baf9a0db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:19.133331 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02f487-bdcd-43f7-a2a5-29d2baf9a0db admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:19.133665 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02f487-bdcd-43f7-a2a5-29d2baf9a0db admin admin] PATH_INFO: `/v3/projects/2d6f9bea276b432db444630bf6e25992` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:19.138601 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02f487-bdcd-43f7-a2a5-29d2baf9a0db admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d6f9bea276b432db444630bf6e25992)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:19.141784 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02f487-bdcd-43f7-a2a5-29d2baf9a0db admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:19.290568 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-8f02f487-bdcd-43f7-a2a5-29d2baf9a0db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d6f9bea276b432db444630bf6e25992', 'request_id': 'req-8f02f487-bdcd-43f7-a2a5-29d2baf9a0db'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:19.320872 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-8f02f487-bdcd-43f7-a2a5-29d2baf9a0db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d6f9bea276b432db444630bf6e25992', 'request_id': 'req-8f02f487-bdcd-43f7-a2a5-29d2baf9a0db'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:19.344319 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-8f02f487-bdcd-43f7-a2a5-29d2baf9a0db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d6f9bea276b432db444630bf6e25992', 'request_id': 'req-8f02f487-bdcd-43f7-a2a5-29d2baf9a0db'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:19.399531 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-8f02f487-bdcd-43f7-a2a5-29d2baf9a0db admin admin] The token cache is being invalidate because project 2d6f9bea276b432db444630bf6e25992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:19.402832 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-8f02f487-bdcd-43f7-a2a5-29d2baf9a0db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:19.406981 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-8f02f487-bdcd-43f7-a2a5-29d2baf9a0db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:19.413953 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 848/1710] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:18 2022] DELETE /identity/v3/projects/2d6f9bea276b432db444630bf6e25992 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:19.419651 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a83ce7-58df-4465-8a34-d5ea329404db None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:19.419984 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a83ce7-58df-4465-8a34-d5ea329404db None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:19.420254 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a83ce7-58df-4465-8a34-d5ea329404db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:19.535454 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-03a83ce7-58df-4465-8a34-d5ea329404db None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:19.536700 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-03a83ce7-58df-4465-8a34-d5ea329404db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:19.597939 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa478167-1e90-459a-9a9d-3dc593a11f1e None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:19.598029 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa478167-1e90-459a-9a9d-3dc593a11f1e None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:19.598319 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa478167-1e90-459a-9a9d-3dc593a11f1e None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:19.600098 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 849/1711] 10.222.0.18 () {54 vars in 921 bytes} [Tue Mar 8 13:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Mar 08 13:52:19.706766 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 863/1712] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:19.709100 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6f068-ec54-4822-a894-74b19c8b8f02 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:19.709821 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6f068-ec54-4822-a894-74b19c8b8f02 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:19.709821 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a6f068-ec54-4822-a894-74b19c8b8f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:19.759287 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e69e2-3780-4b41-bbea-d8df9b7101dc None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:19.759575 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e69e2-3780-4b41-bbea-d8df9b7101dc None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:19.759851 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e69e2-3780-4b41-bbea-d8df9b7101dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:19.802830 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-21a6f068-ec54-4822-a894-74b19c8b8f02 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:19.804149 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-21a6f068-ec54-4822-a894-74b19c8b8f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:19.835190 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-7d5e69e2-3780-4b41-bbea-d8df9b7101dc None None] MFA Rules not processed for user `21ec894123044d4382995791c74c587b`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:19.842573 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-7d5e69e2-3780-4b41-bbea-d8df9b7101dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:19.882408 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 850/1713] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:19.889452 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0d7b5-e245-4427-b006-19a6b5733a4d None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:19.889746 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0d7b5-e245-4427-b006-19a6b5733a4d None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:19.890090 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0d7b5-e245-4427-b006-19a6b5733a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:19.948405 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-a9e0d7b5-e245-4427-b006-19a6b5733a4d None None] MFA Rules not processed for user `8d63599c0ea547408d2d9d1d886431db`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:19.952102 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-a9e0d7b5-e245-4427-b006-19a6b5733a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:20.052512 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 864/1714] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Mar 8 13:52:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:20.054290 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e69e2-3780-4b41-bbea-d8df9b7101dc None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:20.056492 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-7d5e69e2-3780-4b41-bbea-d8df9b7101dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:20.095233 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5e69e2-3780-4b41-bbea-d8df9b7101dc None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:20.100415 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ae24f-f27d-4fc4-8913-e18e203dfcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:20.101825 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ae24f-f27d-4fc4-8913-e18e203dfcb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:20.102319 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ae24f-f27d-4fc4-8913-e18e203dfcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:20.102829 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ae24f-f27d-4fc4-8913-e18e203dfcb9 admin admin] PATH_INFO: `/v3/projects/85b5d38df8e1448a8413767e35b96059` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:20.104498 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ae24f-f27d-4fc4-8913-e18e203dfcb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85b5d38df8e1448a8413767e35b96059)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:20.114534 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ae24f-f27d-4fc4-8913-e18e203dfcb9 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:20.123144 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 851/1715] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:20.124230 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0d7b5-e245-4427-b006-19a6b5733a4d None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:20.150067 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e0d7b5-e245-4427-b006-19a6b5733a4d None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:20.157705 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53340cb1-83a3-48f5-845e-3ccc2e635773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:20.158011 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53340cb1-83a3-48f5-845e-3ccc2e635773 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:20.158276 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53340cb1-83a3-48f5-845e-3ccc2e635773 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:20.158548 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53340cb1-83a3-48f5-845e-3ccc2e635773 admin admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:20.159367 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53340cb1-83a3-48f5-845e-3ccc2e635773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:20.159670 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53340cb1-83a3-48f5-845e-3ccc2e635773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:20.161925 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53340cb1-83a3-48f5-845e-3ccc2e635773 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:20.204239 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-611ae24f-f27d-4fc4-8913-e18e203dfcb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85b5d38df8e1448a8413767e35b96059', 'request_id': 'req-611ae24f-f27d-4fc4-8913-e18e203dfcb9'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:20.212466 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-611ae24f-f27d-4fc4-8913-e18e203dfcb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85b5d38df8e1448a8413767e35b96059', 'request_id': 'req-611ae24f-f27d-4fc4-8913-e18e203dfcb9'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:20.212914 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 852/1716] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:52:20.213919 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53340cb1-83a3-48f5-845e-3ccc2e635773 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:20.226858 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-53340cb1-83a3-48f5-845e-3ccc2e635773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:20.243723 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-611ae24f-f27d-4fc4-8913-e18e203dfcb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85b5d38df8e1448a8413767e35b96059', 'request_id': 'req-611ae24f-f27d-4fc4-8913-e18e203dfcb9'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:20.283170 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53340cb1-83a3-48f5-845e-3ccc2e635773 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:20.285893 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-611ae24f-f27d-4fc4-8913-e18e203dfcb9 admin admin] The token cache is being invalidate because project 85b5d38df8e1448a8413767e35b96059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:20.286180 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-611ae24f-f27d-4fc4-8913-e18e203dfcb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:20.287799 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-611ae24f-f27d-4fc4-8913-e18e203dfcb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:20.296945 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 865/1717] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:20 2022] DELETE /identity/v3/projects/85b5d38df8e1448a8413767e35b96059 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:20.298146 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ae24f-f27d-4fc4-8913-e18e203dfcb9 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:20.303196 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-611ae24f-f27d-4fc4-8913-e18e203dfcb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:20.383594 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453ff0b-56a7-4e37-a644-1b6761975d38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:20.385012 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453ff0b-56a7-4e37-a644-1b6761975d38 service nova] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:20.385523 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453ff0b-56a7-4e37-a644-1b6761975d38 service nova] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:20.386206 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453ff0b-56a7-4e37-a644-1b6761975d38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:20.389768 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-b453ff0b-56a7-4e37-a644-1b6761975d38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:20.409509 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453ff0b-56a7-4e37-a644-1b6761975d38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:20.411621 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453ff0b-56a7-4e37-a644-1b6761975d38 service nova] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:20.446557 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 853/1718] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:20.447892 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00247f-cef1-449e-8f42-d1c454e8ff43 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:20.448187 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00247f-cef1-449e-8f42-d1c454e8ff43 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:20.448459 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00247f-cef1-449e-8f42-d1c454e8ff43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:20.507332 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ae24f-f27d-4fc4-8913-e18e203dfcb9 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:20.513963 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-2e00247f-cef1-449e-8f42-d1c454e8ff43 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:20.515193 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-2e00247f-cef1-449e-8f42-d1c454e8ff43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:20.533812 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e6f7a-393c-4e6a-a8c8-b6fea12aa619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:20.534834 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e6f7a-393c-4e6a-a8c8-b6fea12aa619 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:20.535940 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e6f7a-393c-4e6a-a8c8-b6fea12aa619 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:20.542814 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 854/1719] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:20.545210 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e6f7a-393c-4e6a-a8c8-b6fea12aa619 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:20.546365 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e6f7a-393c-4e6a-a8c8-b6fea12aa619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:20.548812 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe4aed-9166-442d-bd32-c282fca95178 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:20.549080 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe4aed-9166-442d-bd32-c282fca95178 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:20.549381 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe4aed-9166-442d-bd32-c282fca95178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:20.551251 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e6f7a-393c-4e6a-a8c8-b6fea12aa619 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:20.577914 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-99fe4aed-9166-442d-bd32-c282fca95178 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:20.580080 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-99fe4aed-9166-442d-bd32-c282fca95178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:20.611803 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 855/1720] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:20.615860 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe4aed-9166-442d-bd32-c282fca95178 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:20.647321 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe4aed-9166-442d-bd32-c282fca95178 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:20.656774 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 866/1721] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:20 2022] POST /identity/v3/projects => generated 385 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:20.669219 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e6f7a-393c-4e6a-a8c8-b6fea12aa619 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:20.670281 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d932b8-6fab-4024-a688-c9028eac11e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:20.673076 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d932b8-6fab-4024-a688-c9028eac11e2 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:20.673868 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d932b8-6fab-4024-a688-c9028eac11e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:20.675409 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d932b8-6fab-4024-a688-c9028eac11e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:20.678698 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d932b8-6fab-4024-a688-c9028eac11e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:20.679027 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d932b8-6fab-4024-a688-c9028eac11e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:20.688558 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d932b8-6fab-4024-a688-c9028eac11e2 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:20.721096 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 856/1722] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:52:20.722290 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d932b8-6fab-4024-a688-c9028eac11e2 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:20.747767 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d932b8-6fab-4024-a688-c9028eac11e2 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:20.801230 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e6f7a-393c-4e6a-a8c8-b6fea12aa619 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:20.814885 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501b73b-6de1-4851-94ea-dcf35547b54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:20.816361 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501b73b-6de1-4851-94ea-dcf35547b54b admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:20.816956 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501b73b-6de1-4851-94ea-dcf35547b54b admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:20.817467 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501b73b-6de1-4851-94ea-dcf35547b54b admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:20.820695 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501b73b-6de1-4851-94ea-dcf35547b54b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:20.822951 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501b73b-6de1-4851-94ea-dcf35547b54b admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:20.885929 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 867/1723] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:20 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:20.887576 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501b73b-6de1-4851-94ea-dcf35547b54b admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:20.921242 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501b73b-6de1-4851-94ea-dcf35547b54b admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:20.930148 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a41bfb-5aba-4804-9eef-b607ab5dcec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:20.930832 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a41bfb-5aba-4804-9eef-b607ab5dcec5 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:20.931119 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a41bfb-5aba-4804-9eef-b607ab5dcec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:20.931378 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a41bfb-5aba-4804-9eef-b607ab5dcec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:20.932079 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a41bfb-5aba-4804-9eef-b607ab5dcec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:20.937711 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a41bfb-5aba-4804-9eef-b607ab5dcec5 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:20.945982 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4ccdb-d25a-4cb1-8275-12a16ca0db68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:20.946673 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4ccdb-d25a-4cb1-8275-12a16ca0db68 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:20.946946 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4ccdb-d25a-4cb1-8275-12a16ca0db68 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:20.947216 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4ccdb-d25a-4cb1-8275-12a16ca0db68 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:20.948751 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4ccdb-d25a-4cb1-8275-12a16ca0db68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:20.950714 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a4ccdb-d25a-4cb1-8275-12a16ca0db68 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:20.974308 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 868/1724] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:20.978169 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4ccdb-d25a-4cb1-8275-12a16ca0db68 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:21.006330 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 857/1725] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:20 2022] POST /identity/v3/projects => generated 373 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:21.011743 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a41bfb-5aba-4804-9eef-b607ab5dcec5 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:21.012974 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4ccdb-d25a-4cb1-8275-12a16ca0db68 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:21.147069 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a41bfb-5aba-4804-9eef-b607ab5dcec5 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:21.151849 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b4c476-1956-420b-babd-82364b70227b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:21.157669 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4c476-1956-420b-babd-82364b70227b admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:21.159485 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4c476-1956-420b-babd-82364b70227b admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:21.160899 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b4c476-1956-420b-babd-82364b70227b admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:21.161935 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4c476-1956-420b-babd-82364b70227b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:21.166377 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b4c476-1956-420b-babd-82364b70227b admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:21.166726 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89275f3c-d055-4af7-ae39-a85d70c62f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:21.168582 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89275f3c-d055-4af7-ae39-a85d70c62f4a admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:21.168877 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89275f3c-d055-4af7-ae39-a85d70c62f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:21.169153 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89275f3c-d055-4af7-ae39-a85d70c62f4a admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:21.175373 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89275f3c-d055-4af7-ae39-a85d70c62f4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:21.177755 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89275f3c-d055-4af7-ae39-a85d70c62f4a admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:21.202808 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 869/1726] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:52:21.204897 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2598a-393c-43a2-af97-6734f7d6bba1 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:21.205636 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2598a-393c-43a2-af97-6734f7d6bba1 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:21.206057 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2598a-393c-43a2-af97-6734f7d6bba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:21.233240 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 858/1727] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:21 2022] POST /identity/v3/users => generated 287 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:21.234133 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89275f3c-d055-4af7-ae39-a85d70c62f4a admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:21.244381 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-82a2598a-393c-43a2-af97-6734f7d6bba1 None None] MFA Rules not processed for user `14bb5a0d28894d4fb2642d00f0832cbf`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:21.245150 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89275f3c-d055-4af7-ae39-a85d70c62f4a admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:21.247696 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-82a2598a-393c-43a2-af97-6734f7d6bba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:21.250908 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eceb52-72d2-43d9-a240-fb2abf205257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:21.251848 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eceb52-72d2-43d9-a240-fb2abf205257 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:21.252128 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eceb52-72d2-43d9-a240-fb2abf205257 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:21.252403 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eceb52-72d2-43d9-a240-fb2abf205257 admin admin] PATH_INFO: `/v3/projects/8e36563a61d94c16bd6b4002e33163c3/users/e6904dd4fc1041328b43ffc2dd4b39c8/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:21.279774 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eceb52-72d2-43d9-a240-fb2abf205257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e36563a61d94c16bd6b4002e33163c3, user_id=e6904dd4fc1041328b43ffc2dd4b39c8, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:21.284002 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eceb52-72d2-43d9-a240-fb2abf205257 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:21.310708 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 859/1728] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:21 2022] PUT /identity/v3/projects/8e36563a61d94c16bd6b4002e33163c3/users/e6904dd4fc1041328b43ffc2dd4b39c8/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:21.317930 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eceb52-72d2-43d9-a240-fb2abf205257 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:21.596515 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 870/1729] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:21.600941 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b385a5-bbc0-40dd-9100-540e43f4013d None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:21.605015 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b385a5-bbc0-40dd-9100-540e43f4013d None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:21.606556 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b385a5-bbc0-40dd-9100-540e43f4013d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:21.639036 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eceb52-72d2-43d9-a240-fb2abf205257 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:21.653668 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4957e-241d-4d12-b318-dd8f4005f5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:21.654707 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4957e-241d-4d12-b318-dd8f4005f5da admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:21.655166 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4957e-241d-4d12-b318-dd8f4005f5da admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:21.655580 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4957e-241d-4d12-b318-dd8f4005f5da admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:21.656443 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4957e-241d-4d12-b318-dd8f4005f5da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:21.658994 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4957e-241d-4d12-b318-dd8f4005f5da admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:21.675981 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-47b385a5-bbc0-40dd-9100-540e43f4013d None None] MFA Rules not processed for user `3f7d37d467324d88ae189dc8d89c314a`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:21.677296 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-47b385a5-bbc0-40dd-9100-540e43f4013d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:21.683464 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 860/1730] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:21.689306 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844482f-a733-4b4a-9d75-98070dc8b14f None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:21.691988 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844482f-a733-4b4a-9d75-98070dc8b14f None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:21.693555 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844482f-a733-4b4a-9d75-98070dc8b14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:21.759106 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-f844482f-a733-4b4a-9d75-98070dc8b14f None None] MFA Rules not processed for user `e6904dd4fc1041328b43ffc2dd4b39c8`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:21.761138 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f844482f-a733-4b4a-9d75-98070dc8b14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:21.843572 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 861/1731] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:21.848565 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844482f-a733-4b4a-9d75-98070dc8b14f None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:21.878743 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844482f-a733-4b4a-9d75-98070dc8b14f None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:21.896454 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84669b09-e222-421a-9d87-f55f666dbd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:21.896454 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84669b09-e222-421a-9d87-f55f666dbd47 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:21.896454 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84669b09-e222-421a-9d87-f55f666dbd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:21.896454 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84669b09-e222-421a-9d87-f55f666dbd47 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:21.896948 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84669b09-e222-421a-9d87-f55f666dbd47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:21.898940 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84669b09-e222-421a-9d87-f55f666dbd47 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:21.921452 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 871/1732] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:21.922313 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b385a5-bbc0-40dd-9100-540e43f4013d None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:21.950601 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b385a5-bbc0-40dd-9100-540e43f4013d None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:21.958762 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 862/1733] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:21.961719 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84669b09-e222-421a-9d87-f55f666dbd47 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:21.963703 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d95d7-1e9e-43db-aeeb-e413034e3a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:21.965054 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-84669b09-e222-421a-9d87-f55f666dbd47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:21.968482 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d95d7-1e9e-43db-aeeb-e413034e3a54 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:21.969078 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d95d7-1e9e-43db-aeeb-e413034e3a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:21.969447 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d95d7-1e9e-43db-aeeb-e413034e3a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:21.970279 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d95d7-1e9e-43db-aeeb-e413034e3a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:21.973842 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d95d7-1e9e-43db-aeeb-e413034e3a54 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:22.048006 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 872/1734] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:21 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:22.049879 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d95d7-1e9e-43db-aeeb-e413034e3a54 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:22.191944 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84669b09-e222-421a-9d87-f55f666dbd47 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:22.369375 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d95d7-1e9e-43db-aeeb-e413034e3a54 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:22.377996 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be18bfd-368e-43f8-bea2-434aa3de30fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:22.378930 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be18bfd-368e-43f8-bea2-434aa3de30fe admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:22.382863 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be18bfd-368e-43f8-bea2-434aa3de30fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:22.383195 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be18bfd-368e-43f8-bea2-434aa3de30fe admin admin] PATH_INFO: `/v3/projects/220289d8ac4246bfb015d989d61c6ef5/users/b8afc39f51864dfb999c499993299362/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:22.424314 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be18bfd-368e-43f8-bea2-434aa3de30fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=220289d8ac4246bfb015d989d61c6ef5, user_id=b8afc39f51864dfb999c499993299362, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:22.431763 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be18bfd-368e-43f8-bea2-434aa3de30fe admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:22.465183 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf8504-11ff-4454-9a26-674c9895885d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:22.466540 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf8504-11ff-4454-9a26-674c9895885d service nova] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:22.466993 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf8504-11ff-4454-9a26-674c9895885d service nova] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:22.467397 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf8504-11ff-4454-9a26-674c9895885d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:22.481399 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 873/1735] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:22 2022] PUT /identity/v3/projects/220289d8ac4246bfb015d989d61c6ef5/users/b8afc39f51864dfb999c499993299362/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:22.483344 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be18bfd-368e-43f8-bea2-434aa3de30fe admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:22.672046 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be18bfd-368e-43f8-bea2-434aa3de30fe admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:22.701292 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35945700-44b3-486f-9ee6-016824e6f888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:22.704687 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35945700-44b3-486f-9ee6-016824e6f888 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:22.704973 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35945700-44b3-486f-9ee6-016824e6f888 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:22.705235 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35945700-44b3-486f-9ee6-016824e6f888 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:22.705977 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35945700-44b3-486f-9ee6-016824e6f888 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:22.722546 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35945700-44b3-486f-9ee6-016824e6f888 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:22.752075 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf8504-11ff-4454-9a26-674c9895885d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:22.757276 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf8504-11ff-4454-9a26-674c9895885d service nova] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:22.788346 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 874/1736] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:22 2022] POST /identity/v3/users => generated 300 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:22.793120 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35945700-44b3-486f-9ee6-016824e6f888 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:22.797775 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 863/1737] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 838 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:22.799327 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1b332-b74b-40a5-8249-cdb746423cd0 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:22.799596 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1b332-b74b-40a5-8249-cdb746423cd0 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:22.799874 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1b332-b74b-40a5-8249-cdb746423cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:22.800509 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-35945700-44b3-486f-9ee6-016824e6f888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:22.901702 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-46e1b332-b74b-40a5-8249-cdb746423cd0 None None] MFA Rules not processed for user `b8afc39f51864dfb999c499993299362`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:22.902956 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-46e1b332-b74b-40a5-8249-cdb746423cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:23.173744 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 864/1738] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:23.182622 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1b332-b74b-40a5-8249-cdb746423cd0 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:23.202106 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35945700-44b3-486f-9ee6-016824e6f888 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:23.221107 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e1b332-b74b-40a5-8249-cdb746423cd0 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:23.232728 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9957eac-719b-443d-b53e-2d26bb41a580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:23.233941 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9957eac-719b-443d-b53e-2d26bb41a580 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:23.236658 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9957eac-719b-443d-b53e-2d26bb41a580 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:23.237500 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9957eac-719b-443d-b53e-2d26bb41a580 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:23.238494 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9957eac-719b-443d-b53e-2d26bb41a580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:23.241229 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1d399-8efa-4ed9-b892-161c50d03041 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:23.245097 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9957eac-719b-443d-b53e-2d26bb41a580 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:23.246464 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1d399-8efa-4ed9-b892-161c50d03041 service nova] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:23.247426 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1d399-8efa-4ed9-b892-161c50d03041 service nova] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:23.247668 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1d399-8efa-4ed9-b892-161c50d03041 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:23.309916 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 865/1739] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:23.316951 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9957eac-719b-443d-b53e-2d26bb41a580 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:23.359809 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9957eac-719b-443d-b53e-2d26bb41a580 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:23.383854 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de913c6c-dd44-4110-bcca-caecc9cee37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:23.384879 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de913c6c-dd44-4110-bcca-caecc9cee37c admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:23.385373 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de913c6c-dd44-4110-bcca-caecc9cee37c admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:23.386527 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de913c6c-dd44-4110-bcca-caecc9cee37c admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:23.389033 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de913c6c-dd44-4110-bcca-caecc9cee37c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:23.397333 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de913c6c-dd44-4110-bcca-caecc9cee37c admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:23.540964 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 866/1740] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:23 2022] POST /identity/v3/projects => generated 371 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:23.541890 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de913c6c-dd44-4110-bcca-caecc9cee37c admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:23.583594 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1d399-8efa-4ed9-b892-161c50d03041 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:23.585249 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1d399-8efa-4ed9-b892-161c50d03041 service nova] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:23.664648 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 875/1741] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 873 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:23.671763 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1d399-8efa-4ed9-b892-161c50d03041 service nova] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:23.718702 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1d399-8efa-4ed9-b892-161c50d03041 service nova] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:23.913959 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de913c6c-dd44-4110-bcca-caecc9cee37c admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:23.938632 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee0a95-5022-4c6a-b2a2-245cdbae54c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:23.942484 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee0a95-5022-4c6a-b2a2-245cdbae54c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:23.943835 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee0a95-5022-4c6a-b2a2-245cdbae54c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:23.948568 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee0a95-5022-4c6a-b2a2-245cdbae54c8 admin admin] PATH_INFO: `/v3/projects/c89661fd3d244289b4238d7c5ed8c755/users/4821e2638a95425687ffe2c52e6066cd/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:24.005521 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee0a95-5022-4c6a-b2a2-245cdbae54c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89661fd3d244289b4238d7c5ed8c755, user_id=4821e2638a95425687ffe2c52e6066cd, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:24.016056 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee0a95-5022-4c6a-b2a2-245cdbae54c8 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:24.024861 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e7365-aa58-46fa-9ce5-e0e0f23df6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:24.027628 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e7365-aa58-46fa-9ce5-e0e0f23df6c5 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:24.034175 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e7365-aa58-46fa-9ce5-e0e0f23df6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:24.035445 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e7365-aa58-46fa-9ce5-e0e0f23df6c5 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:24.037271 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e7365-aa58-46fa-9ce5-e0e0f23df6c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:24.041039 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e7365-aa58-46fa-9ce5-e0e0f23df6c5 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:24.069910 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 867/1742] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:23 2022] PUT /identity/v3/projects/c89661fd3d244289b4238d7c5ed8c755/users/4821e2638a95425687ffe2c52e6066cd/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:24.077555 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee0a95-5022-4c6a-b2a2-245cdbae54c8 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:24.167933 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 876/1743] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:23 2022] POST /identity/v3/users => generated 292 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:24.171669 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e7365-aa58-46fa-9ce5-e0e0f23df6c5 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:24.212206 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e7365-aa58-46fa-9ce5-e0e0f23df6c5 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:24.334085 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee0a95-5022-4c6a-b2a2-245cdbae54c8 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:24.346882 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb099c5-4492-41ba-990b-0c375622e092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:24.350986 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb099c5-4492-41ba-990b-0c375622e092 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:24.353653 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb099c5-4492-41ba-990b-0c375622e092 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:24.354110 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb099c5-4492-41ba-990b-0c375622e092 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:24.355955 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb099c5-4492-41ba-990b-0c375622e092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:24.359831 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb099c5-4492-41ba-990b-0c375622e092 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:24.397827 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 868/1744] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:24.400387 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb099c5-4492-41ba-990b-0c375622e092 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:24.429872 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb099c5-4492-41ba-990b-0c375622e092 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:24.441137 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d720f-f577-4bae-935a-4d1d0fc389f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:24.442365 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d720f-f577-4bae-935a-4d1d0fc389f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:24.442786 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d720f-f577-4bae-935a-4d1d0fc389f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:24.443197 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d720f-f577-4bae-935a-4d1d0fc389f2 admin admin] PATH_INFO: `/v3/projects/c89661fd3d244289b4238d7c5ed8c755/users/4821e2638a95425687ffe2c52e6066cd/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:24.445520 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d720f-f577-4bae-935a-4d1d0fc389f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c89661fd3d244289b4238d7c5ed8c755, user_id=4821e2638a95425687ffe2c52e6066cd, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:24.448462 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d720f-f577-4bae-935a-4d1d0fc389f2 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:24.469685 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 869/1745] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:24 2022] PUT /identity/v3/projects/c89661fd3d244289b4238d7c5ed8c755/users/4821e2638a95425687ffe2c52e6066cd/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:24.471503 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62607a1-6034-4090-bc65-a3eec338db1d None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:24.471943 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62607a1-6034-4090-bc65-a3eec338db1d None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:24.472383 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62607a1-6034-4090-bc65-a3eec338db1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:24.522436 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a6f5a-2ebf-417d-8390-9c3656cf2789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:24.523220 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a6f5a-2ebf-417d-8390-9c3656cf2789 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:24.523555 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a6f5a-2ebf-417d-8390-9c3656cf2789 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:24.523794 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a6f5a-2ebf-417d-8390-9c3656cf2789 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:24.524564 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a6f5a-2ebf-417d-8390-9c3656cf2789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:24.531122 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73a6f5a-2ebf-417d-8390-9c3656cf2789 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:24.551125 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-d62607a1-6034-4090-bc65-a3eec338db1d None None] MFA Rules not processed for user `4821e2638a95425687ffe2c52e6066cd`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:24.554402 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-d62607a1-6034-4090-bc65-a3eec338db1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:24.580002 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 877/1746] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:24.581425 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a6f5a-2ebf-417d-8390-9c3656cf2789 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:24.609425 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a6f5a-2ebf-417d-8390-9c3656cf2789 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:24.776772 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 870/1747] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:24.794561 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62607a1-6034-4090-bc65-a3eec338db1d None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:24.797092 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-d62607a1-6034-4090-bc65-a3eec338db1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:24.800746 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf07bd-040a-4740-8b0a-935182f1ac0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:24.801984 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf07bd-040a-4740-8b0a-935182f1ac0c admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:24.802266 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf07bd-040a-4740-8b0a-935182f1ac0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:24.802610 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf07bd-040a-4740-8b0a-935182f1ac0c admin admin] PATH_INFO: `/v3/projects/dc495702be6c4256923923d105822df5/users/afe8fdc751654d7c8b62de26a6e1114b/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:24.854605 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf07bd-040a-4740-8b0a-935182f1ac0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc495702be6c4256923923d105822df5, user_id=afe8fdc751654d7c8b62de26a6e1114b, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:24.857331 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf07bd-040a-4740-8b0a-935182f1ac0c admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:24.907814 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 878/1748] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:24 2022] PUT /identity/v3/projects/dc495702be6c4256923923d105822df5/users/afe8fdc751654d7c8b62de26a6e1114b/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:24.916332 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf07bd-040a-4740-8b0a-935182f1ac0c admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:24.993834 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62607a1-6034-4090-bc65-a3eec338db1d None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:25.061990 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f8af7-a096-41fb-8975-808e7af02740 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:25.062653 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f8af7-a096-41fb-8975-808e7af02740 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:25.063219 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f8af7-a096-41fb-8975-808e7af02740 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:25.063501 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122f8af7-a096-41fb-8975-808e7af02740 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:25.172104 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f8af7-a096-41fb-8975-808e7af02740 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:25.173745 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122f8af7-a096-41fb-8975-808e7af02740 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:25.174674 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf07bd-040a-4740-8b0a-935182f1ac0c admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:25.200378 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0022d26-bcdc-4d79-85f5-81368bc1f60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:25.200928 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0022d26-bcdc-4d79-85f5-81368bc1f60c admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:25.201203 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0022d26-bcdc-4d79-85f5-81368bc1f60c admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:25.201662 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0022d26-bcdc-4d79-85f5-81368bc1f60c admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:25.202540 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0022d26-bcdc-4d79-85f5-81368bc1f60c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:25.204983 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0022d26-bcdc-4d79-85f5-81368bc1f60c admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:25.218269 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 871/1749] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:52:25.266916 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 879/1750] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:52:25.271902 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f8af7-a096-41fb-8975-808e7af02740 service cinder] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:25.337550 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122f8af7-a096-41fb-8975-808e7af02740 service cinder] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:25.378972 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361d3ec-3f51-49d2-a02a-54e3954f385b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:25.379906 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361d3ec-3f51-49d2-a02a-54e3954f385b admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:25.380190 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361d3ec-3f51-49d2-a02a-54e3954f385b admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:25.380465 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361d3ec-3f51-49d2-a02a-54e3954f385b admin admin] PATH_INFO: `/v3/projects/dc495702be6c4256923923d105822df5/users/afe8fdc751654d7c8b62de26a6e1114b/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:25.410208 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361d3ec-3f51-49d2-a02a-54e3954f385b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc495702be6c4256923923d105822df5, user_id=afe8fdc751654d7c8b62de26a6e1114b, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:25.426919 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361d3ec-3f51-49d2-a02a-54e3954f385b admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:25.489765 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 872/1751] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:25 2022] PUT /identity/v3/projects/dc495702be6c4256923923d105822df5/users/afe8fdc751654d7c8b62de26a6e1114b/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:25.494770 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2322a1a-fd43-4cf0-a8c7-a33120abe114 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:25.494770 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2322a1a-fd43-4cf0-a8c7-a33120abe114 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:25.495037 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2322a1a-fd43-4cf0-a8c7-a33120abe114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:25.598380 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-a2322a1a-fd43-4cf0-a8c7-a33120abe114 None None] MFA Rules not processed for user `afe8fdc751654d7c8b62de26a6e1114b`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:25.599711 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-a2322a1a-fd43-4cf0-a8c7-a33120abe114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:25.765908 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361d3ec-3f51-49d2-a02a-54e3954f385b admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:25.767455 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-a361d3ec-3f51-49d2-a02a-54e3954f385b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:25.859820 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 880/1752] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:25 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:25.947728 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2322a1a-fd43-4cf0-a8c7-a33120abe114 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:26.064113 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361d3ec-3f51-49d2-a02a-54e3954f385b admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:26.083584 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2322a1a-fd43-4cf0-a8c7-a33120abe114 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:26.096877 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec05df2-3fad-4fcf-b9c4-61c01720d85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:26.097254 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec05df2-3fad-4fcf-b9c4-61c01720d85c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:26.097554 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec05df2-3fad-4fcf-b9c4-61c01720d85c admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:26.097775 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d3ebb2-124d-49b2-b1d1-028efa39f7e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:26.097923 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec05df2-3fad-4fcf-b9c4-61c01720d85c admin admin] PATH_INFO: `/v3/users/695eb0506dfa4588bde6fc5551bf9b21` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:26.098828 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3ebb2-124d-49b2-b1d1-028efa39f7e7 service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:26.099255 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3ebb2-124d-49b2-b1d1-028efa39f7e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:26.099689 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d3ebb2-124d-49b2-b1d1-028efa39f7e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:26.102033 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec05df2-3fad-4fcf-b9c4-61c01720d85c admin admin] RBAC: Authorizing `identity:delete_user(user_id=695eb0506dfa4588bde6fc5551bf9b21)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:26.104088 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec05df2-3fad-4fcf-b9c4-61c01720d85c admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:26.121308 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3ebb2-124d-49b2-b1d1-028efa39f7e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:26.122999 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d3ebb2-124d-49b2-b1d1-028efa39f7e7 service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:26.179226 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 881/1753] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:25 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:52:26.233949 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-3ec05df2-3fad-4fcf-b9c4-61c01720d85c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '695eb0506dfa4588bde6fc5551bf9b21'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:26.238445 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-3ec05df2-3fad-4fcf-b9c4-61c01720d85c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '695eb0506dfa4588bde6fc5551bf9b21'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:26.267678 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-3ec05df2-3fad-4fcf-b9c4-61c01720d85c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '695eb0506dfa4588bde6fc5551bf9b21'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:26.322070 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-3ec05df2-3fad-4fcf-b9c4-61c01720d85c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '695eb0506dfa4588bde6fc5551bf9b21'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:26.355445 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-3ec05df2-3fad-4fcf-b9c4-61c01720d85c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '695eb0506dfa4588bde6fc5551bf9b21'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:26.389531 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502565d3-c635-4b47-8d1b-d18395b88547 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:26.389881 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502565d3-c635-4b47-8d1b-d18395b88547 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:26.390756 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502565d3-c635-4b47-8d1b-d18395b88547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:26.392407 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 873/1754] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:25 2022] DELETE /identity/v3/users/695eb0506dfa4588bde6fc5551bf9b21 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:52:26.436429 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-502565d3-c635-4b47-8d1b-d18395b88547 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:26.447410 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-502565d3-c635-4b47-8d1b-d18395b88547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:26.520423 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec05df2-3fad-4fcf-b9c4-61c01720d85c admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:26.522168 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-3ec05df2-3fad-4fcf-b9c4-61c01720d85c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:26.700119 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 882/1755] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:26.737818 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502565d3-c635-4b47-8d1b-d18395b88547 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:26.739625 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-502565d3-c635-4b47-8d1b-d18395b88547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:26.751720 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec05df2-3fad-4fcf-b9c4-61c01720d85c admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:26.762527 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab97d18-f85d-4f1b-8553-af70eafd7bc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:26.763200 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab97d18-f85d-4f1b-8553-af70eafd7bc7 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:26.765051 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab97d18-f85d-4f1b-8553-af70eafd7bc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:26.765376 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab97d18-f85d-4f1b-8553-af70eafd7bc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:26.770754 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-1ab97d18-f85d-4f1b-8553-af70eafd7bc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:26.904543 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502565d3-c635-4b47-8d1b-d18395b88547 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:26.921459 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9a219-dc96-45dc-95b7-aff38a26a27e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:26.924096 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9a219-dc96-45dc-95b7-aff38a26a27e service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:26.925106 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9a219-dc96-45dc-95b7-aff38a26a27e service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:26.926840 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9a219-dc96-45dc-95b7-aff38a26a27e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:26.967376 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9a219-dc96-45dc-95b7-aff38a26a27e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:26.974110 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9a219-dc96-45dc-95b7-aff38a26a27e service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:26.996008 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab97d18-f85d-4f1b-8553-af70eafd7bc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:27.002613 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab97d18-f85d-4f1b-8553-af70eafd7bc7 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:27.009988 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 883/1756] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:52:27.046183 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 874/1757] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:52:27.610300 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9a219-dc96-45dc-95b7-aff38a26a27e service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:27.612257 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-d6a9a219-dc96-45dc-95b7-aff38a26a27e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:27.638183 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9a219-dc96-45dc-95b7-aff38a26a27e service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:27.658385 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4a471-f9fe-4609-a953-d665e3242224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:27.659998 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4a471-f9fe-4609-a953-d665e3242224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:27.660584 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4a471-f9fe-4609-a953-d665e3242224 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:27.660847 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4a471-f9fe-4609-a953-d665e3242224 admin admin] PATH_INFO: `/v3/users/e6904dd4fc1041328b43ffc2dd4b39c8` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:27.663328 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4a471-f9fe-4609-a953-d665e3242224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6904dd4fc1041328b43ffc2dd4b39c8)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:27.667600 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4a471-f9fe-4609-a953-d665e3242224 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:27.789404 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-5da4a471-f9fe-4609-a953-d665e3242224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6904dd4fc1041328b43ffc2dd4b39c8'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:27.793826 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-5da4a471-f9fe-4609-a953-d665e3242224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6904dd4fc1041328b43ffc2dd4b39c8'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:27.813426 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-5da4a471-f9fe-4609-a953-d665e3242224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6904dd4fc1041328b43ffc2dd4b39c8'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:27.822870 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-5da4a471-f9fe-4609-a953-d665e3242224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6904dd4fc1041328b43ffc2dd4b39c8'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:27.839066 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-5da4a471-f9fe-4609-a953-d665e3242224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6904dd4fc1041328b43ffc2dd4b39c8'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:27.849574 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 884/1758] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:27 2022] DELETE /identity/v3/users/e6904dd4fc1041328b43ffc2dd4b39c8 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:27.854619 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9c9ec-bba4-4e90-a03f-489d2c6caa0f None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:27.855095 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9c9ec-bba4-4e90-a03f-489d2c6caa0f None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:27.855164 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9c9ec-bba4-4e90-a03f-489d2c6caa0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:27.862208 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4a471-f9fe-4609-a953-d665e3242224 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:27.868880 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-5da4a471-f9fe-4609-a953-d665e3242224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:27.881404 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-acb9c9ec-bba4-4e90-a03f-489d2c6caa0f None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:27.885202 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-acb9c9ec-bba4-4e90-a03f-489d2c6caa0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:28.003161 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 875/1759] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:28.011555 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9c9ec-bba4-4e90-a03f-489d2c6caa0f None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:28.013218 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-acb9c9ec-bba4-4e90-a03f-489d2c6caa0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:28.037176 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9c9ec-bba4-4e90-a03f-489d2c6caa0f None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:28.081393 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b04f56-e112-4271-a718-5fa94f1ec835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:28.086457 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4a471-f9fe-4609-a953-d665e3242224 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:28.086979 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b04f56-e112-4271-a718-5fa94f1ec835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:28.087346 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b04f56-e112-4271-a718-5fa94f1ec835 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:28.087706 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b04f56-e112-4271-a718-5fa94f1ec835 admin admin] PATH_INFO: `/v3/users/cc798af469a94b559a53d6ea30096d1a` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:28.093611 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b04f56-e112-4271-a718-5fa94f1ec835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc798af469a94b559a53d6ea30096d1a)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:28.100978 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b04f56-e112-4271-a718-5fa94f1ec835 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:28.109643 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c0e5b-dcba-4ac8-baea-010c19bbb8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:28.110594 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c0e5b-dcba-4ac8-baea-010c19bbb8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:28.110874 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c0e5b-dcba-4ac8-baea-010c19bbb8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:28.111195 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c0e5b-dcba-4ac8-baea-010c19bbb8d3 admin admin] PATH_INFO: `/v3/projects/4dbc0bdc9692457b971774c79e0d7a9b` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:28.113661 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c0e5b-dcba-4ac8-baea-010c19bbb8d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dbc0bdc9692457b971774c79e0d7a9b)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:28.117858 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c0e5b-dcba-4ac8-baea-010c19bbb8d3 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:28.231557 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a8b04f56-e112-4271-a718-5fa94f1ec835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc798af469a94b559a53d6ea30096d1a'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:28.232272 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a8b04f56-e112-4271-a718-5fa94f1ec835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc798af469a94b559a53d6ea30096d1a'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:28.258445 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a8b04f56-e112-4271-a718-5fa94f1ec835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc798af469a94b559a53d6ea30096d1a'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:28.279850 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-d83c0e5b-dcba-4ac8-baea-010c19bbb8d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dbc0bdc9692457b971774c79e0d7a9b', 'request_id': 'req-d83c0e5b-dcba-4ac8-baea-010c19bbb8d3'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:28.281602 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a8b04f56-e112-4271-a718-5fa94f1ec835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc798af469a94b559a53d6ea30096d1a'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:28.298691 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-d83c0e5b-dcba-4ac8-baea-010c19bbb8d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dbc0bdc9692457b971774c79e0d7a9b', 'request_id': 'req-d83c0e5b-dcba-4ac8-baea-010c19bbb8d3'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:28.303087 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a8b04f56-e112-4271-a718-5fa94f1ec835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc798af469a94b559a53d6ea30096d1a'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:28.315816 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-d83c0e5b-dcba-4ac8-baea-010c19bbb8d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dbc0bdc9692457b971774c79e0d7a9b', 'request_id': 'req-d83c0e5b-dcba-4ac8-baea-010c19bbb8d3'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:28.317189 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 876/1760] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:28 2022] DELETE /identity/v3/users/cc798af469a94b559a53d6ea30096d1a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:28.323348 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b04f56-e112-4271-a718-5fa94f1ec835 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:28.326036 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-a8b04f56-e112-4271-a718-5fa94f1ec835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:28.350674 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-d83c0e5b-dcba-4ac8-baea-010c19bbb8d3 admin admin] The token cache is being invalidate because project 4dbc0bdc9692457b971774c79e0d7a9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:28.352690 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-d83c0e5b-dcba-4ac8-baea-010c19bbb8d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:28.355875 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-d83c0e5b-dcba-4ac8-baea-010c19bbb8d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:28.358493 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 885/1761] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:27 2022] DELETE /identity/v3/projects/4dbc0bdc9692457b971774c79e0d7a9b => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:28.360809 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6eefc-a8ec-46cb-952c-8b9cadffbc36 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:28.361375 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6eefc-a8ec-46cb-952c-8b9cadffbc36 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:28.362017 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6eefc-a8ec-46cb-952c-8b9cadffbc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:28.421319 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-c0c6eefc-a8ec-46cb-952c-8b9cadffbc36 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:28.426217 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-c0c6eefc-a8ec-46cb-952c-8b9cadffbc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:28.502574 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b04f56-e112-4271-a718-5fa94f1ec835 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:28.517710 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27e474-32f1-4b3b-bbc8-7c4914271acd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:28.520718 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27e474-32f1-4b3b-bbc8-7c4914271acd service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:28.521018 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27e474-32f1-4b3b-bbc8-7c4914271acd service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:28.521305 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad27e474-32f1-4b3b-bbc8-7c4914271acd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:28.531480 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-ad27e474-32f1-4b3b-bbc8-7c4914271acd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:28.590258 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 886/1762] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:28.592090 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b752c35-5aa4-43ea-90c7-ae46b5b5e32b None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:28.592507 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b752c35-5aa4-43ea-90c7-ae46b5b5e32b None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:28.592914 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b752c35-5aa4-43ea-90c7-ae46b5b5e32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:28.633010 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-5b752c35-5aa4-43ea-90c7-ae46b5b5e32b None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:28.635220 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-5b752c35-5aa4-43ea-90c7-ae46b5b5e32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:28.658441 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 887/1763] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:28.659358 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b752c35-5aa4-43ea-90c7-ae46b5b5e32b None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:28.666820 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-5b752c35-5aa4-43ea-90c7-ae46b5b5e32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:28.697902 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b752c35-5aa4-43ea-90c7-ae46b5b5e32b None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:28.706709 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538a873-e720-4612-8d3a-ec7864d81410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:28.707594 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538a873-e720-4612-8d3a-ec7864d81410 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:28.707789 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538a873-e720-4612-8d3a-ec7864d81410 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:28.708147 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538a873-e720-4612-8d3a-ec7864d81410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:28.744910 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538a873-e720-4612-8d3a-ec7864d81410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:28.746424 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538a873-e720-4612-8d3a-ec7864d81410 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:28.773119 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 888/1764] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:28.774409 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e235e12-c110-46cf-b356-2853ab5c8cff None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:28.775163 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e235e12-c110-46cf-b356-2853ab5c8cff None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:28.775451 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e235e12-c110-46cf-b356-2853ab5c8cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:28.819032 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27e474-32f1-4b3b-bbc8-7c4914271acd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:28.823276 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad27e474-32f1-4b3b-bbc8-7c4914271acd service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:28.838501 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-1e235e12-c110-46cf-b356-2853ab5c8cff None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:28.839756 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-1e235e12-c110-46cf-b356-2853ab5c8cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:28.862586 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 889/1765] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:28.866768 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e235e12-c110-46cf-b356-2853ab5c8cff None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:28.868334 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 877/1766] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:28.887962 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e235e12-c110-46cf-b356-2853ab5c8cff None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:28.899210 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942965d-e4d0-4484-aaef-630907addaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:28.899913 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942965d-e4d0-4484-aaef-630907addaa6 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:28.900194 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942965d-e4d0-4484-aaef-630907addaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:28.900542 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942965d-e4d0-4484-aaef-630907addaa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:28.901288 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942965d-e4d0-4484-aaef-630907addaa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:28.902645 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942965d-e4d0-4484-aaef-630907addaa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:28.911364 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942965d-e4d0-4484-aaef-630907addaa6 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:28.939482 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 890/1767] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:52:28.947937 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27e474-32f1-4b3b-bbc8-7c4914271acd service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:28.979191 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad27e474-32f1-4b3b-bbc8-7c4914271acd service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:29.003504 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15608f-c83a-44bb-85f2-d09aad97f57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:29.007256 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15608f-c83a-44bb-85f2-d09aad97f57a admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:29.007525 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15608f-c83a-44bb-85f2-d09aad97f57a admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:29.010309 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15608f-c83a-44bb-85f2-d09aad97f57a admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:29.011345 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15608f-c83a-44bb-85f2-d09aad97f57a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:29.021436 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15608f-c83a-44bb-85f2-d09aad97f57a admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:29.115230 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 878/1768] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:28 2022] POST /identity/v3/projects => generated 369 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:29.116585 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942965d-e4d0-4484-aaef-630907addaa6 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:29.136440 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942965d-e4d0-4484-aaef-630907addaa6 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:29.275456 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83375e-8c7b-41a6-99ec-673109bc3706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:29.276334 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83375e-8c7b-41a6-99ec-673109bc3706 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:29.276442 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83375e-8c7b-41a6-99ec-673109bc3706 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:29.276698 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83375e-8c7b-41a6-99ec-673109bc3706 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:29.277440 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83375e-8c7b-41a6-99ec-673109bc3706 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:29.279380 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83375e-8c7b-41a6-99ec-673109bc3706 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:29.350249 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15608f-c83a-44bb-85f2-d09aad97f57a admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:29.372056 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15608f-c83a-44bb-85f2-d09aad97f57a admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:29.374904 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 891/1769] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:29 2022] POST /identity/v3/users => generated 285 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:52:29.400751 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6056c1-254a-4140-b9ab-414eb9f637a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:29.401481 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6056c1-254a-4140-b9ab-414eb9f637a0 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:29.401764 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6056c1-254a-4140-b9ab-414eb9f637a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:29.402035 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6056c1-254a-4140-b9ab-414eb9f637a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:29.403367 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6056c1-254a-4140-b9ab-414eb9f637a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:29.404954 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6056c1-254a-4140-b9ab-414eb9f637a0 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:29.441346 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83375e-8c7b-41a6-99ec-673109bc3706 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:29.451044 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 879/1770] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:29.453705 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83375e-8c7b-41a6-99ec-673109bc3706 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:29.474117 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb976ff-4dfc-42ee-8393-3163cd060a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:29.474761 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb976ff-4dfc-42ee-8393-3163cd060a7b admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:29.475008 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb976ff-4dfc-42ee-8393-3163cd060a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:29.475279 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb976ff-4dfc-42ee-8393-3163cd060a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:29.476181 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb976ff-4dfc-42ee-8393-3163cd060a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:29.479253 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb976ff-4dfc-42ee-8393-3163cd060a7b admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:29.518774 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6056c1-254a-4140-b9ab-414eb9f637a0 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:29.519206 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 892/1771] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:52:29.537214 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6056c1-254a-4140-b9ab-414eb9f637a0 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:29.545008 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f1884-39fa-475a-a078-5a40763f3602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:29.546211 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f1884-39fa-475a-a078-5a40763f3602 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:29.546634 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f1884-39fa-475a-a078-5a40763f3602 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:29.547117 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f1884-39fa-475a-a078-5a40763f3602 admin admin] PATH_INFO: `/v3/projects/15a61a2f33714e8da0baeff23ce5023a/users/a7508cfdf3024e648acdde2e8ae80ec9/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:29.580173 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f1884-39fa-475a-a078-5a40763f3602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a61a2f33714e8da0baeff23ce5023a, user_id=a7508cfdf3024e648acdde2e8ae80ec9, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:29.583123 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f1884-39fa-475a-a078-5a40763f3602 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:29.613111 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 880/1772] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:29 2022] PUT /identity/v3/projects/15a61a2f33714e8da0baeff23ce5023a/users/a7508cfdf3024e648acdde2e8ae80ec9/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:29.623510 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b01e1-adf7-414d-aafc-e759d39c6e8a None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:29.623801 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b01e1-adf7-414d-aafc-e759d39c6e8a None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:29.624076 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b01e1-adf7-414d-aafc-e759d39c6e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:29.686481 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-574b01e1-adf7-414d-aafc-e759d39c6e8a None None] MFA Rules not processed for user `a7508cfdf3024e648acdde2e8ae80ec9`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:29.689478 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-574b01e1-adf7-414d-aafc-e759d39c6e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:29.805003 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31777536-1030-427a-96f6-b9b0b449431a None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:29.806276 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31777536-1030-427a-96f6-b9b0b449431a None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:29.806636 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31777536-1030-427a-96f6-b9b0b449431a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:29.844514 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-31777536-1030-427a-96f6-b9b0b449431a None None] MFA Rules not processed for user `14bb5a0d28894d4fb2642d00f0832cbf`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:29.846055 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-31777536-1030-427a-96f6-b9b0b449431a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:29.951027 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 893/1773] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:29 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:29.955912 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b01e1-adf7-414d-aafc-e759d39c6e8a None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:30.006531 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 881/1774] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:30.092810 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b01e1-adf7-414d-aafc-e759d39c6e8a None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:30.102894 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadfddf4-34bc-447c-bf04-169cc7bb1b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:30.103619 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfddf4-34bc-447c-bf04-169cc7bb1b5a admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:30.103895 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfddf4-34bc-447c-bf04-169cc7bb1b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:30.104163 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfddf4-34bc-447c-bf04-169cc7bb1b5a admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:30.104864 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadfddf4-34bc-447c-bf04-169cc7bb1b5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:30.106850 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadfddf4-34bc-447c-bf04-169cc7bb1b5a admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:30.243666 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31777536-1030-427a-96f6-b9b0b449431a None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:30.246813 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 894/1775] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:29 2022] POST /identity/v3/projects => generated 369 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:52:30.262584 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31777536-1030-427a-96f6-b9b0b449431a None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:30.374447 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847dcea7-c627-4373-889d-bbd8ea45f8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:30.375494 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847dcea7-c627-4373-889d-bbd8ea45f8e8 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:30.375782 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847dcea7-c627-4373-889d-bbd8ea45f8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:30.376416 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847dcea7-c627-4373-889d-bbd8ea45f8e8 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:30.377135 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847dcea7-c627-4373-889d-bbd8ea45f8e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:30.379246 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847dcea7-c627-4373-889d-bbd8ea45f8e8 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:30.421523 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 882/1776] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:30 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:52:30.425663 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadfddf4-34bc-447c-bf04-169cc7bb1b5a admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:30.436801 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadfddf4-34bc-447c-bf04-169cc7bb1b5a admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:30.442134 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50856a93-eae8-45ee-98b0-8fc8372c7e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:30.442956 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50856a93-eae8-45ee-98b0-8fc8372c7e3c admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:30.443337 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50856a93-eae8-45ee-98b0-8fc8372c7e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:30.443710 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50856a93-eae8-45ee-98b0-8fc8372c7e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:30.446002 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50856a93-eae8-45ee-98b0-8fc8372c7e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:30.447756 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50856a93-eae8-45ee-98b0-8fc8372c7e3c admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:30.469436 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 895/1777] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:30.472971 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847dcea7-c627-4373-889d-bbd8ea45f8e8 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:30.488696 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847dcea7-c627-4373-889d-bbd8ea45f8e8 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:30.500418 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5199b-d246-4834-82ef-3e6f0e8d8284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:30.502424 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5199b-d246-4834-82ef-3e6f0e8d8284 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:30.503603 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5199b-d246-4834-82ef-3e6f0e8d8284 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:30.503895 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5199b-d246-4834-82ef-3e6f0e8d8284 admin admin] PATH_INFO: `/v3/projects/40517c0ca6844ce2a007141e9f6dac2c/users/ecfefdbcd1ff4972bf77de20507aaeea/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:30.571977 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5199b-d246-4834-82ef-3e6f0e8d8284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40517c0ca6844ce2a007141e9f6dac2c, user_id=ecfefdbcd1ff4972bf77de20507aaeea, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:30.577469 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5199b-d246-4834-82ef-3e6f0e8d8284 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:30.611024 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 883/1778] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:30 2022] PUT /identity/v3/projects/40517c0ca6844ce2a007141e9f6dac2c/users/ecfefdbcd1ff4972bf77de20507aaeea/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:30.615294 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50856a93-eae8-45ee-98b0-8fc8372c7e3c admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:30.630765 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50856a93-eae8-45ee-98b0-8fc8372c7e3c admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:30.740927 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088570b-66db-4a5b-9f95-e7e733c3c7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:30.743458 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088570b-66db-4a5b-9f95-e7e733c3c7d6 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:30.743756 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088570b-66db-4a5b-9f95-e7e733c3c7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:30.745062 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088570b-66db-4a5b-9f95-e7e733c3c7d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:30.747148 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088570b-66db-4a5b-9f95-e7e733c3c7d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:30.751657 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088570b-66db-4a5b-9f95-e7e733c3c7d6 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:30.769623 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 896/1779] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:52:30.773490 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5199b-d246-4834-82ef-3e6f0e8d8284 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:30.790717 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5199b-d246-4834-82ef-3e6f0e8d8284 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:30.802487 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071a5b1-dcd1-4f83-96c2-f1cd018c1b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:30.803475 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071a5b1-dcd1-4f83-96c2-f1cd018c1b00 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:30.803755 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071a5b1-dcd1-4f83-96c2-f1cd018c1b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:30.805144 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071a5b1-dcd1-4f83-96c2-f1cd018c1b00 admin admin] PATH_INFO: `/v3/projects/40517c0ca6844ce2a007141e9f6dac2c/users/ecfefdbcd1ff4972bf77de20507aaeea/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:30.810274 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071a5b1-dcd1-4f83-96c2-f1cd018c1b00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40517c0ca6844ce2a007141e9f6dac2c, user_id=ecfefdbcd1ff4972bf77de20507aaeea, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:30.832852 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071a5b1-dcd1-4f83-96c2-f1cd018c1b00 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:30.868923 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 884/1780] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:30 2022] PUT /identity/v3/projects/40517c0ca6844ce2a007141e9f6dac2c/users/ecfefdbcd1ff4972bf77de20507aaeea/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:30.871361 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95251d1-d24c-4d51-8a7e-33eba0cc7204 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:30.871653 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95251d1-d24c-4d51-8a7e-33eba0cc7204 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:30.871928 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95251d1-d24c-4d51-8a7e-33eba0cc7204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:30.929679 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-f95251d1-d24c-4d51-8a7e-33eba0cc7204 None None] MFA Rules not processed for user `ecfefdbcd1ff4972bf77de20507aaeea`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:30.930978 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-f95251d1-d24c-4d51-8a7e-33eba0cc7204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:30.987893 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071a5b1-dcd1-4f83-96c2-f1cd018c1b00 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:30.991523 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-7071a5b1-dcd1-4f83-96c2-f1cd018c1b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:31.076694 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 897/1781] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:30 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:31.093508 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95251d1-d24c-4d51-8a7e-33eba0cc7204 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:31.095383 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-f95251d1-d24c-4d51-8a7e-33eba0cc7204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:31.100782 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071a5b1-dcd1-4f83-96c2-f1cd018c1b00 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:31.107509 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1b948-3f91-45b8-ae3a-744d4dbe6e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:31.108473 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1b948-3f91-45b8-ae3a-744d4dbe6e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:31.108752 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1b948-3f91-45b8-ae3a-744d4dbe6e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:31.109024 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1b948-3f91-45b8-ae3a-744d4dbe6e2f admin admin] PATH_INFO: `/v3/projects/d4949dc37a8e4cd4b13b18c83cb19543` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:31.110347 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1b948-3f91-45b8-ae3a-744d4dbe6e2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4949dc37a8e4cd4b13b18c83cb19543)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:31.112837 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1b948-3f91-45b8-ae3a-744d4dbe6e2f admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:31.188387 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-15c1b948-3f91-45b8-ae3a-744d4dbe6e2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4949dc37a8e4cd4b13b18c83cb19543', 'request_id': 'req-15c1b948-3f91-45b8-ae3a-744d4dbe6e2f'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:31.199507 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-15c1b948-3f91-45b8-ae3a-744d4dbe6e2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4949dc37a8e4cd4b13b18c83cb19543', 'request_id': 'req-15c1b948-3f91-45b8-ae3a-744d4dbe6e2f'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:31.219851 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95251d1-d24c-4d51-8a7e-33eba0cc7204 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:31.221325 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-15c1b948-3f91-45b8-ae3a-744d4dbe6e2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4949dc37a8e4cd4b13b18c83cb19543', 'request_id': 'req-15c1b948-3f91-45b8-ae3a-744d4dbe6e2f'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:31.235916 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-15c1b948-3f91-45b8-ae3a-744d4dbe6e2f admin admin] The token cache is being invalidate because project d4949dc37a8e4cd4b13b18c83cb19543 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:31.236198 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-15c1b948-3f91-45b8-ae3a-744d4dbe6e2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:31.239852 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-15c1b948-3f91-45b8-ae3a-744d4dbe6e2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:31.248352 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 885/1782] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:30 2022] DELETE /identity/v3/projects/d4949dc37a8e4cd4b13b18c83cb19543 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:31.249192 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1b948-3f91-45b8-ae3a-744d4dbe6e2f admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:31.250639 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-15c1b948-3f91-45b8-ae3a-744d4dbe6e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:31.321156 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820dfed-896f-4b86-9ef3-1e72b3578026 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:31.322651 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820dfed-896f-4b86-9ef3-1e72b3578026 service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:31.323171 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820dfed-896f-4b86-9ef3-1e72b3578026 service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:31.323632 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820dfed-896f-4b86-9ef3-1e72b3578026 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:31.326524 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-3820dfed-896f-4b86-9ef3-1e72b3578026 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:31.342617 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1b948-3f91-45b8-ae3a-744d4dbe6e2f admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:31.356079 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b0789-e008-4e9f-9e79-bbb8875a9cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:31.357119 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b0789-e008-4e9f-9e79-bbb8875a9cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:31.357992 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b0789-e008-4e9f-9e79-bbb8875a9cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:31.357992 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b0789-e008-4e9f-9e79-bbb8875a9cd1 admin admin] PATH_INFO: `/v3/projects/8e36563a61d94c16bd6b4002e33163c3` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:31.360508 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b0789-e008-4e9f-9e79-bbb8875a9cd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e36563a61d94c16bd6b4002e33163c3)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:31.362924 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80b0789-e008-4e9f-9e79-bbb8875a9cd1 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:31.410685 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820dfed-896f-4b86-9ef3-1e72b3578026 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:31.413164 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3820dfed-896f-4b86-9ef3-1e72b3578026 service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:31.450304 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 898/1783] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:31 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:31.451510 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820dfed-896f-4b86-9ef3-1e72b3578026 service cinder] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:31.458749 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-3820dfed-896f-4b86-9ef3-1e72b3578026 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:31.463195 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c80b0789-e008-4e9f-9e79-bbb8875a9cd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e36563a61d94c16bd6b4002e33163c3', 'request_id': 'req-c80b0789-e008-4e9f-9e79-bbb8875a9cd1'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:31.478655 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c80b0789-e008-4e9f-9e79-bbb8875a9cd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e36563a61d94c16bd6b4002e33163c3', 'request_id': 'req-c80b0789-e008-4e9f-9e79-bbb8875a9cd1'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:31.488672 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820dfed-896f-4b86-9ef3-1e72b3578026 service cinder] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:31.493238 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c80b0789-e008-4e9f-9e79-bbb8875a9cd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e36563a61d94c16bd6b4002e33163c3', 'request_id': 'req-c80b0789-e008-4e9f-9e79-bbb8875a9cd1'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:31.513783 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c80b0789-e008-4e9f-9e79-bbb8875a9cd1 admin admin] The token cache is being invalidate because project 8e36563a61d94c16bd6b4002e33163c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:31.514142 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c80b0789-e008-4e9f-9e79-bbb8875a9cd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:31.514819 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c80b0789-e008-4e9f-9e79-bbb8875a9cd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:31.516508 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 886/1784] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:31 2022] DELETE /identity/v3/projects/8e36563a61d94c16bd6b4002e33163c3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:31.520474 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b0789-e008-4e9f-9e79-bbb8875a9cd1 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:31.522380 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-c80b0789-e008-4e9f-9e79-bbb8875a9cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:31.629493 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b0789-e008-4e9f-9e79-bbb8875a9cd1 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:31.634796 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aba3f96-43f9-4b6b-afe4-92062b2c5776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:31.635703 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba3f96-43f9-4b6b-afe4-92062b2c5776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:31.635980 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba3f96-43f9-4b6b-afe4-92062b2c5776 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:31.636252 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aba3f96-43f9-4b6b-afe4-92062b2c5776 admin admin] PATH_INFO: `/v3/users/c15fba2ea50b4bb4b5ca91c296c493a4` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:31.637542 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba3f96-43f9-4b6b-afe4-92062b2c5776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c15fba2ea50b4bb4b5ca91c296c493a4)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:31.644537 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aba3f96-43f9-4b6b-afe4-92062b2c5776 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:31.647278 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5045f-1a54-48d7-b42b-237420f70761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:31.648655 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5045f-1a54-48d7-b42b-237420f70761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:31.649282 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5045f-1a54-48d7-b42b-237420f70761 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:31.649597 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5045f-1a54-48d7-b42b-237420f70761 admin admin] PATH_INFO: `/v3/users/4821e2638a95425687ffe2c52e6066cd` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:31.653618 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5045f-1a54-48d7-b42b-237420f70761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4821e2638a95425687ffe2c52e6066cd)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:31.661167 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5045f-1a54-48d7-b42b-237420f70761 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:31.756830 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-0aba3f96-43f9-4b6b-afe4-92062b2c5776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c15fba2ea50b4bb4b5ca91c296c493a4'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:31.758053 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-0aba3f96-43f9-4b6b-afe4-92062b2c5776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c15fba2ea50b4bb4b5ca91c296c493a4'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:31.781214 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-0aba3f96-43f9-4b6b-afe4-92062b2c5776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c15fba2ea50b4bb4b5ca91c296c493a4'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:31.803129 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-eda5045f-1a54-48d7-b42b-237420f70761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4821e2638a95425687ffe2c52e6066cd'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:31.805275 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-eda5045f-1a54-48d7-b42b-237420f70761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4821e2638a95425687ffe2c52e6066cd'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:31.809936 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-0aba3f96-43f9-4b6b-afe4-92062b2c5776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c15fba2ea50b4bb4b5ca91c296c493a4'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:31.832327 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-eda5045f-1a54-48d7-b42b-237420f70761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4821e2638a95425687ffe2c52e6066cd'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:31.864555 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-0aba3f96-43f9-4b6b-afe4-92062b2c5776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c15fba2ea50b4bb4b5ca91c296c493a4'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:31.871618 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-eda5045f-1a54-48d7-b42b-237420f70761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4821e2638a95425687ffe2c52e6066cd'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:31.888230 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 899/1785] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:31 2022] DELETE /identity/v3/users/c15fba2ea50b4bb4b5ca91c296c493a4 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:31.889666 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc5d64-2d31-410b-b566-7b58f99ada88 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:31.890488 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc5d64-2d31-410b-b566-7b58f99ada88 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:31.890488 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc5d64-2d31-410b-b566-7b58f99ada88 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:31.893806 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 900/1786] 10.222.0.18 () {54 vars in 912 bytes} [Tue Mar 8 13:52:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:52:31.897293 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-eda5045f-1a54-48d7-b42b-237420f70761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4821e2638a95425687ffe2c52e6066cd'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:31.904056 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f24a86-534e-49c8-9994-e9bcbed02d03 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:31.909510 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f24a86-534e-49c8-9994-e9bcbed02d03 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:31.909890 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f24a86-534e-49c8-9994-e9bcbed02d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:31.915544 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 887/1787] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:31 2022] DELETE /identity/v3/users/4821e2638a95425687ffe2c52e6066cd => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:31.939935 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-49f24a86-534e-49c8-9994-e9bcbed02d03 None None] MFA Rules not processed for user `4c610d719b3049f98b95cc8e9bd56834`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:31.942217 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-49f24a86-534e-49c8-9994-e9bcbed02d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:32.012090 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 901/1788] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Mar 8 13:52:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:32.078152 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5045f-1a54-48d7-b42b-237420f70761 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:32.080625 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-eda5045f-1a54-48d7-b42b-237420f70761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:32.146488 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5045f-1a54-48d7-b42b-237420f70761 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:32.158018 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37391339-0840-4156-ad3d-6a4b1d7bbe4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:32.158770 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37391339-0840-4156-ad3d-6a4b1d7bbe4e service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:32.159261 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37391339-0840-4156-ad3d-6a4b1d7bbe4e service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:32.160101 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37391339-0840-4156-ad3d-6a4b1d7bbe4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:32.180346 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37391339-0840-4156-ad3d-6a4b1d7bbe4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:32.180346 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37391339-0840-4156-ad3d-6a4b1d7bbe4e service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:32.198147 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 888/1789] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:32.541063 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f32c6-3032-4ada-becc-67743a5a3e5e None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:32.541547 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f32c6-3032-4ada-becc-67743a5a3e5e None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:32.541911 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f32c6-3032-4ada-becc-67743a5a3e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:32.563628 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-bb0f32c6-3032-4ada-becc-67743a5a3e5e None None] MFA Rules not processed for user `3f7d37d467324d88ae189dc8d89c314a`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:32.566475 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-bb0f32c6-3032-4ada-becc-67743a5a3e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:32.593701 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37391339-0840-4156-ad3d-6a4b1d7bbe4e service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:32.595518 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-37391339-0840-4156-ad3d-6a4b1d7bbe4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:32.747394 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 902/1790] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:32.766407 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37391339-0840-4156-ad3d-6a4b1d7bbe4e service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:32.772007 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c853a-267c-45c3-b8a7-87325bf50036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:32.773122 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c853a-267c-45c3-b8a7-87325bf50036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:32.773610 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c853a-267c-45c3-b8a7-87325bf50036 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:32.774115 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c853a-267c-45c3-b8a7-87325bf50036 admin admin] PATH_INFO: `/v3/projects/f14bf70ccaca4e63b315aaa9492cf0e2` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:32.775505 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c853a-267c-45c3-b8a7-87325bf50036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f14bf70ccaca4e63b315aaa9492cf0e2)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:32.778115 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7c853a-267c-45c3-b8a7-87325bf50036 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:32.855186 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-ca7c853a-267c-45c3-b8a7-87325bf50036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f14bf70ccaca4e63b315aaa9492cf0e2', 'request_id': 'req-ca7c853a-267c-45c3-b8a7-87325bf50036'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:32.867501 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-ca7c853a-267c-45c3-b8a7-87325bf50036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f14bf70ccaca4e63b315aaa9492cf0e2', 'request_id': 'req-ca7c853a-267c-45c3-b8a7-87325bf50036'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:32.878763 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-ca7c853a-267c-45c3-b8a7-87325bf50036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f14bf70ccaca4e63b315aaa9492cf0e2', 'request_id': 'req-ca7c853a-267c-45c3-b8a7-87325bf50036'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:32.896068 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-ca7c853a-267c-45c3-b8a7-87325bf50036 admin admin] The token cache is being invalidate because project f14bf70ccaca4e63b315aaa9492cf0e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:32.896403 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-ca7c853a-267c-45c3-b8a7-87325bf50036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:32.897706 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-ca7c853a-267c-45c3-b8a7-87325bf50036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:32.899676 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 889/1791] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:32 2022] DELETE /identity/v3/projects/f14bf70ccaca4e63b315aaa9492cf0e2 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:32.907504 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0b269-de14-479d-bb7d-8518d87744c9 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:32.907504 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0b269-de14-479d-bb7d-8518d87744c9 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:32.907504 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0b269-de14-479d-bb7d-8518d87744c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:32.980100 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-4ba0b269-de14-479d-bb7d-8518d87744c9 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:32.985084 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-4ba0b269-de14-479d-bb7d-8518d87744c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:32.987028 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c853a-267c-45c3-b8a7-87325bf50036 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:32.996634 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-ca7c853a-267c-45c3-b8a7-87325bf50036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:33.153927 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 903/1792] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:33.161502 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7c853a-267c-45c3-b8a7-87325bf50036 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:33.162816 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f0f5e-6b7b-4541-8b88-7a82d3cede72 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:33.163112 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f0f5e-6b7b-4541-8b88-7a82d3cede72 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:33.163394 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f0f5e-6b7b-4541-8b88-7a82d3cede72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:33.167031 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4b95c-668e-4148-91f2-e69c4399c7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:33.167932 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4b95c-668e-4148-91f2-e69c4399c7a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:33.168206 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4b95c-668e-4148-91f2-e69c4399c7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:33.168475 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4b95c-668e-4148-91f2-e69c4399c7a5 admin admin] PATH_INFO: `/v3/projects/c89661fd3d244289b4238d7c5ed8c755` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:33.170450 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4b95c-668e-4148-91f2-e69c4399c7a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c89661fd3d244289b4238d7c5ed8c755)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:33.172515 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4b95c-668e-4148-91f2-e69c4399c7a5 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:33.187837 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-d32f0f5e-6b7b-4541-8b88-7a82d3cede72 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:33.189805 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-d32f0f5e-6b7b-4541-8b88-7a82d3cede72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:33.239866 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 904/1793] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:33.247422 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f0f5e-6b7b-4541-8b88-7a82d3cede72 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:33.272858 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-1ee4b95c-668e-4148-91f2-e69c4399c7a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c89661fd3d244289b4238d7c5ed8c755', 'request_id': 'req-1ee4b95c-668e-4148-91f2-e69c4399c7a5'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:33.274305 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f0f5e-6b7b-4541-8b88-7a82d3cede72 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:33.287173 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-1ee4b95c-668e-4148-91f2-e69c4399c7a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c89661fd3d244289b4238d7c5ed8c755', 'request_id': 'req-1ee4b95c-668e-4148-91f2-e69c4399c7a5'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:33.308388 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-1ee4b95c-668e-4148-91f2-e69c4399c7a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c89661fd3d244289b4238d7c5ed8c755', 'request_id': 'req-1ee4b95c-668e-4148-91f2-e69c4399c7a5'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:33.337231 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-1ee4b95c-668e-4148-91f2-e69c4399c7a5 admin admin] The token cache is being invalidate because project c89661fd3d244289b4238d7c5ed8c755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:33.337751 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-1ee4b95c-668e-4148-91f2-e69c4399c7a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:33.339885 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-1ee4b95c-668e-4148-91f2-e69c4399c7a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:33.343008 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 890/1794] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:32 2022] DELETE /identity/v3/projects/c89661fd3d244289b4238d7c5ed8c755 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:52:33.344354 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ed3f2-d698-4e11-aa43-4c7b487745d5 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:33.344645 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ed3f2-d698-4e11-aa43-4c7b487745d5 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:33.344914 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ed3f2-d698-4e11-aa43-4c7b487745d5 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:33.357694 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 891/1795] 10.222.0.18 () {54 vars in 921 bytes} [Tue Mar 8 13:52:33 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:52:33.359176 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289aad20-ff2c-4a61-b27f-f7303e53b300 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:33.359466 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289aad20-ff2c-4a61-b27f-f7303e53b300 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:33.359749 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289aad20-ff2c-4a61-b27f-f7303e53b300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:33.404657 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-289aad20-ff2c-4a61-b27f-f7303e53b300 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:33.407294 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-289aad20-ff2c-4a61-b27f-f7303e53b300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:33.428410 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231285f7-7d21-4a20-b801-a76b2e2f9206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:33.429383 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231285f7-7d21-4a20-b801-a76b2e2f9206 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:33.429674 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231285f7-7d21-4a20-b801-a76b2e2f9206 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:33.430874 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231285f7-7d21-4a20-b801-a76b2e2f9206 admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:33.431625 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231285f7-7d21-4a20-b801-a76b2e2f9206 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:33.433076 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231285f7-7d21-4a20-b801-a76b2e2f9206 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:33.435675 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231285f7-7d21-4a20-b801-a76b2e2f9206 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:33.463277 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 905/1796] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:52:33.465241 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ce677-0de2-4cf3-953f-4862ab941812 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:33.465590 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ce677-0de2-4cf3-953f-4862ab941812 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:33.466763 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605ce677-0de2-4cf3-953f-4862ab941812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:33.517605 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-605ce677-0de2-4cf3-953f-4862ab941812 None None] MFA Rules not processed for user `21ec894123044d4382995791c74c587b`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:33.523152 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-605ce677-0de2-4cf3-953f-4862ab941812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:33.578219 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 892/1797] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:33.584088 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289aad20-ff2c-4a61-b27f-f7303e53b300 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:33.588233 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-289aad20-ff2c-4a61-b27f-f7303e53b300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:33.626858 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289aad20-ff2c-4a61-b27f-f7303e53b300 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:33.638401 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eff262-c56a-4b6c-89ce-efc0efd66f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:33.639216 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eff262-c56a-4b6c-89ce-efc0efd66f45 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:33.639543 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eff262-c56a-4b6c-89ce-efc0efd66f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:33.639885 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eff262-c56a-4b6c-89ce-efc0efd66f45 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:33.640677 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eff262-c56a-4b6c-89ce-efc0efd66f45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:33.644610 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eff262-c56a-4b6c-89ce-efc0efd66f45 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:33.703613 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 893/1798] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:33 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:33.706325 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b80d9-988d-47bd-a7ab-78567701882b None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:33.706717 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b80d9-988d-47bd-a7ab-78567701882b None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:33.707194 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851b80d9-988d-47bd-a7ab-78567701882b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:33.730756 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 906/1799] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Mar 8 13:52:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:33.731645 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ce677-0de2-4cf3-953f-4862ab941812 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:33.745326 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-851b80d9-988d-47bd-a7ab-78567701882b None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:33.746833 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-851b80d9-988d-47bd-a7ab-78567701882b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:33.749321 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605ce677-0de2-4cf3-953f-4862ab941812 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:33.863402 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 894/1800] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:33.864416 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b80d9-988d-47bd-a7ab-78567701882b None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:33.867443 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-851b80d9-988d-47bd-a7ab-78567701882b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:33.881998 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851b80d9-988d-47bd-a7ab-78567701882b None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:33.882665 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef6f4e-a1ba-4424-b08b-4e974783d8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:33.883400 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef6f4e-a1ba-4424-b08b-4e974783d8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:33.883849 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef6f4e-a1ba-4424-b08b-4e974783d8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:33.883950 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef6f4e-a1ba-4424-b08b-4e974783d8e1 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:33.884827 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef6f4e-a1ba-4424-b08b-4e974783d8e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:33.886941 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ef6f4e-a1ba-4424-b08b-4e974783d8e1 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:33.901333 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741198a4-49eb-4458-a6e2-23c48e197173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:33.902446 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741198a4-49eb-4458-a6e2-23c48e197173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:33.902859 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741198a4-49eb-4458-a6e2-23c48e197173 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:33.903201 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741198a4-49eb-4458-a6e2-23c48e197173 admin admin] PATH_INFO: `/v3/users/a7508cfdf3024e648acdde2e8ae80ec9` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:33.904615 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741198a4-49eb-4458-a6e2-23c48e197173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7508cfdf3024e648acdde2e8ae80ec9)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:33.906928 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741198a4-49eb-4458-a6e2-23c48e197173 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:33.946544 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 907/1801] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:33 2022] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:33.946544 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef6f4e-a1ba-4424-b08b-4e974783d8e1 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:33.958540 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef6f4e-a1ba-4424-b08b-4e974783d8e1 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:33.982848 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3ba6a-2ea9-484d-a36d-1e1d4e4e07fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:33.983868 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3ba6a-2ea9-484d-a36d-1e1d4e4e07fc admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:33.984151 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3ba6a-2ea9-484d-a36d-1e1d4e4e07fc admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:33.984712 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3ba6a-2ea9-484d-a36d-1e1d4e4e07fc admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:33.986560 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3ba6a-2ea9-484d-a36d-1e1d4e4e07fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:33.986895 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3ba6a-2ea9-484d-a36d-1e1d4e4e07fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:33.991936 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3ba6a-2ea9-484d-a36d-1e1d4e4e07fc admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:34.018462 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-741198a4-49eb-4458-a6e2-23c48e197173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7508cfdf3024e648acdde2e8ae80ec9'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:34.019320 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-741198a4-49eb-4458-a6e2-23c48e197173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7508cfdf3024e648acdde2e8ae80ec9'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:34.021287 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 908/1802] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:52:34.024907 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3ba6a-2ea9-484d-a36d-1e1d4e4e07fc admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:34.029123 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-16c3ba6a-2ea9-484d-a36d-1e1d4e4e07fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:34.035470 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-741198a4-49eb-4458-a6e2-23c48e197173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7508cfdf3024e648acdde2e8ae80ec9'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:34.061969 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-741198a4-49eb-4458-a6e2-23c48e197173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7508cfdf3024e648acdde2e8ae80ec9'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:34.064063 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3ba6a-2ea9-484d-a36d-1e1d4e4e07fc admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:34.072071 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-741198a4-49eb-4458-a6e2-23c48e197173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7508cfdf3024e648acdde2e8ae80ec9'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:34.072405 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53317508-43a8-4292-8a62-ad432c37c24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:34.073549 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53317508-43a8-4292-8a62-ad432c37c24c admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:34.073829 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53317508-43a8-4292-8a62-ad432c37c24c admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:34.074101 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53317508-43a8-4292-8a62-ad432c37c24c admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:34.075042 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53317508-43a8-4292-8a62-ad432c37c24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:34.082196 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 895/1803] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:33 2022] DELETE /identity/v3/users/a7508cfdf3024e648acdde2e8ae80ec9 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:34.087095 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741198a4-49eb-4458-a6e2-23c48e197173 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:34.088732 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-741198a4-49eb-4458-a6e2-23c48e197173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:34.090472 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53317508-43a8-4292-8a62-ad432c37c24c admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:34.122064 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 909/1804] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:34.123342 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53317508-43a8-4292-8a62-ad432c37c24c admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:34.126703 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-53317508-43a8-4292-8a62-ad432c37c24c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:34.167797 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53317508-43a8-4292-8a62-ad432c37c24c admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:34.185093 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741198a4-49eb-4458-a6e2-23c48e197173 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:34.193030 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffebe2-fe23-4069-a5d7-b9c74385f01c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:34.194691 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffebe2-fe23-4069-a5d7-b9c74385f01c service nova] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:34.195546 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffebe2-fe23-4069-a5d7-b9c74385f01c service nova] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:34.196994 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffebe2-fe23-4069-a5d7-b9c74385f01c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:34.203502 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-5cffebe2-fe23-4069-a5d7-b9c74385f01c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:34.240817 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffebe2-fe23-4069-a5d7-b9c74385f01c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:34.245694 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffebe2-fe23-4069-a5d7-b9c74385f01c service nova] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:34.270977 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 896/1805] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:34.281713 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce56e89-92d7-4b71-a2db-87e9c66117a9 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:34.283477 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce56e89-92d7-4b71-a2db-87e9c66117a9 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:34.283754 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce56e89-92d7-4b71-a2db-87e9c66117a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:34.326772 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-fce56e89-92d7-4b71-a2db-87e9c66117a9 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:34.331925 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-fce56e89-92d7-4b71-a2db-87e9c66117a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:34.334206 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb539216-df4b-4ccc-a4fd-ccc433ae412e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:34.334893 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb539216-df4b-4ccc-a4fd-ccc433ae412e admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:34.335225 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb539216-df4b-4ccc-a4fd-ccc433ae412e admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:34.335506 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb539216-df4b-4ccc-a4fd-ccc433ae412e admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:34.336210 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb539216-df4b-4ccc-a4fd-ccc433ae412e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:34.338753 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb539216-df4b-4ccc-a4fd-ccc433ae412e admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:34.361570 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 897/1806] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:34.364623 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce56e89-92d7-4b71-a2db-87e9c66117a9 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:34.388351 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce56e89-92d7-4b71-a2db-87e9c66117a9 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:34.396647 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe48353-2c65-4373-8dc0-47a7bd98e854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:34.397486 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe48353-2c65-4373-8dc0-47a7bd98e854 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:34.397916 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe48353-2c65-4373-8dc0-47a7bd98e854 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:34.398430 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe48353-2c65-4373-8dc0-47a7bd98e854 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:34.399209 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe48353-2c65-4373-8dc0-47a7bd98e854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:34.410087 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe48353-2c65-4373-8dc0-47a7bd98e854 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:34.412537 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 910/1807] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:34 2022] POST /identity/v3/projects => generated 381 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:34.414170 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb539216-df4b-4ccc-a4fd-ccc433ae412e admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:34.418175 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-bb539216-df4b-4ccc-a4fd-ccc433ae412e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:34.446230 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 898/1808] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:34.447210 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe48353-2c65-4373-8dc0-47a7bd98e854 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:34.463550 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe48353-2c65-4373-8dc0-47a7bd98e854 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:34.570196 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb539216-df4b-4ccc-a4fd-ccc433ae412e admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:34.581548 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b16fa-bb63-4b5c-9fdd-21eba9de3b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:34.582242 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b16fa-bb63-4b5c-9fdd-21eba9de3b1b service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:34.585077 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b16fa-bb63-4b5c-9fdd-21eba9de3b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:34.585386 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b16fa-bb63-4b5c-9fdd-21eba9de3b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:34.646359 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943b5fe-8e61-49ba-bc13-c969d3ae83be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:34.647699 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943b5fe-8e61-49ba-bc13-c969d3ae83be admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:34.649503 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943b5fe-8e61-49ba-bc13-c969d3ae83be admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:34.649503 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943b5fe-8e61-49ba-bc13-c969d3ae83be admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:34.649503 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943b5fe-8e61-49ba-bc13-c969d3ae83be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:34.651235 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943b5fe-8e61-49ba-bc13-c969d3ae83be admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:34.709323 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 899/1809] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:34 2022] POST /identity/v3/users => generated 291 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:34.710911 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943b5fe-8e61-49ba-bc13-c969d3ae83be admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:34.741180 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943b5fe-8e61-49ba-bc13-c969d3ae83be admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:34.741444 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b16fa-bb63-4b5c-9fdd-21eba9de3b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:34.742990 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b16fa-bb63-4b5c-9fdd-21eba9de3b1b service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:34.752240 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfac7c1-3cec-4886-86c3-af333fb2a2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:34.753701 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfac7c1-3cec-4886-86c3-af333fb2a2e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:34.754135 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfac7c1-3cec-4886-86c3-af333fb2a2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:34.754553 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfac7c1-3cec-4886-86c3-af333fb2a2e3 admin admin] PATH_INFO: `/v3/projects/8192f1c6c15a4696972f8816529ade17/users/a144e99fa4e8430ab1c904c5189542f0/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:34.773390 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 911/1810] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:34.778412 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfac7c1-3cec-4886-86c3-af333fb2a2e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8192f1c6c15a4696972f8816529ade17, user_id=a144e99fa4e8430ab1c904c5189542f0, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:34.779735 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b16fa-bb63-4b5c-9fdd-21eba9de3b1b service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:34.782944 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfac7c1-3cec-4886-86c3-af333fb2a2e3 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:34.808992 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b16fa-bb63-4b5c-9fdd-21eba9de3b1b service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:34.814923 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 900/1811] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:34 2022] PUT /identity/v3/projects/8192f1c6c15a4696972f8816529ade17/users/a144e99fa4e8430ab1c904c5189542f0/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:34.825965 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbf50d-6a6c-4d69-baed-b32dd3518ac8 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:34.826264 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbf50d-6a6c-4d69-baed-b32dd3518ac8 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:34.826511 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cbf50d-6a6c-4d69-baed-b32dd3518ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:34.896588 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-b4cbf50d-6a6c-4d69-baed-b32dd3518ac8 None None] MFA Rules not processed for user `a144e99fa4e8430ab1c904c5189542f0`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:34.897791 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b7bd2-fc07-496d-92ec-2ae2b00e6fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:34.898569 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b7bd2-fc07-496d-92ec-2ae2b00e6fbe admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:34.898689 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-b4cbf50d-6a6c-4d69-baed-b32dd3518ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:34.899373 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b7bd2-fc07-496d-92ec-2ae2b00e6fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:34.899660 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b7bd2-fc07-496d-92ec-2ae2b00e6fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:34.900632 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b7bd2-fc07-496d-92ec-2ae2b00e6fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:34.903915 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b7bd2-fc07-496d-92ec-2ae2b00e6fbe admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:34.917061 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 912/1812] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:34.921945 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b7bd2-fc07-496d-92ec-2ae2b00e6fbe admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:34.936532 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b7bd2-fc07-496d-92ec-2ae2b00e6fbe admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:34.948471 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f30c4-b6f1-4a10-90f8-ddbb9e12c381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:34.949230 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f30c4-b6f1-4a10-90f8-ddbb9e12c381 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:34.949850 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f30c4-b6f1-4a10-90f8-ddbb9e12c381 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:34.950134 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f30c4-b6f1-4a10-90f8-ddbb9e12c381 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:34.950938 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f30c4-b6f1-4a10-90f8-ddbb9e12c381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:34.953939 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f30c4-b6f1-4a10-90f8-ddbb9e12c381 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:34.974024 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 913/1813] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:34.976332 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f30c4-b6f1-4a10-90f8-ddbb9e12c381 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:34.997178 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 901/1814] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:34.998227 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbf50d-6a6c-4d69-baed-b32dd3518ac8 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:35.001898 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f30c4-b6f1-4a10-90f8-ddbb9e12c381 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:35.025298 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853eb1c8-d31d-4e72-b332-28d50e543702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:35.026229 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cbf50d-6a6c-4d69-baed-b32dd3518ac8 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:35.027735 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eb1c8-d31d-4e72-b332-28d50e543702 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:35.029147 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eb1c8-d31d-4e72-b332-28d50e543702 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:35.030005 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eb1c8-d31d-4e72-b332-28d50e543702 admin admin] PATH_INFO: `/v3/projects/ae48665497d04b1797a8e2503fefe0d5/users/b4191a256b224cf79abb2f6334741352/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:35.038869 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76776825-a51b-45b4-b18e-b55ab0cfa105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:35.039553 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76776825-a51b-45b4-b18e-b55ab0cfa105 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:35.040088 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76776825-a51b-45b4-b18e-b55ab0cfa105 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:35.040258 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76776825-a51b-45b4-b18e-b55ab0cfa105 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:35.041015 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76776825-a51b-45b4-b18e-b55ab0cfa105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:35.043451 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76776825-a51b-45b4-b18e-b55ab0cfa105 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:35.094287 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853eb1c8-d31d-4e72-b332-28d50e543702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae48665497d04b1797a8e2503fefe0d5, user_id=b4191a256b224cf79abb2f6334741352, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:35.101590 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853eb1c8-d31d-4e72-b332-28d50e543702 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:35.111540 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 902/1815] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:34 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:35.114254 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76776825-a51b-45b4-b18e-b55ab0cfa105 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:35.142424 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 914/1816] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:34 2022] PUT /identity/v3/projects/ae48665497d04b1797a8e2503fefe0d5/users/b4191a256b224cf79abb2f6334741352/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:35.159377 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b332bb-3e9d-4c54-a82c-a98569887709 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:35.159801 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b332bb-3e9d-4c54-a82c-a98569887709 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:35.160144 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b332bb-3e9d-4c54-a82c-a98569887709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:35.214706 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-01b332bb-3e9d-4c54-a82c-a98569887709 None None] MFA Rules not processed for user `b4191a256b224cf79abb2f6334741352`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:35.228346 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-01b332bb-3e9d-4c54-a82c-a98569887709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:35.323300 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76776825-a51b-45b4-b18e-b55ab0cfa105 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:35.395544 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 915/1817] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:35.401181 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b332bb-3e9d-4c54-a82c-a98569887709 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:35.417288 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82b5ec-76a7-4e42-a784-f5549da67b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:35.421661 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82b5ec-76a7-4e42-a784-f5549da67b14 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:35.422295 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82b5ec-76a7-4e42-a784-f5549da67b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:35.422582 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82b5ec-76a7-4e42-a784-f5549da67b14 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:35.424531 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82b5ec-76a7-4e42-a784-f5549da67b14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:35.427656 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82b5ec-76a7-4e42-a784-f5549da67b14 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:35.472745 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 903/1818] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:35 2022] POST /identity/v3/users => generated 296 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:35.478063 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82b5ec-76a7-4e42-a784-f5549da67b14 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:35.503589 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82b5ec-76a7-4e42-a784-f5549da67b14 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:35.504801 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b332bb-3e9d-4c54-a82c-a98569887709 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:35.514721 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe24781-56d6-40fb-b482-7f48f07928eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:35.517062 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe24781-56d6-40fb-b482-7f48f07928eb admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:35.517363 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe24781-56d6-40fb-b482-7f48f07928eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:35.517647 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe24781-56d6-40fb-b482-7f48f07928eb admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:35.518464 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87e9b4-d3b3-4980-b0ce-92cbe2b6502b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:35.519148 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87e9b4-d3b3-4980-b0ce-92cbe2b6502b admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:35.519422 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87e9b4-d3b3-4980-b0ce-92cbe2b6502b admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:35.519743 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87e9b4-d3b3-4980-b0ce-92cbe2b6502b admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:35.520214 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe24781-56d6-40fb-b482-7f48f07928eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:35.521758 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87e9b4-d3b3-4980-b0ce-92cbe2b6502b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:35.523175 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe24781-56d6-40fb-b482-7f48f07928eb admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:35.526790 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87e9b4-d3b3-4980-b0ce-92cbe2b6502b admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:35.549059 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 904/1819] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:35.552440 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe24781-56d6-40fb-b482-7f48f07928eb admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:35.582059 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe24781-56d6-40fb-b482-7f48f07928eb admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:35.599507 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 916/1820] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:35 2022] POST /identity/v3/projects => generated 379 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:35.601184 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87e9b4-d3b3-4980-b0ce-92cbe2b6502b admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:35.607588 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b52d80-6ea9-4837-b5ae-6f5e46aeb510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:35.608657 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b52d80-6ea9-4837-b5ae-6f5e46aeb510 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:35.608935 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b52d80-6ea9-4837-b5ae-6f5e46aeb510 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:35.609202 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b52d80-6ea9-4837-b5ae-6f5e46aeb510 admin admin] PATH_INFO: `/v3/projects/9bab319ea8f5463195a5f9bf04e7202c/users/7a2b3060c53846ff803e1bc5bef0ce97/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:35.647271 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b52d80-6ea9-4837-b5ae-6f5e46aeb510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bab319ea8f5463195a5f9bf04e7202c, user_id=7a2b3060c53846ff803e1bc5bef0ce97, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:35.650013 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b52d80-6ea9-4837-b5ae-6f5e46aeb510 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:35.687911 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 905/1821] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:35 2022] PUT /identity/v3/projects/9bab319ea8f5463195a5f9bf04e7202c/users/7a2b3060c53846ff803e1bc5bef0ce97/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:35.687911 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b52d80-6ea9-4837-b5ae-6f5e46aeb510 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:35.718126 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87e9b4-d3b3-4980-b0ce-92cbe2b6502b admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:35.789873 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b52d80-6ea9-4837-b5ae-6f5e46aeb510 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:35.804207 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed68658-fe2e-496b-a054-a869dc4d0a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:35.804207 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed68658-fe2e-496b-a054-a869dc4d0a21 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:35.804207 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed68658-fe2e-496b-a054-a869dc4d0a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:35.804207 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed68658-fe2e-496b-a054-a869dc4d0a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:35.804960 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed68658-fe2e-496b-a054-a869dc4d0a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:35.809592 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed68658-fe2e-496b-a054-a869dc4d0a21 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:35.832593 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 906/1822] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:35.841126 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed68658-fe2e-496b-a054-a869dc4d0a21 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:35.864635 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed68658-fe2e-496b-a054-a869dc4d0a21 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:35.870218 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0501472-4bc4-4df7-94f2-7e097ab6fa59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:35.871151 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a247fa8-6225-4e0d-9271-ab3ed44ff590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:35.871625 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0501472-4bc4-4df7-94f2-7e097ab6fa59 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:35.871625 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0501472-4bc4-4df7-94f2-7e097ab6fa59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:35.871876 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0501472-4bc4-4df7-94f2-7e097ab6fa59 admin admin] PATH_INFO: `/v3/projects/9bab319ea8f5463195a5f9bf04e7202c/users/7a2b3060c53846ff803e1bc5bef0ce97/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:35.872751 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a247fa8-6225-4e0d-9271-ab3ed44ff590 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:35.873331 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a247fa8-6225-4e0d-9271-ab3ed44ff590 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:35.873713 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a247fa8-6225-4e0d-9271-ab3ed44ff590 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:35.874518 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a247fa8-6225-4e0d-9271-ab3ed44ff590 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:35.882444 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0501472-4bc4-4df7-94f2-7e097ab6fa59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bab319ea8f5463195a5f9bf04e7202c, user_id=7a2b3060c53846ff803e1bc5bef0ce97, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:35.885056 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0501472-4bc4-4df7-94f2-7e097ab6fa59 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:35.885688 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a247fa8-6225-4e0d-9271-ab3ed44ff590 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:35.908021 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 907/1823] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:35 2022] PUT /identity/v3/projects/9bab319ea8f5463195a5f9bf04e7202c/users/7a2b3060c53846ff803e1bc5bef0ce97/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:35.909596 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76567975-0e62-459c-bb49-a07537a44844 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:35.909928 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76567975-0e62-459c-bb49-a07537a44844 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:35.910199 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76567975-0e62-459c-bb49-a07537a44844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:35.956466 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-76567975-0e62-459c-bb49-a07537a44844 None None] MFA Rules not processed for user `7a2b3060c53846ff803e1bc5bef0ce97`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:35.958400 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-76567975-0e62-459c-bb49-a07537a44844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:35.964188 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 917/1824] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:35 2022] POST /identity/v3/users => generated 296 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:35.977180 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a247fa8-6225-4e0d-9271-ab3ed44ff590 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:36.016100 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a247fa8-6225-4e0d-9271-ab3ed44ff590 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:36.088103 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 908/1825] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:36.101711 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76567975-0e62-459c-bb49-a07537a44844 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:36.103329 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-76567975-0e62-459c-bb49-a07537a44844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:36.167964 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76567975-0e62-459c-bb49-a07537a44844 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:36.171934 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a0854-1617-4803-8845-86bf372aea38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:36.173475 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a0854-1617-4803-8845-86bf372aea38 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:36.174110 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a0854-1617-4803-8845-86bf372aea38 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:36.174284 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9a0854-1617-4803-8845-86bf372aea38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:36.181635 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22fc5b-9577-4565-81f1-10ba0d14eb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:36.182473 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22fc5b-9577-4565-81f1-10ba0d14eb31 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:36.182764 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22fc5b-9577-4565-81f1-10ba0d14eb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:36.183043 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22fc5b-9577-4565-81f1-10ba0d14eb31 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:36.183785 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22fc5b-9577-4565-81f1-10ba0d14eb31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:36.185432 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22fc5b-9577-4565-81f1-10ba0d14eb31 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:36.186022 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a0854-1617-4803-8845-86bf372aea38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:36.187556 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9a0854-1617-4803-8845-86bf372aea38 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:36.200428 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 909/1826] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:36.206281 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 918/1827] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:36.212262 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a0854-1617-4803-8845-86bf372aea38 service cinder] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:36.234975 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9a0854-1617-4803-8845-86bf372aea38 service cinder] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:36.247086 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db397078-022d-4bca-860f-b6888a5b7bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:36.250681 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db397078-022d-4bca-860f-b6888a5b7bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:36.250879 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db397078-022d-4bca-860f-b6888a5b7bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:36.251165 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db397078-022d-4bca-860f-b6888a5b7bb3 admin admin] PATH_INFO: `/v3/projects/6a5c3257ba0b40e7b64e0fd552395634/users/ddeab7826f8c43769811a5c7ced60124/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:36.290166 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db397078-022d-4bca-860f-b6888a5b7bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a5c3257ba0b40e7b64e0fd552395634, user_id=ddeab7826f8c43769811a5c7ced60124, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:36.295825 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db397078-022d-4bca-860f-b6888a5b7bb3 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:36.334761 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 910/1828] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:36 2022] PUT /identity/v3/projects/6a5c3257ba0b40e7b64e0fd552395634/users/ddeab7826f8c43769811a5c7ced60124/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:36.335382 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22fc5b-9577-4565-81f1-10ba0d14eb31 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:36.352328 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22fc5b-9577-4565-81f1-10ba0d14eb31 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:36.523302 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c71eb-31ce-4a4e-93ae-76ca8c6cdcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:36.524041 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c71eb-31ce-4a4e-93ae-76ca8c6cdcbf admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:36.524695 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c71eb-31ce-4a4e-93ae-76ca8c6cdcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:36.524979 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c71eb-31ce-4a4e-93ae-76ca8c6cdcbf admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:36.526153 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c71eb-31ce-4a4e-93ae-76ca8c6cdcbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:36.528482 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c71eb-31ce-4a4e-93ae-76ca8c6cdcbf admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:36.549654 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db397078-022d-4bca-860f-b6888a5b7bb3 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:36.557144 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 919/1829] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:36.563066 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db397078-022d-4bca-860f-b6888a5b7bb3 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:36.576085 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b074aa-1e4c-413f-a384-a22bf5c6ed44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:36.577320 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b074aa-1e4c-413f-a384-a22bf5c6ed44 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:36.577713 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b074aa-1e4c-413f-a384-a22bf5c6ed44 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:36.578075 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b074aa-1e4c-413f-a384-a22bf5c6ed44 admin admin] PATH_INFO: `/v3/projects/6a5c3257ba0b40e7b64e0fd552395634/users/ddeab7826f8c43769811a5c7ced60124/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:36.581924 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b074aa-1e4c-413f-a384-a22bf5c6ed44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a5c3257ba0b40e7b64e0fd552395634, user_id=ddeab7826f8c43769811a5c7ced60124, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:36.599158 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b074aa-1e4c-413f-a384-a22bf5c6ed44 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:36.650505 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 911/1830] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:36 2022] PUT /identity/v3/projects/6a5c3257ba0b40e7b64e0fd552395634/users/ddeab7826f8c43769811a5c7ced60124/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:36.663915 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b87e8-8151-4432-8695-21e0116c7fd8 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:36.664343 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b87e8-8151-4432-8695-21e0116c7fd8 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:36.664762 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b87e8-8151-4432-8695-21e0116c7fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:36.733994 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-270b87e8-8151-4432-8695-21e0116c7fd8 None None] MFA Rules not processed for user `ddeab7826f8c43769811a5c7ced60124`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:36.735699 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-270b87e8-8151-4432-8695-21e0116c7fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:36.865456 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b074aa-1e4c-413f-a384-a22bf5c6ed44 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:36.937669 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 920/1831] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:36.954550 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b87e8-8151-4432-8695-21e0116c7fd8 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:36.958783 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-270b87e8-8151-4432-8695-21e0116c7fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:37.061103 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b074aa-1e4c-413f-a384-a22bf5c6ed44 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:37.075435 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef88297-d432-487d-8fd0-4794a65148bd tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a2b3060c53846ff803e1bc5bef0ce97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bab319ea8f5463195a5f9bf04e7202c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:37.076721 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef88297-d432-487d-8fd0-4794a65148bd tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:37.077019 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef88297-d432-487d-8fd0-4794a65148bd tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:37.078455 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef88297-d432-487d-8fd0-4794a65148bd tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:37.079222 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef88297-d432-487d-8fd0-4794a65148bd tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:37.079536 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef88297-d432-487d-8fd0-4794a65148bd tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:37.085086 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef88297-d432-487d-8fd0-4794a65148bd tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:37.095861 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b87e8-8151-4432-8695-21e0116c7fd8 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:37.105419 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaadaaf-2c91-4b0a-b001-9750d558c6a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:37.106336 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaadaaf-2c91-4b0a-b001-9750d558c6a8 service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:37.106629 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaadaaf-2c91-4b0a-b001-9750d558c6a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:37.107056 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaadaaf-2c91-4b0a-b001-9750d558c6a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:37.111277 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 912/1832] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:52:37.112782 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef88297-d432-487d-8fd0-4794a65148bd tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:37.118609 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-9ef88297-d432-487d-8fd0-4794a65148bd tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:37.121455 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaadaaf-2c91-4b0a-b001-9750d558c6a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:37.124015 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaadaaf-2c91-4b0a-b001-9750d558c6a8 service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:37.165552 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 921/1833] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:36 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:52:37.167041 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaadaaf-2c91-4b0a-b001-9750d558c6a8 service cinder] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:37.188554 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaadaaf-2c91-4b0a-b001-9750d558c6a8 service cinder] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:37.201858 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb5917-3e9b-46e1-ae86-ead23ee6bea4 tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a2b3060c53846ff803e1bc5bef0ce97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bab319ea8f5463195a5f9bf04e7202c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:37.202560 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb5917-3e9b-46e1-ae86-ead23ee6bea4 tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:37.202853 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb5917-3e9b-46e1-ae86-ead23ee6bea4 tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:37.203136 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabb5917-3e9b-46e1-ae86-ead23ee6bea4 tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:37.203974 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb5917-3e9b-46e1-ae86-ead23ee6bea4 tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:37.206585 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabb5917-3e9b-46e1-ae86-ead23ee6bea4 tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:37.241634 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef88297-d432-487d-8fd0-4794a65148bd tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:37.266548 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f19b41-bb93-4b5b-8cc1-c4adf24a3a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:37.269054 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f19b41-bb93-4b5b-8cc1-c4adf24a3a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:37.272469 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f19b41-bb93-4b5b-8cc1-c4adf24a3a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:37.273496 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 922/1834] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:37 2022] POST /identity/v3/projects => generated 355 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:37.274847 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f19b41-bb93-4b5b-8cc1-c4adf24a3a16 admin admin] PATH_INFO: `/v3/projects/15a61a2f33714e8da0baeff23ce5023a` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:37.278287 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb5917-3e9b-46e1-ae86-ead23ee6bea4 tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:37.297695 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f19b41-bb93-4b5b-8cc1-c4adf24a3a16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a61a2f33714e8da0baeff23ce5023a)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:37.297695 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f19b41-bb93-4b5b-8cc1-c4adf24a3a16 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:37.414296 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-30f19b41-bb93-4b5b-8cc1-c4adf24a3a16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a61a2f33714e8da0baeff23ce5023a', 'request_id': 'req-30f19b41-bb93-4b5b-8cc1-c4adf24a3a16'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:37.430168 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-30f19b41-bb93-4b5b-8cc1-c4adf24a3a16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a61a2f33714e8da0baeff23ce5023a', 'request_id': 'req-30f19b41-bb93-4b5b-8cc1-c4adf24a3a16'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:37.438206 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabb5917-3e9b-46e1-ae86-ead23ee6bea4 tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:37.452006 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-30f19b41-bb93-4b5b-8cc1-c4adf24a3a16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a61a2f33714e8da0baeff23ce5023a', 'request_id': 'req-30f19b41-bb93-4b5b-8cc1-c4adf24a3a16'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:37.491896 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-30f19b41-bb93-4b5b-8cc1-c4adf24a3a16 admin admin] The token cache is being invalidate because project 15a61a2f33714e8da0baeff23ce5023a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:37.491896 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-30f19b41-bb93-4b5b-8cc1-c4adf24a3a16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:37.492169 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-30f19b41-bb93-4b5b-8cc1-c4adf24a3a16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:37.494183 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 913/1835] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:37 2022] DELETE /identity/v3/projects/15a61a2f33714e8da0baeff23ce5023a => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:37.505903 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f19b41-bb93-4b5b-8cc1-c4adf24a3a16 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:37.516493 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-30f19b41-bb93-4b5b-8cc1-c4adf24a3a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:37.643610 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b0759-667e-4df8-af7b-2ff0358d026c tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a2b3060c53846ff803e1bc5bef0ce97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bab319ea8f5463195a5f9bf04e7202c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:37.644658 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b0759-667e-4df8-af7b-2ff0358d026c tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:37.646066 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b0759-667e-4df8-af7b-2ff0358d026c tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:37.646565 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b0759-667e-4df8-af7b-2ff0358d026c tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:37.647987 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b0759-667e-4df8-af7b-2ff0358d026c tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:37.651020 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b0759-667e-4df8-af7b-2ff0358d026c tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:37.659617 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99b0759-667e-4df8-af7b-2ff0358d026c tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:37.684029 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f19b41-bb93-4b5b-8cc1-c4adf24a3a16 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:37.691678 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fba99-8d29-4127-8d06-3d35a8c241eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:37.692943 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fba99-8d29-4127-8d06-3d35a8c241eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:37.693412 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fba99-8d29-4127-8d06-3d35a8c241eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:37.694164 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fba99-8d29-4127-8d06-3d35a8c241eb admin admin] PATH_INFO: `/v3/users/ecfefdbcd1ff4972bf77de20507aaeea` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:37.695798 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261fba99-8d29-4127-8d06-3d35a8c241eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecfefdbcd1ff4972bf77de20507aaeea)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:37.702139 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 923/1836] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:52:37.703362 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261fba99-8d29-4127-8d06-3d35a8c241eb admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:37.774205 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b0759-667e-4df8-af7b-2ff0358d026c tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:37.781455 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-f99b0759-667e-4df8-af7b-2ff0358d026c tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:37.836471 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99b0759-667e-4df8-af7b-2ff0358d026c tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:37.854189 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-261fba99-8d29-4127-8d06-3d35a8c241eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecfefdbcd1ff4972bf77de20507aaeea'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:37.858396 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-261fba99-8d29-4127-8d06-3d35a8c241eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecfefdbcd1ff4972bf77de20507aaeea'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:37.865493 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5481630-c550-4251-8096-4b8bf3cc99f4 tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a2b3060c53846ff803e1bc5bef0ce97', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bab319ea8f5463195a5f9bf04e7202c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:37.866602 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5481630-c550-4251-8096-4b8bf3cc99f4 tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:37.867182 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5481630-c550-4251-8096-4b8bf3cc99f4 tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:37.868556 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5481630-c550-4251-8096-4b8bf3cc99f4 tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] PATH_INFO: `/v3/projects/d712b8e5a37e46c39a9ca21bf7732a75` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:37.873319 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5481630-c550-4251-8096-4b8bf3cc99f4 tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d712b8e5a37e46c39a9ca21bf7732a75)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:37.878842 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-261fba99-8d29-4127-8d06-3d35a8c241eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecfefdbcd1ff4972bf77de20507aaeea'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:37.880874 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5481630-c550-4251-8096-4b8bf3cc99f4 tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:37.912748 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-261fba99-8d29-4127-8d06-3d35a8c241eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecfefdbcd1ff4972bf77de20507aaeea'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:37.945873 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-261fba99-8d29-4127-8d06-3d35a8c241eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecfefdbcd1ff4972bf77de20507aaeea'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:37.967552 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 914/1837] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:37 2022] DELETE /identity/v3/users/ecfefdbcd1ff4972bf77de20507aaeea => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:38.031963 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-f5481630-c550-4251-8096-4b8bf3cc99f4 tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd712b8e5a37e46c39a9ca21bf7732a75', 'request_id': 'req-f5481630-c550-4251-8096-4b8bf3cc99f4'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:38.058889 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-f5481630-c550-4251-8096-4b8bf3cc99f4 tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd712b8e5a37e46c39a9ca21bf7732a75', 'request_id': 'req-f5481630-c550-4251-8096-4b8bf3cc99f4'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:38.075305 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-f5481630-c550-4251-8096-4b8bf3cc99f4 tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd712b8e5a37e46c39a9ca21bf7732a75', 'request_id': 'req-f5481630-c550-4251-8096-4b8bf3cc99f4'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:38.093826 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-f5481630-c550-4251-8096-4b8bf3cc99f4 tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] The token cache is being invalidate because project d712b8e5a37e46c39a9ca21bf7732a75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:38.094546 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-f5481630-c550-4251-8096-4b8bf3cc99f4 tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:38.095910 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-f5481630-c550-4251-8096-4b8bf3cc99f4 tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:38.099676 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 924/1838] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:37 2022] DELETE /identity/v3/projects/d712b8e5a37e46c39a9ca21bf7732a75 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:38.185308 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fba99-8d29-4127-8d06-3d35a8c241eb admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:38.187013 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-261fba99-8d29-4127-8d06-3d35a8c241eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:38.304445 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fba99-8d29-4127-8d06-3d35a8c241eb admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:38.430545 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ac876-2966-4013-960c-eed3b061a0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:38.431385 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ac876-2966-4013-960c-eed3b061a0d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:38.431663 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ac876-2966-4013-960c-eed3b061a0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:38.431969 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ac876-2966-4013-960c-eed3b061a0d3 admin admin] PATH_INFO: `/v3/users/b4191a256b224cf79abb2f6334741352` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:38.440754 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ac876-2966-4013-960c-eed3b061a0d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4191a256b224cf79abb2f6334741352)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:38.443889 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ac876-2966-4013-960c-eed3b061a0d3 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:38.464040 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5481630-c550-4251-8096-4b8bf3cc99f4 tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:38.465716 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-f5481630-c550-4251-8096-4b8bf3cc99f4 tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:38.490763 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5481630-c550-4251-8096-4b8bf3cc99f4 tempest-VolumeQuotaClassesTest-778788201 tempest-VolumeQuotaClassesTest-778788201-project-admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:38.507095 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a0a15-80eb-47a9-a5d0-ebc581ce99a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:38.514146 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a0a15-80eb-47a9-a5d0-ebc581ce99a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:38.514462 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a0a15-80eb-47a9-a5d0-ebc581ce99a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:38.514822 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0a0a15-80eb-47a9-a5d0-ebc581ce99a0 admin admin] PATH_INFO: `/v3/users/a144e99fa4e8430ab1c904c5189542f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:38.519267 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a0a15-80eb-47a9-a5d0-ebc581ce99a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a144e99fa4e8430ab1c904c5189542f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:38.523667 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0a0a15-80eb-47a9-a5d0-ebc581ce99a0 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:38.528353 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-7c5ac876-2966-4013-960c-eed3b061a0d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4191a256b224cf79abb2f6334741352'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:38.530531 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-7c5ac876-2966-4013-960c-eed3b061a0d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4191a256b224cf79abb2f6334741352'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:38.558531 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-7c5ac876-2966-4013-960c-eed3b061a0d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4191a256b224cf79abb2f6334741352'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:38.581242 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-7c5ac876-2966-4013-960c-eed3b061a0d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4191a256b224cf79abb2f6334741352'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:38.591886 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-7c5ac876-2966-4013-960c-eed3b061a0d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4191a256b224cf79abb2f6334741352'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:38.606284 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 915/1839] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:38 2022] DELETE /identity/v3/users/b4191a256b224cf79abb2f6334741352 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:38.610884 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012e228-912f-489a-b1e6-7172d12a94f0 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:38.611079 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012e228-912f-489a-b1e6-7172d12a94f0 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:38.611553 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012e228-912f-489a-b1e6-7172d12a94f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:38.632992 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-7012e228-912f-489a-b1e6-7172d12a94f0 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:38.634458 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-7012e228-912f-489a-b1e6-7172d12a94f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:38.639551 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-1c0a0a15-80eb-47a9-a5d0-ebc581ce99a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a144e99fa4e8430ab1c904c5189542f0'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:38.641183 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-1c0a0a15-80eb-47a9-a5d0-ebc581ce99a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a144e99fa4e8430ab1c904c5189542f0'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:38.662684 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-1c0a0a15-80eb-47a9-a5d0-ebc581ce99a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a144e99fa4e8430ab1c904c5189542f0'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:38.674986 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-1c0a0a15-80eb-47a9-a5d0-ebc581ce99a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a144e99fa4e8430ab1c904c5189542f0'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:38.702188 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-1c0a0a15-80eb-47a9-a5d0-ebc581ce99a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a144e99fa4e8430ab1c904c5189542f0'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:38.712616 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 916/1840] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:38.715599 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 925/1841] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:38 2022] DELETE /identity/v3/users/a144e99fa4e8430ab1c904c5189542f0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:52:38.720063 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ac342-fff1-4a67-9e5c-6bc8b277e328 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:38.720360 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ac342-fff1-4a67-9e5c-6bc8b277e328 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:38.720633 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ac342-fff1-4a67-9e5c-6bc8b277e328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:38.736710 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a0a15-80eb-47a9-a5d0-ebc581ce99a0 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:38.739280 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-1c0a0a15-80eb-47a9-a5d0-ebc581ce99a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:38.757465 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-d63ac342-fff1-4a67-9e5c-6bc8b277e328 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:38.761812 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-d63ac342-fff1-4a67-9e5c-6bc8b277e328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:38.830983 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0a0a15-80eb-47a9-a5d0-ebc581ce99a0 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:38.835061 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c3a9a-53a6-4c01-ae29-45bc95822f1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:38.836265 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c3a9a-53a6-4c01-ae29-45bc95822f1f service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:38.837855 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c3a9a-53a6-4c01-ae29-45bc95822f1f service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:38.837855 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c3a9a-53a6-4c01-ae29-45bc95822f1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:38.848272 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 917/1842] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:38.850440 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c3a9a-53a6-4c01-ae29-45bc95822f1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:38.850440 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590c3a9a-53a6-4c01-ae29-45bc95822f1f service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:38.859848 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ac342-fff1-4a67-9e5c-6bc8b277e328 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:38.862150 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 926/1843] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:52:38.879047 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ac342-fff1-4a67-9e5c-6bc8b277e328 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:38.884640 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a910759-c132-449f-ad9d-ee171d5d9deb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:38.885422 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a910759-c132-449f-ad9d-ee171d5d9deb service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:38.885773 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a910759-c132-449f-ad9d-ee171d5d9deb service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:38.886217 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a910759-c132-449f-ad9d-ee171d5d9deb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:38.902482 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a910759-c132-449f-ad9d-ee171d5d9deb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:38.904267 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a910759-c132-449f-ad9d-ee171d5d9deb service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:38.915417 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 918/1844] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:52:39.132629 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c3a9a-53a6-4c01-ae29-45bc95822f1f service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:39.132629 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-590c3a9a-53a6-4c01-ae29-45bc95822f1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:39.144114 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c3a9a-53a6-4c01-ae29-45bc95822f1f service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:39.148847 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f7ebc-405c-4545-9663-59ac6ac17a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:39.149815 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f7ebc-405c-4545-9663-59ac6ac17a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:39.150094 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f7ebc-405c-4545-9663-59ac6ac17a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:39.150363 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f7ebc-405c-4545-9663-59ac6ac17a93 admin admin] PATH_INFO: `/v3/projects/40517c0ca6844ce2a007141e9f6dac2c` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:39.162164 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f7ebc-405c-4545-9663-59ac6ac17a93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40517c0ca6844ce2a007141e9f6dac2c)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:39.165378 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f7ebc-405c-4545-9663-59ac6ac17a93 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:39.247977 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-eb2f7ebc-405c-4545-9663-59ac6ac17a93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40517c0ca6844ce2a007141e9f6dac2c', 'request_id': 'req-eb2f7ebc-405c-4545-9663-59ac6ac17a93'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:39.269873 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-eb2f7ebc-405c-4545-9663-59ac6ac17a93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40517c0ca6844ce2a007141e9f6dac2c', 'request_id': 'req-eb2f7ebc-405c-4545-9663-59ac6ac17a93'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:39.297929 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-eb2f7ebc-405c-4545-9663-59ac6ac17a93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40517c0ca6844ce2a007141e9f6dac2c', 'request_id': 'req-eb2f7ebc-405c-4545-9663-59ac6ac17a93'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:39.341467 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-eb2f7ebc-405c-4545-9663-59ac6ac17a93 admin admin] The token cache is being invalidate because project 40517c0ca6844ce2a007141e9f6dac2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:39.341761 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-eb2f7ebc-405c-4545-9663-59ac6ac17a93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:39.342848 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-eb2f7ebc-405c-4545-9663-59ac6ac17a93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:39.349778 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 927/1845] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:39 2022] DELETE /identity/v3/projects/40517c0ca6844ce2a007141e9f6dac2c => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:39.355967 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d3cd6-ab04-4d0f-a54e-05849a57bb71 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:39.356391 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d3cd6-ab04-4d0f-a54e-05849a57bb71 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:39.358325 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d3cd6-ab04-4d0f-a54e-05849a57bb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:39.386175 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-198d3cd6-ab04-4d0f-a54e-05849a57bb71 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:39.388760 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-198d3cd6-ab04-4d0f-a54e-05849a57bb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:39.504428 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f7ebc-405c-4545-9663-59ac6ac17a93 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:39.506264 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-eb2f7ebc-405c-4545-9663-59ac6ac17a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:39.570390 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 919/1846] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:39.579900 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69e530-dc2d-4513-ab3d-627d35204e8c None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:39.580327 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69e530-dc2d-4513-ab3d-627d35204e8c None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:39.581347 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d69e530-dc2d-4513-ab3d-627d35204e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:39.608270 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-3d69e530-dc2d-4513-ab3d-627d35204e8c None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:39.610156 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-3d69e530-dc2d-4513-ab3d-627d35204e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:39.621023 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 920/1847] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:39.626887 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69e530-dc2d-4513-ab3d-627d35204e8c None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:39.641006 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d69e530-dc2d-4513-ab3d-627d35204e8c None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:39.650614 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f85199-f00f-4033-8ba9-d8f96f30ef90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:39.652500 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f85199-f00f-4033-8ba9-d8f96f30ef90 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:39.652768 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f85199-f00f-4033-8ba9-d8f96f30ef90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:39.654160 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f85199-f00f-4033-8ba9-d8f96f30ef90 admin admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:39.654971 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f85199-f00f-4033-8ba9-d8f96f30ef90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:39.656178 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f85199-f00f-4033-8ba9-d8f96f30ef90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:39.661534 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f85199-f00f-4033-8ba9-d8f96f30ef90 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:39.667988 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f7ebc-405c-4545-9663-59ac6ac17a93 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:39.681503 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fae8b2-52d9-41f5-a974-99a3fefc6bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:39.682391 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fae8b2-52d9-41f5-a974-99a3fefc6bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:39.682665 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fae8b2-52d9-41f5-a974-99a3fefc6bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:39.683233 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fae8b2-52d9-41f5-a974-99a3fefc6bf1 admin admin] PATH_INFO: `/v3/projects/ae48665497d04b1797a8e2503fefe0d5` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:39.686330 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fae8b2-52d9-41f5-a974-99a3fefc6bf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae48665497d04b1797a8e2503fefe0d5)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:39.688370 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fae8b2-52d9-41f5-a974-99a3fefc6bf1 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:39.692197 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 921/1848] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:52:39.693214 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f85199-f00f-4033-8ba9-d8f96f30ef90 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:39.721462 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f85199-f00f-4033-8ba9-d8f96f30ef90 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:39.733830 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e14e01-6476-4f93-94e3-79048a572603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:39.734513 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e14e01-6476-4f93-94e3-79048a572603 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:39.735701 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e14e01-6476-4f93-94e3-79048a572603 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:39.736065 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e14e01-6476-4f93-94e3-79048a572603 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:39.737141 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e14e01-6476-4f93-94e3-79048a572603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:39.739293 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e14e01-6476-4f93-94e3-79048a572603 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:39.816506 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 922/1849] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:39 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:39.817549 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e14e01-6476-4f93-94e3-79048a572603 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:39.823345 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-50fae8b2-52d9-41f5-a974-99a3fefc6bf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae48665497d04b1797a8e2503fefe0d5', 'request_id': 'req-50fae8b2-52d9-41f5-a974-99a3fefc6bf1'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:39.837274 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-50fae8b2-52d9-41f5-a974-99a3fefc6bf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae48665497d04b1797a8e2503fefe0d5', 'request_id': 'req-50fae8b2-52d9-41f5-a974-99a3fefc6bf1'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:39.856859 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-50fae8b2-52d9-41f5-a974-99a3fefc6bf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae48665497d04b1797a8e2503fefe0d5', 'request_id': 'req-50fae8b2-52d9-41f5-a974-99a3fefc6bf1'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:39.881843 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-50fae8b2-52d9-41f5-a974-99a3fefc6bf1 admin admin] The token cache is being invalidate because project ae48665497d04b1797a8e2503fefe0d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:39.882156 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-50fae8b2-52d9-41f5-a974-99a3fefc6bf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:39.885617 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-50fae8b2-52d9-41f5-a974-99a3fefc6bf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:39.888697 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 928/1850] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:39 2022] DELETE /identity/v3/projects/ae48665497d04b1797a8e2503fefe0d5 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:39.893510 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fae8b2-52d9-41f5-a974-99a3fefc6bf1 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:39.897927 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-50fae8b2-52d9-41f5-a974-99a3fefc6bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:39.971683 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e14e01-6476-4f93-94e3-79048a572603 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:39.985153 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cf51d-c359-406b-be3c-c4b65269bbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:39.986671 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cf51d-c359-406b-be3c-c4b65269bbef admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:39.986988 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cf51d-c359-406b-be3c-c4b65269bbef admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:39.987267 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cf51d-c359-406b-be3c-c4b65269bbef admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:39.987989 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6cf51d-c359-406b-be3c-c4b65269bbef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:39.992422 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6cf51d-c359-406b-be3c-c4b65269bbef admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:40.033090 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 923/1851] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:39 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:40.038801 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cf51d-c359-406b-be3c-c4b65269bbef admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:40.042184 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-9e6cf51d-c359-406b-be3c-c4b65269bbef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:40.073579 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cf51d-c359-406b-be3c-c4b65269bbef admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:40.084469 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2557a2-1f5a-4ba7-b002-cfa19aac301e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:40.086212 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2557a2-1f5a-4ba7-b002-cfa19aac301e admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:40.087449 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2557a2-1f5a-4ba7-b002-cfa19aac301e admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:40.088048 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fae8b2-52d9-41f5-a974-99a3fefc6bf1 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:40.088417 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2557a2-1f5a-4ba7-b002-cfa19aac301e admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:40.090795 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2557a2-1f5a-4ba7-b002-cfa19aac301e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:40.092563 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2557a2-1f5a-4ba7-b002-cfa19aac301e admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:40.101269 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216b0e8-e71c-4543-b6d3-2ae7c0acbfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:40.102235 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216b0e8-e71c-4543-b6d3-2ae7c0acbfc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:40.102514 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216b0e8-e71c-4543-b6d3-2ae7c0acbfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:40.102842 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d216b0e8-e71c-4543-b6d3-2ae7c0acbfc1 admin admin] PATH_INFO: `/v3/users/ddeab7826f8c43769811a5c7ced60124` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:40.107779 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216b0e8-e71c-4543-b6d3-2ae7c0acbfc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddeab7826f8c43769811a5c7ced60124)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:40.109819 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d216b0e8-e71c-4543-b6d3-2ae7c0acbfc1 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:40.123422 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 924/1852] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:52:40.129481 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2557a2-1f5a-4ba7-b002-cfa19aac301e admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:40.155506 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2557a2-1f5a-4ba7-b002-cfa19aac301e admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:40.173757 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9c91f-fbb7-4caa-8f0d-6e2a9012ef29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:40.185342 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9c91f-fbb7-4caa-8f0d-6e2a9012ef29 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:40.186781 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9c91f-fbb7-4caa-8f0d-6e2a9012ef29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:40.187828 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a9c91f-fbb7-4caa-8f0d-6e2a9012ef29 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:40.191101 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9c91f-fbb7-4caa-8f0d-6e2a9012ef29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:40.193931 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a9c91f-fbb7-4caa-8f0d-6e2a9012ef29 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:40.218429 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 925/1853] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:52:40.219630 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9c91f-fbb7-4caa-8f0d-6e2a9012ef29 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:40.225742 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-70a9c91f-fbb7-4caa-8f0d-6e2a9012ef29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:40.233815 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-d216b0e8-e71c-4543-b6d3-2ae7c0acbfc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddeab7826f8c43769811a5c7ced60124'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:40.235377 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-d216b0e8-e71c-4543-b6d3-2ae7c0acbfc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddeab7826f8c43769811a5c7ced60124'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:40.255850 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a9c91f-fbb7-4caa-8f0d-6e2a9012ef29 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:40.264798 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-d216b0e8-e71c-4543-b6d3-2ae7c0acbfc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddeab7826f8c43769811a5c7ced60124'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:40.269482 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba77ac-3078-4864-b275-b657aec4d628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:40.270528 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba77ac-3078-4864-b275-b657aec4d628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:40.272492 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba77ac-3078-4864-b275-b657aec4d628 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:40.272890 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba77ac-3078-4864-b275-b657aec4d628 admin admin] PATH_INFO: `/v3/projects/8192f1c6c15a4696972f8816529ade17` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:40.277002 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba77ac-3078-4864-b275-b657aec4d628 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8192f1c6c15a4696972f8816529ade17)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:40.279742 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba77ac-3078-4864-b275-b657aec4d628 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:40.291214 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-d216b0e8-e71c-4543-b6d3-2ae7c0acbfc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddeab7826f8c43769811a5c7ced60124'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:40.342397 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-d216b0e8-e71c-4543-b6d3-2ae7c0acbfc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddeab7826f8c43769811a5c7ced60124'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:40.350246 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 929/1854] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:39 2022] DELETE /identity/v3/users/ddeab7826f8c43769811a5c7ced60124 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:40.351241 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216b0e8-e71c-4543-b6d3-2ae7c0acbfc1 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:40.357521 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-d216b0e8-e71c-4543-b6d3-2ae7c0acbfc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:40.394208 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-01ba77ac-3078-4864-b275-b657aec4d628 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8192f1c6c15a4696972f8816529ade17', 'request_id': 'req-01ba77ac-3078-4864-b275-b657aec4d628'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:40.416898 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-01ba77ac-3078-4864-b275-b657aec4d628 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8192f1c6c15a4696972f8816529ade17', 'request_id': 'req-01ba77ac-3078-4864-b275-b657aec4d628'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:40.437307 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-01ba77ac-3078-4864-b275-b657aec4d628 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8192f1c6c15a4696972f8816529ade17', 'request_id': 'req-01ba77ac-3078-4864-b275-b657aec4d628'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:40.451072 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d216b0e8-e71c-4543-b6d3-2ae7c0acbfc1 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:40.470455 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-01ba77ac-3078-4864-b275-b657aec4d628 admin admin] The token cache is being invalidate because project 8192f1c6c15a4696972f8816529ade17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:40.474711 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-01ba77ac-3078-4864-b275-b657aec4d628 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:40.475897 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-01ba77ac-3078-4864-b275-b657aec4d628 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:40.480720 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 926/1855] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:40 2022] DELETE /identity/v3/projects/8192f1c6c15a4696972f8816529ade17 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:40.484624 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba77ac-3078-4864-b275-b657aec4d628 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:40.486159 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-01ba77ac-3078-4864-b275-b657aec4d628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:40.543713 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb18aa-fab8-45a1-be50-7242078b02bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:40.547801 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb18aa-fab8-45a1-be50-7242078b02bd admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:40.548160 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb18aa-fab8-45a1-be50-7242078b02bd admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:40.548539 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb18aa-fab8-45a1-be50-7242078b02bd admin admin] PATH_INFO: `/v3/projects/011b473078be402fb72fa643f8435bca/users/ab9e0d6004e347a1b176402300eb9fee/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:40.596736 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb18aa-fab8-45a1-be50-7242078b02bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=011b473078be402fb72fa643f8435bca, user_id=ab9e0d6004e347a1b176402300eb9fee, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:40.604299 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb18aa-fab8-45a1-be50-7242078b02bd admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:40.635990 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba77ac-3078-4864-b275-b657aec4d628 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:40.642430 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc15d5-275d-4e9e-95d2-de0a906a093c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:40.643583 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc15d5-275d-4e9e-95d2-de0a906a093c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:40.643874 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc15d5-275d-4e9e-95d2-de0a906a093c admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:40.644191 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc15d5-275d-4e9e-95d2-de0a906a093c admin admin] PATH_INFO: `/v3/users/7a2b3060c53846ff803e1bc5bef0ce97` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:40.648362 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc15d5-275d-4e9e-95d2-de0a906a093c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a2b3060c53846ff803e1bc5bef0ce97)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:40.662793 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 930/1856] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:40 2022] PUT /identity/v3/projects/011b473078be402fb72fa643f8435bca/users/ab9e0d6004e347a1b176402300eb9fee/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:40.662793 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2562be3-a854-44ea-85ca-b165c760058b None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:40.662793 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2562be3-a854-44ea-85ca-b165c760058b None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:40.662793 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2562be3-a854-44ea-85ca-b165c760058b None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:40.663850 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc15d5-275d-4e9e-95d2-de0a906a093c admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:40.664021 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 931/1857] 10.222.0.18 () {54 vars in 921 bytes} [Tue Mar 8 13:52:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:52:40.664757 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c8283-4de8-4dcf-8bd0-f7ea988a4310 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:40.664757 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c8283-4de8-4dcf-8bd0-f7ea988a4310 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:40.665034 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c8283-4de8-4dcf-8bd0-f7ea988a4310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:40.698385 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-5a4c8283-4de8-4dcf-8bd0-f7ea988a4310 None None] MFA Rules not processed for user `ab9e0d6004e347a1b176402300eb9fee`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:40.699925 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-5a4c8283-4de8-4dcf-8bd0-f7ea988a4310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:40.776276 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 932/1858] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:40.781299 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74458a2-2c3d-46b0-9be9-875cdb72ca10 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:40.781884 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74458a2-2c3d-46b0-9be9-875cdb72ca10 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:40.782480 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74458a2-2c3d-46b0-9be9-875cdb72ca10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:40.787486 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-4ebc15d5-275d-4e9e-95d2-de0a906a093c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a2b3060c53846ff803e1bc5bef0ce97'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:40.788481 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-4ebc15d5-275d-4e9e-95d2-de0a906a093c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a2b3060c53846ff803e1bc5bef0ce97'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:40.809022 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-a74458a2-2c3d-46b0-9be9-875cdb72ca10 None None] MFA Rules not processed for user `21ec894123044d4382995791c74c587b`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:40.810694 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-a74458a2-2c3d-46b0-9be9-875cdb72ca10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:40.810852 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-4ebc15d5-275d-4e9e-95d2-de0a906a093c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a2b3060c53846ff803e1bc5bef0ce97'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:40.855663 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-4ebc15d5-275d-4e9e-95d2-de0a906a093c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a2b3060c53846ff803e1bc5bef0ce97'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:40.866815 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-4ebc15d5-275d-4e9e-95d2-de0a906a093c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a2b3060c53846ff803e1bc5bef0ce97'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:40.892931 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 927/1859] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:40 2022] DELETE /identity/v3/users/7a2b3060c53846ff803e1bc5bef0ce97 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:40.892931 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc15d5-275d-4e9e-95d2-de0a906a093c admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:40.895196 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-4ebc15d5-275d-4e9e-95d2-de0a906a093c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:40.897817 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 933/1860] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Mar 8 13:52:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:40.930559 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74458a2-2c3d-46b0-9be9-875cdb72ca10 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:40.932351 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-a74458a2-2c3d-46b0-9be9-875cdb72ca10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:40.954341 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74458a2-2c3d-46b0-9be9-875cdb72ca10 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:41.095286 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc15d5-275d-4e9e-95d2-de0a906a093c admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:41.095666 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e4422-be21-4d13-adc2-2e5a3bbbc44a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:41.096432 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e4422-be21-4d13-adc2-2e5a3bbbc44a service nova] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:41.096817 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e4422-be21-4d13-adc2-2e5a3bbbc44a service nova] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:41.097213 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e4422-be21-4d13-adc2-2e5a3bbbc44a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:41.108359 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e4422-be21-4d13-adc2-2e5a3bbbc44a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:41.110617 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e4422-be21-4d13-adc2-2e5a3bbbc44a service nova] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:41.114821 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40e3a4-1ba0-48c3-8f8a-620c0f0b99aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:41.118876 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40e3a4-1ba0-48c3-8f8a-620c0f0b99aa admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:41.119187 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40e3a4-1ba0-48c3-8f8a-620c0f0b99aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:41.119471 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40e3a4-1ba0-48c3-8f8a-620c0f0b99aa admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:41.123508 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40e3a4-1ba0-48c3-8f8a-620c0f0b99aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:41.126772 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 934/1861] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:52:41.133388 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40e3a4-1ba0-48c3-8f8a-620c0f0b99aa admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:41.209304 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 928/1862] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:40 2022] POST /identity/v3/projects => generated 387 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:41.213910 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e4422-be21-4d13-adc2-2e5a3bbbc44a service nova] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:41.230010 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e4422-be21-4d13-adc2-2e5a3bbbc44a service nova] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:41.335750 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff935e-13e2-4889-9ef6-cdb606aa49c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:41.337089 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff935e-13e2-4889-9ef6-cdb606aa49c1 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:41.337600 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff935e-13e2-4889-9ef6-cdb606aa49c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:41.338107 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff935e-13e2-4889-9ef6-cdb606aa49c1 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:41.339025 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff935e-13e2-4889-9ef6-cdb606aa49c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:41.342184 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff935e-13e2-4889-9ef6-cdb606aa49c1 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:41.414295 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 935/1863] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:41 2022] POST /identity/v3/users => generated 300 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:41.418589 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40e3a4-1ba0-48c3-8f8a-620c0f0b99aa admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:41.438790 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff935e-13e2-4889-9ef6-cdb606aa49c1 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:41.441553 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-44ff935e-13e2-4889-9ef6-cdb606aa49c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:41.450241 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40e3a4-1ba0-48c3-8f8a-620c0f0b99aa admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:41.474215 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130b683-8d3c-4fca-a031-3f9d1f386ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:41.474547 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff935e-13e2-4889-9ef6-cdb606aa49c1 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:41.475770 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130b683-8d3c-4fca-a031-3f9d1f386ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:41.476120 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130b683-8d3c-4fca-a031-3f9d1f386ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:41.476588 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130b683-8d3c-4fca-a031-3f9d1f386ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:41.477559 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130b683-8d3c-4fca-a031-3f9d1f386ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:41.479411 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130b683-8d3c-4fca-a031-3f9d1f386ad7 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:41.479756 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b3475-faf5-4448-b589-9131382da6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:41.480622 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b3475-faf5-4448-b589-9131382da6db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:41.480897 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b3475-faf5-4448-b589-9131382da6db admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:41.481166 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b3475-faf5-4448-b589-9131382da6db admin admin] PATH_INFO: `/v3/projects/6a5c3257ba0b40e7b64e0fd552395634` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:41.483296 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b3475-faf5-4448-b589-9131382da6db admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a5c3257ba0b40e7b64e0fd552395634)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:41.485255 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b3475-faf5-4448-b589-9131382da6db admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:41.509601 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 929/1864] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:41.513312 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130b683-8d3c-4fca-a031-3f9d1f386ad7 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:41.533806 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130b683-8d3c-4fca-a031-3f9d1f386ad7 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:41.546075 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a6aaa-bd5c-4637-8f9e-b6658402d188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:41.547237 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a6aaa-bd5c-4637-8f9e-b6658402d188 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:41.547658 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a6aaa-bd5c-4637-8f9e-b6658402d188 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:41.548070 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a6aaa-bd5c-4637-8f9e-b6658402d188 admin admin] PATH_INFO: `/v3/projects/04893dd7726242ba8cd57ea23cd62270/users/50aa7c2f37a949758dc397910466c640/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:41.560747 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-905b3475-faf5-4448-b589-9131382da6db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a5c3257ba0b40e7b64e0fd552395634', 'request_id': 'req-905b3475-faf5-4448-b589-9131382da6db'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:41.568289 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-905b3475-faf5-4448-b589-9131382da6db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a5c3257ba0b40e7b64e0fd552395634', 'request_id': 'req-905b3475-faf5-4448-b589-9131382da6db'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:41.581149 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a6aaa-bd5c-4637-8f9e-b6658402d188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04893dd7726242ba8cd57ea23cd62270, user_id=50aa7c2f37a949758dc397910466c640, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:41.582495 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-905b3475-faf5-4448-b589-9131382da6db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a5c3257ba0b40e7b64e0fd552395634', 'request_id': 'req-905b3475-faf5-4448-b589-9131382da6db'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:41.584365 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941a6aaa-bd5c-4637-8f9e-b6658402d188 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:41.609440 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 930/1865] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:41 2022] PUT /identity/v3/projects/04893dd7726242ba8cd57ea23cd62270/users/50aa7c2f37a949758dc397910466c640/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:41.609625 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-905b3475-faf5-4448-b589-9131382da6db admin admin] The token cache is being invalidate because project 6a5c3257ba0b40e7b64e0fd552395634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:41.610980 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a6aaa-bd5c-4637-8f9e-b6658402d188 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:41.611846 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-905b3475-faf5-4448-b589-9131382da6db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:41.613571 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-905b3475-faf5-4448-b589-9131382da6db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:41.617731 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 936/1866] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:41 2022] DELETE /identity/v3/projects/6a5c3257ba0b40e7b64e0fd552395634 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:52:41.623175 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cb6fd-7ef8-46da-a845-3fb2d96af51f None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:41.623461 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cb6fd-7ef8-46da-a845-3fb2d96af51f None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:41.623791 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953cb6fd-7ef8-46da-a845-3fb2d96af51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:41.653452 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-953cb6fd-7ef8-46da-a845-3fb2d96af51f None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:41.655525 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-953cb6fd-7ef8-46da-a845-3fb2d96af51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:41.711889 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a6aaa-bd5c-4637-8f9e-b6658402d188 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:41.717027 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aff674-fe51-4c4c-8fb7-966437e8967d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:41.717740 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aff674-fe51-4c4c-8fb7-966437e8967d admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:41.718025 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aff674-fe51-4c4c-8fb7-966437e8967d admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:41.719055 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aff674-fe51-4c4c-8fb7-966437e8967d admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:41.720453 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aff674-fe51-4c4c-8fb7-966437e8967d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:41.722162 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aff674-fe51-4c4c-8fb7-966437e8967d admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:41.756066 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 931/1867] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:41.757259 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aff674-fe51-4c4c-8fb7-966437e8967d admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:41.763936 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-e9aff674-fe51-4c4c-8fb7-966437e8967d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:41.787944 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aff674-fe51-4c4c-8fb7-966437e8967d admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:41.792058 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 937/1868] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:41.797827 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c07bb-b700-4440-9061-6d2be2ad546a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:41.798913 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c07bb-b700-4440-9061-6d2be2ad546a admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:41.799173 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c07bb-b700-4440-9061-6d2be2ad546a admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:41.799454 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c07bb-b700-4440-9061-6d2be2ad546a admin admin] PATH_INFO: `/v3/projects/04893dd7726242ba8cd57ea23cd62270/users/50aa7c2f37a949758dc397910466c640/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:41.800870 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d55f6-f865-4128-a1d5-6288f38ef0b3 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:41.801974 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d55f6-f865-4128-a1d5-6288f38ef0b3 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:41.802089 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c07bb-b700-4440-9061-6d2be2ad546a admin admin] RBAC: Authorizing `identity:create_grant(project_id=04893dd7726242ba8cd57ea23cd62270, user_id=50aa7c2f37a949758dc397910466c640, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:41.802322 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d55f6-f865-4128-a1d5-6288f38ef0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:41.805004 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c07bb-b700-4440-9061-6d2be2ad546a admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:41.829420 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 932/1869] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:41 2022] PUT /identity/v3/projects/04893dd7726242ba8cd57ea23cd62270/users/50aa7c2f37a949758dc397910466c640/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:41.832196 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-548d55f6-f865-4128-a1d5-6288f38ef0b3 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:41.833494 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbae70-256b-4351-b95f-7c9dddb053fd None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:41.833612 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-548d55f6-f865-4128-a1d5-6288f38ef0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:41.834425 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbae70-256b-4351-b95f-7c9dddb053fd None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:41.834983 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbae70-256b-4351-b95f-7c9dddb053fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:41.887257 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-fafbae70-256b-4351-b95f-7c9dddb053fd None None] MFA Rules not processed for user `50aa7c2f37a949758dc397910466c640`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:41.889750 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-fafbae70-256b-4351-b95f-7c9dddb053fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:41.989008 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 938/1870] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:41.990065 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d55f6-f865-4128-a1d5-6288f38ef0b3 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:41.996584 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 933/1871] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:41.996584 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbae70-256b-4351-b95f-7c9dddb053fd None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:41.997723 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-548d55f6-f865-4128-a1d5-6288f38ef0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:42.021147 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d55f6-f865-4128-a1d5-6288f38ef0b3 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:42.026235 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbae70-256b-4351-b95f-7c9dddb053fd None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:42.026711 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f67bf-81de-4e17-9811-17a4aadf8a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:42.027748 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f67bf-81de-4e17-9811-17a4aadf8a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:42.028262 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f67bf-81de-4e17-9811-17a4aadf8a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:42.028674 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f67bf-81de-4e17-9811-17a4aadf8a20 admin admin] PATH_INFO: `/v3/projects/9bab319ea8f5463195a5f9bf04e7202c` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:42.032908 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285e1d6-9f1b-4e34-a067-a2936eeb37ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:42.043083 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285e1d6-9f1b-4e34-a067-a2936eeb37ad admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:42.043083 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285e1d6-9f1b-4e34-a067-a2936eeb37ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:42.043359 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f67bf-81de-4e17-9811-17a4aadf8a20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bab319ea8f5463195a5f9bf04e7202c)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:42.043458 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285e1d6-9f1b-4e34-a067-a2936eeb37ad admin admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:42.043458 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285e1d6-9f1b-4e34-a067-a2936eeb37ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:42.043607 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f67bf-81de-4e17-9811-17a4aadf8a20 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:42.043680 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285e1d6-9f1b-4e34-a067-a2936eeb37ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:42.043680 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285e1d6-9f1b-4e34-a067-a2936eeb37ad admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:42.062295 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 934/1872] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:52:42.063279 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285e1d6-9f1b-4e34-a067-a2936eeb37ad admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:42.065732 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-6285e1d6-9f1b-4e34-a067-a2936eeb37ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:42.134955 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-9e8f67bf-81de-4e17-9811-17a4aadf8a20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bab319ea8f5463195a5f9bf04e7202c', 'request_id': 'req-9e8f67bf-81de-4e17-9811-17a4aadf8a20'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:42.151063 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-9e8f67bf-81de-4e17-9811-17a4aadf8a20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bab319ea8f5463195a5f9bf04e7202c', 'request_id': 'req-9e8f67bf-81de-4e17-9811-17a4aadf8a20'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:42.171509 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-9e8f67bf-81de-4e17-9811-17a4aadf8a20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bab319ea8f5463195a5f9bf04e7202c', 'request_id': 'req-9e8f67bf-81de-4e17-9811-17a4aadf8a20'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:42.184437 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285e1d6-9f1b-4e34-a067-a2936eeb37ad admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:42.189723 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-9e8f67bf-81de-4e17-9811-17a4aadf8a20 admin admin] The token cache is being invalidate because project 9bab319ea8f5463195a5f9bf04e7202c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:42.190015 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-9e8f67bf-81de-4e17-9811-17a4aadf8a20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:42.191419 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-9e8f67bf-81de-4e17-9811-17a4aadf8a20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:42.194457 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 939/1873] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:41 2022] DELETE /identity/v3/projects/9bab319ea8f5463195a5f9bf04e7202c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:42.198544 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f67bf-81de-4e17-9811-17a4aadf8a20 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:42.202045 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-9e8f67bf-81de-4e17-9811-17a4aadf8a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:42.289437 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6d2be-1f25-4c2f-997d-7cf40d9516a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:42.290972 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6d2be-1f25-4c2f-997d-7cf40d9516a1 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:42.291529 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6d2be-1f25-4c2f-997d-7cf40d9516a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:42.292043 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6d2be-1f25-4c2f-997d-7cf40d9516a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:42.294372 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f2f6d2be-1f25-4c2f-997d-7cf40d9516a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:42.302738 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f67bf-81de-4e17-9811-17a4aadf8a20 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:42.312848 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68264af-8b00-4793-86d2-793d85b45b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:42.313644 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68264af-8b00-4793-86d2-793d85b45b5e admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:42.314686 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68264af-8b00-4793-86d2-793d85b45b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:42.315096 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68264af-8b00-4793-86d2-793d85b45b5e admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:42.316011 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68264af-8b00-4793-86d2-793d85b45b5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:42.318059 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68264af-8b00-4793-86d2-793d85b45b5e admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:42.367344 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 940/1874] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:42 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:42.368806 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20238300-604b-4e9a-9dd1-8054c027e6d7 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:42.373625 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20238300-604b-4e9a-9dd1-8054c027e6d7 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:42.373944 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20238300-604b-4e9a-9dd1-8054c027e6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:42.402686 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6d2be-1f25-4c2f-997d-7cf40d9516a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:42.404320 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6d2be-1f25-4c2f-997d-7cf40d9516a1 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:42.410379 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-20238300-604b-4e9a-9dd1-8054c027e6d7 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:42.411325 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-20238300-604b-4e9a-9dd1-8054c027e6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:42.418881 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 935/1875] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:42.419442 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6d2be-1f25-4c2f-997d-7cf40d9516a1 service cinder] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:42.432773 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6d2be-1f25-4c2f-997d-7cf40d9516a1 service cinder] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:42.520342 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 941/1876] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:42.520990 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20238300-604b-4e9a-9dd1-8054c027e6d7 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:42.522573 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-20238300-604b-4e9a-9dd1-8054c027e6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:42.548429 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20238300-604b-4e9a-9dd1-8054c027e6d7 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:42.549088 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc2176-e2b2-4ae7-9dc3-85a4113b1f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:42.550179 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc2176-e2b2-4ae7-9dc3-85a4113b1f47 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:42.551309 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc2176-e2b2-4ae7-9dc3-85a4113b1f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:42.551761 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc2176-e2b2-4ae7-9dc3-85a4113b1f47 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:42.553633 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f4a75-4a69-49b5-9f0d-406c09a1d898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:42.554075 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc2176-e2b2-4ae7-9dc3-85a4113b1f47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:42.554485 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f4a75-4a69-49b5-9f0d-406c09a1d898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:42.554814 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f4a75-4a69-49b5-9f0d-406c09a1d898 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:42.555058 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f4a75-4a69-49b5-9f0d-406c09a1d898 admin admin] PATH_INFO: `/v3/users/ab9e0d6004e347a1b176402300eb9fee` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:42.556531 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f4a75-4a69-49b5-9f0d-406c09a1d898 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab9e0d6004e347a1b176402300eb9fee)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:42.556700 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc2176-e2b2-4ae7-9dc3-85a4113b1f47 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:42.558863 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f4a75-4a69-49b5-9f0d-406c09a1d898 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:42.605058 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 936/1877] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:42 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:42.606452 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31510b93-2d69-4c2f-af19-e67552652b19 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:42.607119 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31510b93-2d69-4c2f-af19-e67552652b19 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:42.607119 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31510b93-2d69-4c2f-af19-e67552652b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:42.663223 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-770f4a75-4a69-49b5-9f0d-406c09a1d898 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab9e0d6004e347a1b176402300eb9fee'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:42.664018 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-770f4a75-4a69-49b5-9f0d-406c09a1d898 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab9e0d6004e347a1b176402300eb9fee'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:42.674097 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-31510b93-2d69-4c2f-af19-e67552652b19 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:42.675378 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-31510b93-2d69-4c2f-af19-e67552652b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:42.683534 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-770f4a75-4a69-49b5-9f0d-406c09a1d898 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab9e0d6004e347a1b176402300eb9fee'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:42.695792 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-770f4a75-4a69-49b5-9f0d-406c09a1d898 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab9e0d6004e347a1b176402300eb9fee'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:42.696325 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 937/1878] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:42.697255 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31510b93-2d69-4c2f-af19-e67552652b19 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:42.698581 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-31510b93-2d69-4c2f-af19-e67552652b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:42.721252 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-770f4a75-4a69-49b5-9f0d-406c09a1d898 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab9e0d6004e347a1b176402300eb9fee'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:42.728992 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 942/1879] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:42 2022] DELETE /identity/v3/users/ab9e0d6004e347a1b176402300eb9fee => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:42.729987 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f4a75-4a69-49b5-9f0d-406c09a1d898 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:42.734777 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31510b93-2d69-4c2f-af19-e67552652b19 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:42.808862 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f4a75-4a69-49b5-9f0d-406c09a1d898 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:42.817526 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bcdbc2-e9c1-48c5-bbda-1eaaf7a2196e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:42.818226 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcdbc2-e9c1-48c5-bbda-1eaaf7a2196e admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:42.818593 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcdbc2-e9c1-48c5-bbda-1eaaf7a2196e admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:42.818760 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bcdbc2-e9c1-48c5-bbda-1eaaf7a2196e admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:42.819621 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bcdbc2-e9c1-48c5-bbda-1eaaf7a2196e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:42.820286 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734e0ef-ab5c-491a-a980-a2a169072dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:42.821259 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bcdbc2-e9c1-48c5-bbda-1eaaf7a2196e admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:42.824758 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734e0ef-ab5c-491a-a980-a2a169072dad admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:42.824758 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734e0ef-ab5c-491a-a980-a2a169072dad admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:42.824758 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734e0ef-ab5c-491a-a980-a2a169072dad admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:42.825571 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734e0ef-ab5c-491a-a980-a2a169072dad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:42.828960 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734e0ef-ab5c-491a-a980-a2a169072dad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:42.831478 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734e0ef-ab5c-491a-a980-a2a169072dad admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:42.833589 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 938/1880] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:42.835290 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a529a6-1f6a-492e-9f6e-8888c0fef5dc None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:42.835580 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a529a6-1f6a-492e-9f6e-8888c0fef5dc None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:42.836148 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a529a6-1f6a-492e-9f6e-8888c0fef5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:42.847894 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 943/1881] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:52:42.848905 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734e0ef-ab5c-491a-a980-a2a169072dad admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:42.855046 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-e9a529a6-1f6a-492e-9f6e-8888c0fef5dc None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:42.856727 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-e9a529a6-1f6a-492e-9f6e-8888c0fef5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:42.858957 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734e0ef-ab5c-491a-a980-a2a169072dad admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:42.863742 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f65337-2a9d-4817-8719-09dbde9bd6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:42.864772 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f65337-2a9d-4817-8719-09dbde9bd6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:42.864888 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 939/1882] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:42.865002 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f65337-2a9d-4817-8719-09dbde9bd6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:42.865314 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f65337-2a9d-4817-8719-09dbde9bd6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:42.866113 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a529a6-1f6a-492e-9f6e-8888c0fef5dc None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:42.866255 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f65337-2a9d-4817-8719-09dbde9bd6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:42.867987 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f65337-2a9d-4817-8719-09dbde9bd6e5 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:42.877480 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a529a6-1f6a-492e-9f6e-8888c0fef5dc None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:42.879248 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 944/1883] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:42.879930 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f65337-2a9d-4817-8719-09dbde9bd6e5 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:42.881689 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-e8f65337-2a9d-4817-8719-09dbde9bd6e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:42.883719 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a37a1-7b67-4c35-bfe7-8ea85603230b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:42.884441 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a37a1-7b67-4c35-bfe7-8ea85603230b admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:42.884720 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a37a1-7b67-4c35-bfe7-8ea85603230b admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:42.884989 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a37a1-7b67-4c35-bfe7-8ea85603230b admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:42.885733 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a37a1-7b67-4c35-bfe7-8ea85603230b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:42.887741 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a37a1-7b67-4c35-bfe7-8ea85603230b admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:42.922003 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 940/1884] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:42 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:42.922514 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a37a1-7b67-4c35-bfe7-8ea85603230b admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:42.945565 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f65337-2a9d-4817-8719-09dbde9bd6e5 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:42.982657 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a37a1-7b67-4c35-bfe7-8ea85603230b admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:42.987256 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b7ff6b-fd78-4577-a7cb-90c7808db232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:42.988144 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7ff6b-fd78-4577-a7cb-90c7808db232 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:42.988547 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7ff6b-fd78-4577-a7cb-90c7808db232 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:42.988822 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b7ff6b-fd78-4577-a7cb-90c7808db232 admin admin] PATH_INFO: `/v3/projects/ca7c490a55394daba82bf61a7d1e823d/users/2998c1f95ba643938e732e1b2fb59ee6/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:42.993681 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2956801-3391-46bd-8d01-a34d753a38e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:42.994323 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2956801-3391-46bd-8d01-a34d753a38e8 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:42.994604 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2956801-3391-46bd-8d01-a34d753a38e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:42.994877 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2956801-3391-46bd-8d01-a34d753a38e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:43.004496 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7ff6b-fd78-4577-a7cb-90c7808db232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca7c490a55394daba82bf61a7d1e823d, user_id=2998c1f95ba643938e732e1b2fb59ee6, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:43.005899 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2956801-3391-46bd-8d01-a34d753a38e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:43.007320 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2956801-3391-46bd-8d01-a34d753a38e8 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:43.007412 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b7ff6b-fd78-4577-a7cb-90c7808db232 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:43.017822 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 945/1885] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:43.018702 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2956801-3391-46bd-8d01-a34d753a38e8 service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:43.025423 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 941/1886] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:42 2022] PUT /identity/v3/projects/ca7c490a55394daba82bf61a7d1e823d/users/2998c1f95ba643938e732e1b2fb59ee6/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:43.027978 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2956801-3391-46bd-8d01-a34d753a38e8 service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:43.032664 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed96812-3d1c-4966-ba76-7a0ee0cbe5b8 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:43.033076 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed96812-3d1c-4966-ba76-7a0ee0cbe5b8 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:43.033400 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed96812-3d1c-4966-ba76-7a0ee0cbe5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:43.069091 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-3ed96812-3d1c-4966-ba76-7a0ee0cbe5b8 None None] MFA Rules not processed for user `2998c1f95ba643938e732e1b2fb59ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:43.079728 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-3ed96812-3d1c-4966-ba76-7a0ee0cbe5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:43.087613 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8b3ad-4f3a-47d1-b27d-9f6df49b32f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:43.088303 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8b3ad-4f3a-47d1-b27d-9f6df49b32f5 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:43.088585 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8b3ad-4f3a-47d1-b27d-9f6df49b32f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:43.088864 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8b3ad-4f3a-47d1-b27d-9f6df49b32f5 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:43.089598 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8b3ad-4f3a-47d1-b27d-9f6df49b32f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:43.092198 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8b3ad-4f3a-47d1-b27d-9f6df49b32f5 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:43.119039 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 946/1887] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:43 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:43.120018 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8b3ad-4f3a-47d1-b27d-9f6df49b32f5 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:43.129900 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8b3ad-4f3a-47d1-b27d-9f6df49b32f5 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:43.135123 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb6f35-1b00-4b3d-baba-82e71279712b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:43.135808 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb6f35-1b00-4b3d-baba-82e71279712b admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:43.136293 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb6f35-1b00-4b3d-baba-82e71279712b admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:43.136398 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb6f35-1b00-4b3d-baba-82e71279712b admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:43.137078 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb6f35-1b00-4b3d-baba-82e71279712b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:43.138733 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb6f35-1b00-4b3d-baba-82e71279712b admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:43.152923 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 947/1888] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:43.153868 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb6f35-1b00-4b3d-baba-82e71279712b admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:43.164089 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb6f35-1b00-4b3d-baba-82e71279712b admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:43.170690 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ae760-cb6e-42c9-9fa8-71f7572b9a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:43.171301 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ae760-cb6e-42c9-9fa8-71f7572b9a3e admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:43.171627 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ae760-cb6e-42c9-9fa8-71f7572b9a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:43.171982 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ae760-cb6e-42c9-9fa8-71f7572b9a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:43.172723 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ae760-cb6e-42c9-9fa8-71f7572b9a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:43.174693 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641ae760-cb6e-42c9-9fa8-71f7572b9a3e admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:43.186495 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 942/1889] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:43.190278 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 948/1890] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:43.191148 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed96812-3d1c-4966-ba76-7a0ee0cbe5b8 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:43.194144 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ae760-cb6e-42c9-9fa8-71f7572b9a3e admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:43.196608 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-641ae760-cb6e-42c9-9fa8-71f7572b9a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:43.203523 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed96812-3d1c-4966-ba76-7a0ee0cbe5b8 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:43.208946 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca37b8-722a-4407-95bd-b8afdf465dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:43.209949 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca37b8-722a-4407-95bd-b8afdf465dc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:43.210344 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca37b8-722a-4407-95bd-b8afdf465dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:43.210630 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca37b8-722a-4407-95bd-b8afdf465dc6 admin admin] PATH_INFO: `/v3/projects/0adc54f7ae0a44859dca5e1a6c5a7c7a/users/eb3d4d59cb7443d4ab31a227f51bb466/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:43.226848 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca37b8-722a-4407-95bd-b8afdf465dc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0adc54f7ae0a44859dca5e1a6c5a7c7a, user_id=eb3d4d59cb7443d4ab31a227f51bb466, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:43.237440 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca37b8-722a-4407-95bd-b8afdf465dc6 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:43.261162 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 943/1891] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:43 2022] PUT /identity/v3/projects/0adc54f7ae0a44859dca5e1a6c5a7c7a/users/eb3d4d59cb7443d4ab31a227f51bb466/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:52:43.267528 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffefbe9-4f58-47dd-ad19-e9525b274556 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:43.267767 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffefbe9-4f58-47dd-ad19-e9525b274556 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:43.273717 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffefbe9-4f58-47dd-ad19-e9525b274556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:43.293221 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641ae760-cb6e-42c9-9fa8-71f7572b9a3e admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:43.313691 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-3ffefbe9-4f58-47dd-ad19-e9525b274556 None None] MFA Rules not processed for user `eb3d4d59cb7443d4ab31a227f51bb466`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:43.319619 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-3ffefbe9-4f58-47dd-ad19-e9525b274556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:43.351953 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e413b82-12ae-427e-b643-9cdccab04628 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:43.352789 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e413b82-12ae-427e-b643-9cdccab04628 service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:43.353134 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e413b82-12ae-427e-b643-9cdccab04628 service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:43.353904 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e413b82-12ae-427e-b643-9cdccab04628 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:43.405796 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 944/1892] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:43.417448 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffefbe9-4f58-47dd-ad19-e9525b274556 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:43.423803 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-3ffefbe9-4f58-47dd-ad19-e9525b274556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:43.432337 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e413b82-12ae-427e-b643-9cdccab04628 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:43.434101 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e413b82-12ae-427e-b643-9cdccab04628 service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:43.444246 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffefbe9-4f58-47dd-ad19-e9525b274556 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:43.444483 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 949/1893] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:52:43.449039 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da20241-5e61-42df-a927-79f7d94e44dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:43.449790 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da20241-5e61-42df-a927-79f7d94e44dc service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:43.450070 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da20241-5e61-42df-a927-79f7d94e44dc service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:43.450396 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da20241-5e61-42df-a927-79f7d94e44dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:43.458571 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e413b82-12ae-427e-b643-9cdccab04628 service cinder] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:43.461096 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da20241-5e61-42df-a927-79f7d94e44dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:43.462747 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da20241-5e61-42df-a927-79f7d94e44dc service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:43.463670 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-8e413b82-12ae-427e-b643-9cdccab04628 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:43.495387 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 945/1894] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:43.496476 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da20241-5e61-42df-a927-79f7d94e44dc service cinder] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:43.576053 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da20241-5e61-42df-a927-79f7d94e44dc service cinder] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:43.576476 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e413b82-12ae-427e-b643-9cdccab04628 service cinder] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:43.581860 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba45b63-7953-4d4a-97d3-12e2d3b9c145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:43.582776 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba45b63-7953-4d4a-97d3-12e2d3b9c145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:43.582905 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf960d-bcaf-465b-9202-660c2cd1600e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:43.583095 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba45b63-7953-4d4a-97d3-12e2d3b9c145 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:43.583315 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba45b63-7953-4d4a-97d3-12e2d3b9c145 admin admin] PATH_INFO: `/v3/users/2998c1f95ba643938e732e1b2fb59ee6` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:43.583957 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf960d-bcaf-465b-9202-660c2cd1600e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:43.584241 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf960d-bcaf-465b-9202-660c2cd1600e admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:43.584508 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf960d-bcaf-465b-9202-660c2cd1600e admin admin] PATH_INFO: `/v3/projects/011b473078be402fb72fa643f8435bca` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:43.585744 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf960d-bcaf-465b-9202-660c2cd1600e admin admin] RBAC: Authorizing `identity:delete_project(project_id=011b473078be402fb72fa643f8435bca)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:43.586489 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba45b63-7953-4d4a-97d3-12e2d3b9c145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2998c1f95ba643938e732e1b2fb59ee6)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:43.588593 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf960d-bcaf-465b-9202-660c2cd1600e admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:43.590048 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba45b63-7953-4d4a-97d3-12e2d3b9c145 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:43.646200 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-18cf960d-bcaf-465b-9202-660c2cd1600e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '011b473078be402fb72fa643f8435bca', 'request_id': 'req-18cf960d-bcaf-465b-9202-660c2cd1600e'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:43.653412 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-18cf960d-bcaf-465b-9202-660c2cd1600e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '011b473078be402fb72fa643f8435bca', 'request_id': 'req-18cf960d-bcaf-465b-9202-660c2cd1600e'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:43.657418 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-6ba45b63-7953-4d4a-97d3-12e2d3b9c145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2998c1f95ba643938e732e1b2fb59ee6'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:43.658029 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-6ba45b63-7953-4d4a-97d3-12e2d3b9c145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2998c1f95ba643938e732e1b2fb59ee6'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:43.664180 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-18cf960d-bcaf-465b-9202-660c2cd1600e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '011b473078be402fb72fa643f8435bca', 'request_id': 'req-18cf960d-bcaf-465b-9202-660c2cd1600e'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:43.676776 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-18cf960d-bcaf-465b-9202-660c2cd1600e admin admin] The token cache is being invalidate because project 011b473078be402fb72fa643f8435bca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:43.677409 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-18cf960d-bcaf-465b-9202-660c2cd1600e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:43.677840 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-6ba45b63-7953-4d4a-97d3-12e2d3b9c145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2998c1f95ba643938e732e1b2fb59ee6'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:43.679100 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-18cf960d-bcaf-465b-9202-660c2cd1600e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:43.682994 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 950/1895] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:43 2022] DELETE /identity/v3/projects/011b473078be402fb72fa643f8435bca => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:43.687171 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf960d-bcaf-465b-9202-660c2cd1600e admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:43.689101 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-18cf960d-bcaf-465b-9202-660c2cd1600e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:43.696191 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-6ba45b63-7953-4d4a-97d3-12e2d3b9c145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2998c1f95ba643938e732e1b2fb59ee6'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:43.705203 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-6ba45b63-7953-4d4a-97d3-12e2d3b9c145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2998c1f95ba643938e732e1b2fb59ee6'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:43.712174 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 946/1896] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:43 2022] DELETE /identity/v3/users/2998c1f95ba643938e732e1b2fb59ee6 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:43.716416 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e7bad-d1b2-476c-8732-4b501de647b1 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:43.716773 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e7bad-d1b2-476c-8732-4b501de647b1 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:43.717118 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e7bad-d1b2-476c-8732-4b501de647b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:43.734683 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-956e7bad-d1b2-476c-8732-4b501de647b1 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:43.736790 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-956e7bad-d1b2-476c-8732-4b501de647b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:43.769668 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf960d-bcaf-465b-9202-660c2cd1600e admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:43.835490 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418578a-c453-45b5-9242-477f549a70e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:43.836567 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418578a-c453-45b5-9242-477f549a70e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:43.836861 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418578a-c453-45b5-9242-477f549a70e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:43.837166 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418578a-c453-45b5-9242-477f549a70e8 admin admin] PATH_INFO: `/v3/users/50aa7c2f37a949758dc397910466c640` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:43.838522 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418578a-c453-45b5-9242-477f549a70e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50aa7c2f37a949758dc397910466c640)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:43.840607 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418578a-c453-45b5-9242-477f549a70e8 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:43.863824 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 947/1897] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:43.884055 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e7bad-d1b2-476c-8732-4b501de647b1 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:43.888263 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-956e7bad-d1b2-476c-8732-4b501de647b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:43.927616 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-9418578a-c453-45b5-9242-477f549a70e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50aa7c2f37a949758dc397910466c640'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:43.928748 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-9418578a-c453-45b5-9242-477f549a70e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50aa7c2f37a949758dc397910466c640'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:43.947745 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-9418578a-c453-45b5-9242-477f549a70e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50aa7c2f37a949758dc397910466c640'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:43.960338 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-9418578a-c453-45b5-9242-477f549a70e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50aa7c2f37a949758dc397910466c640'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:43.989642 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-9418578a-c453-45b5-9242-477f549a70e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50aa7c2f37a949758dc397910466c640'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:43.994643 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956e7bad-d1b2-476c-8732-4b501de647b1 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:43.999717 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda86f9-3c2b-467e-a8ad-7a4cb3288e1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:44.001344 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda86f9-3c2b-467e-a8ad-7a4cb3288e1f service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:44.001981 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda86f9-3c2b-467e-a8ad-7a4cb3288e1f service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:44.002696 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 951/1898] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:43 2022] DELETE /identity/v3/users/50aa7c2f37a949758dc397910466c640 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:44.005296 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda86f9-3c2b-467e-a8ad-7a4cb3288e1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:44.008198 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-bdda86f9-3c2b-467e-a8ad-7a4cb3288e1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:44.025952 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda86f9-3c2b-467e-a8ad-7a4cb3288e1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:44.027667 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda86f9-3c2b-467e-a8ad-7a4cb3288e1f service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:44.043359 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 948/1899] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:44.677087 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418578a-c453-45b5-9242-477f549a70e8 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:44.678694 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-9418578a-c453-45b5-9242-477f549a70e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:44.708593 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda86f9-3c2b-467e-a8ad-7a4cb3288e1f service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:44.710128 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-bdda86f9-3c2b-467e-a8ad-7a4cb3288e1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:44.734026 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda86f9-3c2b-467e-a8ad-7a4cb3288e1f service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:44.779471 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418578a-c453-45b5-9242-477f549a70e8 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:44.785459 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2811553e-1534-45f2-80e1-42f31488bcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:44.786351 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811553e-1534-45f2-80e1-42f31488bcc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:44.786611 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811553e-1534-45f2-80e1-42f31488bcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:44.786876 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2811553e-1534-45f2-80e1-42f31488bcc6 admin admin] PATH_INFO: `/v3/projects/04893dd7726242ba8cd57ea23cd62270` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:44.788069 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811553e-1534-45f2-80e1-42f31488bcc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04893dd7726242ba8cd57ea23cd62270)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:44.790504 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2811553e-1534-45f2-80e1-42f31488bcc6 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:44.822747 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeafbc8-5c02-4439-adf7-ff5a4e7319f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:44.823871 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeafbc8-5c02-4439-adf7-ff5a4e7319f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:44.824158 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeafbc8-5c02-4439-adf7-ff5a4e7319f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:44.824418 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeafbc8-5c02-4439-adf7-ff5a4e7319f3 admin admin] PATH_INFO: `/v3/projects/ca7c490a55394daba82bf61a7d1e823d` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:44.826236 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeafbc8-5c02-4439-adf7-ff5a4e7319f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca7c490a55394daba82bf61a7d1e823d)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:44.828458 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeafbc8-5c02-4439-adf7-ff5a4e7319f3 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:44.843674 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-2811553e-1534-45f2-80e1-42f31488bcc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04893dd7726242ba8cd57ea23cd62270', 'request_id': 'req-2811553e-1534-45f2-80e1-42f31488bcc6'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:44.852099 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-2811553e-1534-45f2-80e1-42f31488bcc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04893dd7726242ba8cd57ea23cd62270', 'request_id': 'req-2811553e-1534-45f2-80e1-42f31488bcc6'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:44.861580 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-2811553e-1534-45f2-80e1-42f31488bcc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04893dd7726242ba8cd57ea23cd62270', 'request_id': 'req-2811553e-1534-45f2-80e1-42f31488bcc6'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:44.876450 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-2811553e-1534-45f2-80e1-42f31488bcc6 admin admin] The token cache is being invalidate because project 04893dd7726242ba8cd57ea23cd62270 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:44.876733 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-2811553e-1534-45f2-80e1-42f31488bcc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:44.877398 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-2811553e-1534-45f2-80e1-42f31488bcc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:44.878829 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-aaeafbc8-5c02-4439-adf7-ff5a4e7319f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca7c490a55394daba82bf61a7d1e823d', 'request_id': 'req-aaeafbc8-5c02-4439-adf7-ff5a4e7319f3'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:44.879211 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 952/1900] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:44 2022] DELETE /identity/v3/projects/04893dd7726242ba8cd57ea23cd62270 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:44.883594 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e6c09-38d6-45cc-97cb-a05bc40d1ae1 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:44.883877 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e6c09-38d6-45cc-97cb-a05bc40d1ae1 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:44.884152 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e6c09-38d6-45cc-97cb-a05bc40d1ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:44.885647 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-aaeafbc8-5c02-4439-adf7-ff5a4e7319f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca7c490a55394daba82bf61a7d1e823d', 'request_id': 'req-aaeafbc8-5c02-4439-adf7-ff5a4e7319f3'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:44.897847 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-aaeafbc8-5c02-4439-adf7-ff5a4e7319f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca7c490a55394daba82bf61a7d1e823d', 'request_id': 'req-aaeafbc8-5c02-4439-adf7-ff5a4e7319f3'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:44.905040 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-be6e6c09-38d6-45cc-97cb-a05bc40d1ae1 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:44.906378 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-be6e6c09-38d6-45cc-97cb-a05bc40d1ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:44.908799 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-aaeafbc8-5c02-4439-adf7-ff5a4e7319f3 admin admin] The token cache is being invalidate because project ca7c490a55394daba82bf61a7d1e823d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:44.909087 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-aaeafbc8-5c02-4439-adf7-ff5a4e7319f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:44.909779 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-aaeafbc8-5c02-4439-adf7-ff5a4e7319f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:44.911699 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 949/1901] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:44 2022] DELETE /identity/v3/projects/ca7c490a55394daba82bf61a7d1e823d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:52:44.916877 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525deead-195a-4480-8fe0-bc5d247e6794 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:44.917383 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525deead-195a-4480-8fe0-bc5d247e6794 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:44.917968 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525deead-195a-4480-8fe0-bc5d247e6794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:44.936364 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-525deead-195a-4480-8fe0-bc5d247e6794 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:44.937658 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-525deead-195a-4480-8fe0-bc5d247e6794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:44.967357 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 953/1902] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:44.974419 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e44f86-742f-4322-821a-7f219d23bc9f None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:44.974931 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e44f86-742f-4322-821a-7f219d23bc9f None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:44.978098 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e44f86-742f-4322-821a-7f219d23bc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.002953 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-93e44f86-742f-4322-821a-7f219d23bc9f None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:45.005117 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-93e44f86-742f-4322-821a-7f219d23bc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:45.018198 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 954/1903] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:45.019157 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e44f86-742f-4322-821a-7f219d23bc9f None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:45.028865 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e44f86-742f-4322-821a-7f219d23bc9f None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:45.034068 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a7a7a-17f7-4862-bf95-3c1ea2a4a77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:45.034747 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a7a7a-17f7-4862-bf95-3c1ea2a4a77e admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.035015 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a7a7a-17f7-4862-bf95-3c1ea2a4a77e admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.035372 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a7a7a-17f7-4862-bf95-3c1ea2a4a77e admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.036199 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a7a7a-17f7-4862-bf95-3c1ea2a4a77e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:45.036492 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a7a7a-17f7-4862-bf95-3c1ea2a4a77e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:45.036649 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 950/1904] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:45.038167 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a7a7a-17f7-4862-bf95-3c1ea2a4a77e admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:45.045800 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b9a61-b594-47fd-8916-41b0bfc7f5d1 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.046205 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b9a61-b594-47fd-8916-41b0bfc7f5d1 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.046378 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b9a61-b594-47fd-8916-41b0bfc7f5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.055530 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 955/1905] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:52:45.056157 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a7a7a-17f7-4862-bf95-3c1ea2a4a77e admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:45.067626 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a7a7a-17f7-4862-bf95-3c1ea2a4a77e admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:45.073570 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2acf4b-0448-4bd9-acdc-424c5e95c4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:45.074342 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2acf4b-0448-4bd9-acdc-424c5e95c4c9 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.074646 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2acf4b-0448-4bd9-acdc-424c5e95c4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.075043 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2acf4b-0448-4bd9-acdc-424c5e95c4c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.075793 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2acf4b-0448-4bd9-acdc-424c5e95c4c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:45.076093 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-642b9a61-b594-47fd-8916-41b0bfc7f5d1 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:45.077601 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-642b9a61-b594-47fd-8916-41b0bfc7f5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:45.078011 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2acf4b-0448-4bd9-acdc-424c5e95c4c9 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:45.091764 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 951/1906] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:45.096725 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b9a61-b594-47fd-8916-41b0bfc7f5d1 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:45.107284 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b9a61-b594-47fd-8916-41b0bfc7f5d1 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:45.112684 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40692fd0-e2f7-43c3-8f90-fc42fce8e581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:45.114364 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40692fd0-e2f7-43c3-8f90-fc42fce8e581 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.114682 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40692fd0-e2f7-43c3-8f90-fc42fce8e581 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.114906 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40692fd0-e2f7-43c3-8f90-fc42fce8e581 admin admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.115695 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40692fd0-e2f7-43c3-8f90-fc42fce8e581 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:45.115882 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 956/1907] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:45 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:45.116012 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40692fd0-e2f7-43c3-8f90-fc42fce8e581 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:45.118514 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40692fd0-e2f7-43c3-8f90-fc42fce8e581 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:45.120350 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2acf4b-0448-4bd9-acdc-424c5e95c4c9 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:45.136225 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 952/1908] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:52:45.140522 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40692fd0-e2f7-43c3-8f90-fc42fce8e581 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:45.156698 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40692fd0-e2f7-43c3-8f90-fc42fce8e581 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:45.196680 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2acf4b-0448-4bd9-acdc-424c5e95c4c9 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:45.202301 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb597f7-3f5a-4964-bd5c-41c09f44b299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:45.203216 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb597f7-3f5a-4964-bd5c-41c09f44b299 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.203328 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb597f7-3f5a-4964-bd5c-41c09f44b299 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.203592 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb597f7-3f5a-4964-bd5c-41c09f44b299 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.204341 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb597f7-3f5a-4964-bd5c-41c09f44b299 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:45.206651 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb597f7-3f5a-4964-bd5c-41c09f44b299 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:45.231975 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 957/1909] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:45 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:45.235770 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb597f7-3f5a-4964-bd5c-41c09f44b299 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:45.250208 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb597f7-3f5a-4964-bd5c-41c09f44b299 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:45.256391 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04505b31-9f49-45ee-9f76-6a27d93b7a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:45.257395 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04505b31-9f49-45ee-9f76-6a27d93b7a7f admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.258907 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cba3aa-158a-4f68-a324-7be832653090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:45.259862 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cba3aa-158a-4f68-a324-7be832653090 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.260236 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cba3aa-158a-4f68-a324-7be832653090 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.260571 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cba3aa-158a-4f68-a324-7be832653090 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.261415 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cba3aa-158a-4f68-a324-7be832653090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:45.261640 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04505b31-9f49-45ee-9f76-6a27d93b7a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.262123 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04505b31-9f49-45ee-9f76-6a27d93b7a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.263091 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04505b31-9f49-45ee-9f76-6a27d93b7a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:45.264566 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cba3aa-158a-4f68-a324-7be832653090 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:45.265486 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04505b31-9f49-45ee-9f76-6a27d93b7a7f admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:45.284435 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 958/1910] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:45.285523 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04505b31-9f49-45ee-9f76-6a27d93b7a7f admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:45.299584 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04505b31-9f49-45ee-9f76-6a27d93b7a7f admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:45.303488 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 953/1911] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:45 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:45.309007 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cba3aa-158a-4f68-a324-7be832653090 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:45.392649 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24fb03-cba5-4790-87e8-9896df263f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:45.393616 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24fb03-cba5-4790-87e8-9896df263f72 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.394717 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24fb03-cba5-4790-87e8-9896df263f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.395728 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb24fb03-cba5-4790-87e8-9896df263f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.396473 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24fb03-cba5-4790-87e8-9896df263f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:45.398135 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb24fb03-cba5-4790-87e8-9896df263f72 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:45.411556 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 959/1912] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:45.415924 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24fb03-cba5-4790-87e8-9896df263f72 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:45.422028 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cba3aa-158a-4f68-a324-7be832653090 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:45.428450 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42793e2f-bf6c-43a0-959a-06f2accb6f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:45.429563 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42793e2f-bf6c-43a0-959a-06f2accb6f0c admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.430042 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42793e2f-bf6c-43a0-959a-06f2accb6f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.430508 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42793e2f-bf6c-43a0-959a-06f2accb6f0c admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.431579 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42793e2f-bf6c-43a0-959a-06f2accb6f0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:45.433701 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42793e2f-bf6c-43a0-959a-06f2accb6f0c admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:45.444645 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb24fb03-cba5-4790-87e8-9896df263f72 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:45.456595 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c1897-1be6-469d-b867-f877b6bc7000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:45.459354 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c1897-1be6-469d-b867-f877b6bc7000 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.459640 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c1897-1be6-469d-b867-f877b6bc7000 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.460004 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c1897-1be6-469d-b867-f877b6bc7000 admin admin] PATH_INFO: `/v3/projects/dfefeca9da9b443ca76f50f7dc4c1ee2/users/dd134d128142491aa8ae2b587c9d197d/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.467482 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 954/1913] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:45 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:45.472242 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42793e2f-bf6c-43a0-959a-06f2accb6f0c admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:45.487751 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c1897-1be6-469d-b867-f877b6bc7000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfefeca9da9b443ca76f50f7dc4c1ee2, user_id=dd134d128142491aa8ae2b587c9d197d, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:45.490705 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c1897-1be6-469d-b867-f877b6bc7000 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:45.497214 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42793e2f-bf6c-43a0-959a-06f2accb6f0c admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:45.517544 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47f10d-7899-4314-b85d-d5a7b39628ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:45.517544 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47f10d-7899-4314-b85d-d5a7b39628ae admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.517544 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47f10d-7899-4314-b85d-d5a7b39628ae admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.517544 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47f10d-7899-4314-b85d-d5a7b39628ae admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.517974 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47f10d-7899-4314-b85d-d5a7b39628ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:45.517974 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad47f10d-7899-4314-b85d-d5a7b39628ae admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:45.525212 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 960/1914] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:45 2022] PUT /identity/v3/projects/dfefeca9da9b443ca76f50f7dc4c1ee2/users/dd134d128142491aa8ae2b587c9d197d/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:45.535963 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44353f48-2e2f-430e-93b8-dc1ce25cf685 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.536567 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44353f48-2e2f-430e-93b8-dc1ce25cf685 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.537772 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44353f48-2e2f-430e-93b8-dc1ce25cf685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.541067 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 955/1915] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:52:45.552885 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47f10d-7899-4314-b85d-d5a7b39628ae admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:45.575519 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47f10d-7899-4314-b85d-d5a7b39628ae admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:45.582095 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-44353f48-2e2f-430e-93b8-dc1ce25cf685 None None] MFA Rules not processed for user `dd134d128142491aa8ae2b587c9d197d`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:45.583543 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-44353f48-2e2f-430e-93b8-dc1ce25cf685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:45.698177 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 961/1916] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:45.702256 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44353f48-2e2f-430e-93b8-dc1ce25cf685 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:45.705196 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf8166-46c4-4acc-9a3b-4002322d2f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:45.706679 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf8166-46c4-4acc-9a3b-4002322d2f3e admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.707021 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf8166-46c4-4acc-9a3b-4002322d2f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.707360 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf8166-46c4-4acc-9a3b-4002322d2f3e admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.708153 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf8166-46c4-4acc-9a3b-4002322d2f3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:45.709885 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf8166-46c4-4acc-9a3b-4002322d2f3e admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:45.717014 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44353f48-2e2f-430e-93b8-dc1ce25cf685 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:45.722715 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9085b-e4bc-47ac-bc5d-7a04ce5099ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:45.723604 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9085b-e4bc-47ac-bc5d-7a04ce5099ea admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.724258 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9085b-e4bc-47ac-bc5d-7a04ce5099ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.724841 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9085b-e4bc-47ac-bc5d-7a04ce5099ea admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.726533 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9085b-e4bc-47ac-bc5d-7a04ce5099ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:45.731086 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9085b-e4bc-47ac-bc5d-7a04ce5099ea admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:45.746033 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 956/1917] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:45.747603 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf8166-46c4-4acc-9a3b-4002322d2f3e admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:45.771678 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf8166-46c4-4acc-9a3b-4002322d2f3e admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:45.776403 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 962/1918] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:45 2022] POST /identity/v3/projects => generated 383 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:45.777799 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9085b-e4bc-47ac-bc5d-7a04ce5099ea admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:45.864251 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18037df9-4d1f-4fbe-87a0-10f314ba6f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:45.865815 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18037df9-4d1f-4fbe-87a0-10f314ba6f0a admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.866149 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18037df9-4d1f-4fbe-87a0-10f314ba6f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.866430 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18037df9-4d1f-4fbe-87a0-10f314ba6f0a admin admin] PATH_INFO: `/v3/projects/d81981dcbeb54d408c8901247a6a1f74/users/82f67887df014f9fafb1370573bdcd13/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.877667 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9085b-e4bc-47ac-bc5d-7a04ce5099ea admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:45.884159 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72376d33-ec77-4853-86d4-4715e058f373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:45.884427 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18037df9-4d1f-4fbe-87a0-10f314ba6f0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d81981dcbeb54d408c8901247a6a1f74, user_id=82f67887df014f9fafb1370573bdcd13, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:45.884875 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72376d33-ec77-4853-86d4-4715e058f373 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.885151 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72376d33-ec77-4853-86d4-4715e058f373 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.885454 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72376d33-ec77-4853-86d4-4715e058f373 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.886139 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72376d33-ec77-4853-86d4-4715e058f373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:45.887591 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18037df9-4d1f-4fbe-87a0-10f314ba6f0a admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:45.888025 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72376d33-ec77-4853-86d4-4715e058f373 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:45.904151 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 957/1919] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:45 2022] PUT /identity/v3/projects/d81981dcbeb54d408c8901247a6a1f74/users/82f67887df014f9fafb1370573bdcd13/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:45.915755 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa2001-7478-476a-95e7-27267b329943 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:45.916134 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa2001-7478-476a-95e7-27267b329943 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:45.916473 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa2001-7478-476a-95e7-27267b329943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:45.919804 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 963/1920] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:45 2022] POST /identity/v3/users => generated 298 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:45.923371 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72376d33-ec77-4853-86d4-4715e058f373 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:45.934144 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72376d33-ec77-4853-86d4-4715e058f373 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:45.952033 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-78aa2001-7478-476a-95e7-27267b329943 None None] MFA Rules not processed for user `82f67887df014f9fafb1370573bdcd13`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:45.953485 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-78aa2001-7478-476a-95e7-27267b329943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:46.001984 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940170d-49cd-4c40-a144-0f57ca1c70fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:46.003006 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940170d-49cd-4c40-a144-0f57ca1c70fa admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:46.003208 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940170d-49cd-4c40-a144-0f57ca1c70fa admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:46.003483 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940170d-49cd-4c40-a144-0f57ca1c70fa admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:46.004227 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940170d-49cd-4c40-a144-0f57ca1c70fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:46.010271 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940170d-49cd-4c40-a144-0f57ca1c70fa admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:46.027559 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 964/1921] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:52:46.031859 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940170d-49cd-4c40-a144-0f57ca1c70fa admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:46.035022 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 958/1922] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:46.040195 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa2001-7478-476a-95e7-27267b329943 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:46.046927 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940170d-49cd-4c40-a144-0f57ca1c70fa admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:46.052965 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035f63e-a081-4527-a2af-e6bba1a6dabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:46.053986 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035f63e-a081-4527-a2af-e6bba1a6dabe admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:46.054353 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035f63e-a081-4527-a2af-e6bba1a6dabe admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:46.054696 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4035f63e-a081-4527-a2af-e6bba1a6dabe admin admin] PATH_INFO: `/v3/projects/a780458a624a407ab005dbad47cbd596/users/a1fda66f18e94055a5e772c6d6bdabe1/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:46.055828 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa2001-7478-476a-95e7-27267b329943 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:46.065959 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9f184-8342-4723-94ca-68ba701cb72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:46.067026 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9f184-8342-4723-94ca-68ba701cb72b admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:46.067626 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9f184-8342-4723-94ca-68ba701cb72b admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:46.067940 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9f184-8342-4723-94ca-68ba701cb72b admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:46.068716 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9f184-8342-4723-94ca-68ba701cb72b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:46.071618 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9f184-8342-4723-94ca-68ba701cb72b admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:46.072364 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035f63e-a081-4527-a2af-e6bba1a6dabe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a780458a624a407ab005dbad47cbd596, user_id=a1fda66f18e94055a5e772c6d6bdabe1, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:46.075497 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4035f63e-a081-4527-a2af-e6bba1a6dabe admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:46.104818 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 965/1923] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:46 2022] PUT /identity/v3/projects/a780458a624a407ab005dbad47cbd596/users/a1fda66f18e94055a5e772c6d6bdabe1/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:52:46.109935 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 959/1924] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:46 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:46.111867 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9f184-8342-4723-94ca-68ba701cb72b admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:46.113909 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035f63e-a081-4527-a2af-e6bba1a6dabe admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:46.173327 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9f184-8342-4723-94ca-68ba701cb72b admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:46.178133 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53eebf-25fc-4d59-8061-2e63c5d193e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:46.178811 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53eebf-25fc-4d59-8061-2e63c5d193e9 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:46.179093 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53eebf-25fc-4d59-8061-2e63c5d193e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:46.179363 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53eebf-25fc-4d59-8061-2e63c5d193e9 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:46.180058 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53eebf-25fc-4d59-8061-2e63c5d193e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:46.182165 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53eebf-25fc-4d59-8061-2e63c5d193e9 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:46.184771 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4035f63e-a081-4527-a2af-e6bba1a6dabe admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:46.189929 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757185d-f322-4d6c-a281-79b4d676bd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:46.190687 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757185d-f322-4d6c-a281-79b4d676bd82 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:46.191227 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757185d-f322-4d6c-a281-79b4d676bd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:46.191452 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7757185d-f322-4d6c-a281-79b4d676bd82 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:46.192185 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757185d-f322-4d6c-a281-79b4d676bd82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:46.194666 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7757185d-f322-4d6c-a281-79b4d676bd82 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:46.203982 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 960/1925] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:46 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:52:46.205620 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 966/1926] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:52:46.208231 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53eebf-25fc-4d59-8061-2e63c5d193e9 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:46.210020 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757185d-f322-4d6c-a281-79b4d676bd82 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:46.218024 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53eebf-25fc-4d59-8061-2e63c5d193e9 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:46.219664 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7757185d-f322-4d6c-a281-79b4d676bd82 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:46.222704 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188dcd2-b93d-46ca-8f9f-33a01858c33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:46.223375 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188dcd2-b93d-46ca-8f9f-33a01858c33b admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:46.223656 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188dcd2-b93d-46ca-8f9f-33a01858c33b admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:46.223925 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a188dcd2-b93d-46ca-8f9f-33a01858c33b admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:46.224370 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24593a9e-c455-4dd6-a9d4-1ebdccfc9cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:46.224687 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188dcd2-b93d-46ca-8f9f-33a01858c33b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:46.225253 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24593a9e-c455-4dd6-a9d4-1ebdccfc9cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:46.225567 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24593a9e-c455-4dd6-a9d4-1ebdccfc9cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:46.225840 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24593a9e-c455-4dd6-a9d4-1ebdccfc9cc8 admin admin] PATH_INFO: `/v3/projects/a780458a624a407ab005dbad47cbd596/users/a1fda66f18e94055a5e772c6d6bdabe1/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:46.226306 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a188dcd2-b93d-46ca-8f9f-33a01858c33b admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:46.227876 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24593a9e-c455-4dd6-a9d4-1ebdccfc9cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a780458a624a407ab005dbad47cbd596, user_id=a1fda66f18e94055a5e772c6d6bdabe1, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:46.230674 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24593a9e-c455-4dd6-a9d4-1ebdccfc9cc8 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:46.236779 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 961/1927] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:46.240778 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188dcd2-b93d-46ca-8f9f-33a01858c33b admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:46.255075 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 967/1928] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:46 2022] PUT /identity/v3/projects/a780458a624a407ab005dbad47cbd596/users/a1fda66f18e94055a5e772c6d6bdabe1/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:46.255262 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a188dcd2-b93d-46ca-8f9f-33a01858c33b admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:46.257028 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99795d1-d3c7-4860-b5cc-1f22c2931437 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:46.257502 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99795d1-d3c7-4860-b5cc-1f22c2931437 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:46.258345 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99795d1-d3c7-4860-b5cc-1f22c2931437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:46.290034 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-b99795d1-d3c7-4860-b5cc-1f22c2931437 None None] MFA Rules not processed for user `a1fda66f18e94055a5e772c6d6bdabe1`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:46.291309 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-b99795d1-d3c7-4860-b5cc-1f22c2931437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:46.312896 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a9977-1e56-4eb0-8438-986d0ce719e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:46.313830 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a9977-1e56-4eb0-8438-986d0ce719e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:46.314108 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a9977-1e56-4eb0-8438-986d0ce719e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:46.314389 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a9977-1e56-4eb0-8438-986d0ce719e3 admin admin] PATH_INFO: `/v3/projects/068281cf53334c499f302d973e0898b1/users/75da46e7e0d04849bd46c2f0526d45b0/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:46.328894 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a9977-1e56-4eb0-8438-986d0ce719e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=068281cf53334c499f302d973e0898b1, user_id=75da46e7e0d04849bd46c2f0526d45b0, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:46.331911 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a9977-1e56-4eb0-8438-986d0ce719e3 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:46.345963 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 962/1929] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:46 2022] PUT /identity/v3/projects/068281cf53334c499f302d973e0898b1/users/75da46e7e0d04849bd46c2f0526d45b0/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:46.349822 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a9977-1e56-4eb0-8438-986d0ce719e3 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:46.360269 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 968/1930] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:46.371125 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99795d1-d3c7-4860-b5cc-1f22c2931437 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:46.372511 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-b99795d1-d3c7-4860-b5cc-1f22c2931437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:46.415319 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a9977-1e56-4eb0-8438-986d0ce719e3 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:46.420752 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f183fc4-f45a-43ca-afbc-d03d30ed26f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:46.421521 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f183fc4-f45a-43ca-afbc-d03d30ed26f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:46.421799 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f183fc4-f45a-43ca-afbc-d03d30ed26f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:46.422071 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f183fc4-f45a-43ca-afbc-d03d30ed26f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:46.422809 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f183fc4-f45a-43ca-afbc-d03d30ed26f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:46.424444 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f183fc4-f45a-43ca-afbc-d03d30ed26f3 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:46.435804 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 963/1931] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:52:46.438056 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99795d1-d3c7-4860-b5cc-1f22c2931437 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:46.439965 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f183fc4-f45a-43ca-afbc-d03d30ed26f3 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:46.450311 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f183fc4-f45a-43ca-afbc-d03d30ed26f3 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:46.457119 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67909351-f876-4ebe-a66f-7bbff7fe9c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:46.458922 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67909351-f876-4ebe-a66f-7bbff7fe9c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:46.459181 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67909351-f876-4ebe-a66f-7bbff7fe9c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:46.459643 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67909351-f876-4ebe-a66f-7bbff7fe9c3d admin admin] PATH_INFO: `/v3/projects/068281cf53334c499f302d973e0898b1/users/75da46e7e0d04849bd46c2f0526d45b0/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:46.463265 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67909351-f876-4ebe-a66f-7bbff7fe9c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=068281cf53334c499f302d973e0898b1, user_id=75da46e7e0d04849bd46c2f0526d45b0, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:46.466375 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67909351-f876-4ebe-a66f-7bbff7fe9c3d admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:46.478621 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 964/1932] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:46 2022] PUT /identity/v3/projects/068281cf53334c499f302d973e0898b1/users/75da46e7e0d04849bd46c2f0526d45b0/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:52:46.488414 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5010d68-2147-480a-95d0-aad691671c85 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:46.488704 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5010d68-2147-480a-95d0-aad691671c85 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:46.488980 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5010d68-2147-480a-95d0-aad691671c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:46.494635 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5464cc-f557-4ff3-912b-367d3467fef7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:46.495421 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5464cc-f557-4ff3-912b-367d3467fef7 service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:46.495793 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5464cc-f557-4ff3-912b-367d3467fef7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:46.496160 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5464cc-f557-4ff3-912b-367d3467fef7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:46.518521 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-f5010d68-2147-480a-95d0-aad691671c85 None None] MFA Rules not processed for user `75da46e7e0d04849bd46c2f0526d45b0`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:46.519856 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f5010d68-2147-480a-95d0-aad691671c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:46.563573 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5464cc-f557-4ff3-912b-367d3467fef7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:46.565034 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5464cc-f557-4ff3-912b-367d3467fef7 service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:46.575102 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 969/1933] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:46.592687 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 965/1934] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:46.605407 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5464cc-f557-4ff3-912b-367d3467fef7 service cinder] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:46.615384 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5464cc-f557-4ff3-912b-367d3467fef7 service cinder] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:46.673385 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd3015-0b6c-4950-8a21-f959dafcfdc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:46.674191 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd3015-0b6c-4950-8a21-f959dafcfdc6 service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:46.674474 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd3015-0b6c-4950-8a21-f959dafcfdc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:46.674769 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd3015-0b6c-4950-8a21-f959dafcfdc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:46.676100 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5010d68-2147-480a-95d0-aad691671c85 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:46.677618 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f5010d68-2147-480a-95d0-aad691671c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:46.688926 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5010d68-2147-480a-95d0-aad691671c85 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:46.692616 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea916303-179d-4bd2-8b49-d07804a4139a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:46.693256 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea916303-179d-4bd2-8b49-d07804a4139a service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:46.693567 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea916303-179d-4bd2-8b49-d07804a4139a service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:46.693854 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea916303-179d-4bd2-8b49-d07804a4139a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:46.731632 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd3015-0b6c-4950-8a21-f959dafcfdc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:46.733163 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd3015-0b6c-4950-8a21-f959dafcfdc6 service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:46.742096 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 970/1935] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:46.748419 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea916303-179d-4bd2-8b49-d07804a4139a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:46.749912 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea916303-179d-4bd2-8b49-d07804a4139a service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:46.758782 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 966/1936] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:52:52.591440 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd3015-0b6c-4950-8a21-f959dafcfdc6 service cinder] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:52.653406 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd3015-0b6c-4950-8a21-f959dafcfdc6 service cinder] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:52.659118 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55809392-4ce5-4e9e-9d98-53d9055b6bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:52.660037 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55809392-4ce5-4e9e-9d98-53d9055b6bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:52.660262 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55809392-4ce5-4e9e-9d98-53d9055b6bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:52.660536 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55809392-4ce5-4e9e-9d98-53d9055b6bcc admin admin] PATH_INFO: `/v3/users/dd134d128142491aa8ae2b587c9d197d` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:52.661857 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55809392-4ce5-4e9e-9d98-53d9055b6bcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd134d128142491aa8ae2b587c9d197d)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:52.663915 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55809392-4ce5-4e9e-9d98-53d9055b6bcc admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:52.676728 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea916303-179d-4bd2-8b49-d07804a4139a service cinder] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:52.690188 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea916303-179d-4bd2-8b49-d07804a4139a service cinder] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:52.695800 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5599c8b2-ece9-4ea2-b9d0-9a10b7291ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:52.696835 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599c8b2-ece9-4ea2-b9d0-9a10b7291ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:52.697143 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599c8b2-ece9-4ea2-b9d0-9a10b7291ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:52.697400 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5599c8b2-ece9-4ea2-b9d0-9a10b7291ba3 admin admin] PATH_INFO: `/v3/users/82f67887df014f9fafb1370573bdcd13` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:52.698712 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5599c8b2-ece9-4ea2-b9d0-9a10b7291ba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82f67887df014f9fafb1370573bdcd13)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:52.701049 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5599c8b2-ece9-4ea2-b9d0-9a10b7291ba3 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:52.743676 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-55809392-4ce5-4e9e-9d98-53d9055b6bcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd134d128142491aa8ae2b587c9d197d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:52.744376 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-55809392-4ce5-4e9e-9d98-53d9055b6bcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd134d128142491aa8ae2b587c9d197d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:52.757903 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-55809392-4ce5-4e9e-9d98-53d9055b6bcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd134d128142491aa8ae2b587c9d197d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:52.768209 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-55809392-4ce5-4e9e-9d98-53d9055b6bcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd134d128142491aa8ae2b587c9d197d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:52.770590 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-5599c8b2-ece9-4ea2-b9d0-9a10b7291ba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82f67887df014f9fafb1370573bdcd13'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:52.771606 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-5599c8b2-ece9-4ea2-b9d0-9a10b7291ba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82f67887df014f9fafb1370573bdcd13'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:52.780592 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-55809392-4ce5-4e9e-9d98-53d9055b6bcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd134d128142491aa8ae2b587c9d197d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:52.781671 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-5599c8b2-ece9-4ea2-b9d0-9a10b7291ba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82f67887df014f9fafb1370573bdcd13'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:52.789403 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 971/1937] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:52 2022] DELETE /identity/v3/users/dd134d128142491aa8ae2b587c9d197d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:52.793859 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031e84e-cab3-45a6-b8ca-e2035a8d5a4f None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:52.794496 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031e84e-cab3-45a6-b8ca-e2035a8d5a4f None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:52.794688 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031e84e-cab3-45a6-b8ca-e2035a8d5a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:52.796690 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-5599c8b2-ece9-4ea2-b9d0-9a10b7291ba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82f67887df014f9fafb1370573bdcd13'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:52.804628 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-5599c8b2-ece9-4ea2-b9d0-9a10b7291ba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82f67887df014f9fafb1370573bdcd13'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:52.811710 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 967/1938] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:52 2022] DELETE /identity/v3/users/82f67887df014f9fafb1370573bdcd13 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:52:52.816676 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38053ea-edb7-4ec2-a17f-5165236009e4 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:52.817039 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38053ea-edb7-4ec2-a17f-5165236009e4 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:52.817292 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38053ea-edb7-4ec2-a17f-5165236009e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:52.828042 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-3031e84e-cab3-45a6-b8ca-e2035a8d5a4f None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:52.832646 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-3031e84e-cab3-45a6-b8ca-e2035a8d5a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:52.838312 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-f38053ea-edb7-4ec2-a17f-5165236009e4 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:52.839597 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f38053ea-edb7-4ec2-a17f-5165236009e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:52.945747 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 968/1939] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:52.959074 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38053ea-edb7-4ec2-a17f-5165236009e4 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:52.960508 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f38053ea-edb7-4ec2-a17f-5165236009e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:52.978725 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 972/1940] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:52.988154 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031e84e-cab3-45a6-b8ca-e2035a8d5a4f None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:52.990886 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-3031e84e-cab3-45a6-b8ca-e2035a8d5a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:53.045575 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38053ea-edb7-4ec2-a17f-5165236009e4 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:53.058344 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a0449-57ef-4ac1-aff7-1da627eb58a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:53.059323 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a0449-57ef-4ac1-aff7-1da627eb58a4 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:53.059674 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a0449-57ef-4ac1-aff7-1da627eb58a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:53.060020 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a0449-57ef-4ac1-aff7-1da627eb58a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:53.075823 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a0449-57ef-4ac1-aff7-1da627eb58a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:53.077879 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a0449-57ef-4ac1-aff7-1da627eb58a4 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:53.094409 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 969/1941] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:53.112103 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031e84e-cab3-45a6-b8ca-e2035a8d5a4f None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:53.117495 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62fa0a-9750-4fa2-8f0a-f56d73993f24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:53.118603 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62fa0a-9750-4fa2-8f0a-f56d73993f24 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:53.118951 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62fa0a-9750-4fa2-8f0a-f56d73993f24 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:53.119434 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62fa0a-9750-4fa2-8f0a-f56d73993f24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:53.133785 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62fa0a-9750-4fa2-8f0a-f56d73993f24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:53.135496 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62fa0a-9750-4fa2-8f0a-f56d73993f24 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:53.158265 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 973/1942] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:53.860132 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a0449-57ef-4ac1-aff7-1da627eb58a4 service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:53.861898 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-011a0449-57ef-4ac1-aff7-1da627eb58a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:53.876555 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a0449-57ef-4ac1-aff7-1da627eb58a4 service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:53.882339 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c07400-a000-44db-b32b-3332e18c5542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:53.883211 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c07400-a000-44db-b32b-3332e18c5542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:53.883503 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c07400-a000-44db-b32b-3332e18c5542 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:53.883793 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c07400-a000-44db-b32b-3332e18c5542 admin admin] PATH_INFO: `/v3/projects/d81981dcbeb54d408c8901247a6a1f74` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:53.885445 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c07400-a000-44db-b32b-3332e18c5542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d81981dcbeb54d408c8901247a6a1f74)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:53.887359 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c07400-a000-44db-b32b-3332e18c5542 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:53.961011 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-f3c07400-a000-44db-b32b-3332e18c5542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd81981dcbeb54d408c8901247a6a1f74', 'request_id': 'req-f3c07400-a000-44db-b32b-3332e18c5542'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:53.968227 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-f3c07400-a000-44db-b32b-3332e18c5542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd81981dcbeb54d408c8901247a6a1f74', 'request_id': 'req-f3c07400-a000-44db-b32b-3332e18c5542'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:53.981770 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-f3c07400-a000-44db-b32b-3332e18c5542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd81981dcbeb54d408c8901247a6a1f74', 'request_id': 'req-f3c07400-a000-44db-b32b-3332e18c5542'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:53.994620 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-f3c07400-a000-44db-b32b-3332e18c5542 admin admin] The token cache is being invalidate because project d81981dcbeb54d408c8901247a6a1f74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:53.995028 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-f3c07400-a000-44db-b32b-3332e18c5542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:53.995834 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-f3c07400-a000-44db-b32b-3332e18c5542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:53.998052 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 970/1943] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:53 2022] DELETE /identity/v3/projects/d81981dcbeb54d408c8901247a6a1f74 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:54.001930 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62fa0a-9750-4fa2-8f0a-f56d73993f24 service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:54.019134 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62fa0a-9750-4fa2-8f0a-f56d73993f24 service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:54.039748 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c07400-a000-44db-b32b-3332e18c5542 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:54.041398 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f3c07400-a000-44db-b32b-3332e18c5542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:54.111415 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c07400-a000-44db-b32b-3332e18c5542 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:54.116414 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251f892-f135-4016-9fa0-e9c905d94a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:54.117293 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251f892-f135-4016-9fa0-e9c905d94a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:54.117601 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251f892-f135-4016-9fa0-e9c905d94a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:54.117873 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251f892-f135-4016-9fa0-e9c905d94a3b admin admin] PATH_INFO: `/v3/projects/dfefeca9da9b443ca76f50f7dc4c1ee2` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:54.119067 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251f892-f135-4016-9fa0-e9c905d94a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfefeca9da9b443ca76f50f7dc4c1ee2)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:54.120974 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251f892-f135-4016-9fa0-e9c905d94a3b admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:54.130721 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053d849-0c2f-4de0-8f04-0a97230fa054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:54.131692 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053d849-0c2f-4de0-8f04-0a97230fa054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:54.132115 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053d849-0c2f-4de0-8f04-0a97230fa054 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:54.132387 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053d849-0c2f-4de0-8f04-0a97230fa054 admin admin] PATH_INFO: `/v3/users/75da46e7e0d04849bd46c2f0526d45b0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:54.135333 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053d849-0c2f-4de0-8f04-0a97230fa054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75da46e7e0d04849bd46c2f0526d45b0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:54.137391 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053d849-0c2f-4de0-8f04-0a97230fa054 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:54.182732 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-7251f892-f135-4016-9fa0-e9c905d94a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfefeca9da9b443ca76f50f7dc4c1ee2', 'request_id': 'req-7251f892-f135-4016-9fa0-e9c905d94a3b'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:54.193803 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-7251f892-f135-4016-9fa0-e9c905d94a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfefeca9da9b443ca76f50f7dc4c1ee2', 'request_id': 'req-7251f892-f135-4016-9fa0-e9c905d94a3b'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:54.203587 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-d053d849-0c2f-4de0-8f04-0a97230fa054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75da46e7e0d04849bd46c2f0526d45b0'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:54.204450 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-d053d849-0c2f-4de0-8f04-0a97230fa054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75da46e7e0d04849bd46c2f0526d45b0'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:54.205005 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-7251f892-f135-4016-9fa0-e9c905d94a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfefeca9da9b443ca76f50f7dc4c1ee2', 'request_id': 'req-7251f892-f135-4016-9fa0-e9c905d94a3b'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:54.217803 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-d053d849-0c2f-4de0-8f04-0a97230fa054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75da46e7e0d04849bd46c2f0526d45b0'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:54.219679 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-7251f892-f135-4016-9fa0-e9c905d94a3b admin admin] The token cache is being invalidate because project dfefeca9da9b443ca76f50f7dc4c1ee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:54.220531 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-7251f892-f135-4016-9fa0-e9c905d94a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:54.221535 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-7251f892-f135-4016-9fa0-e9c905d94a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:54.226287 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 971/1944] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:54 2022] DELETE /identity/v3/projects/dfefeca9da9b443ca76f50f7dc4c1ee2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:54.227425 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251f892-f135-4016-9fa0-e9c905d94a3b admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:54.228185 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-d053d849-0c2f-4de0-8f04-0a97230fa054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75da46e7e0d04849bd46c2f0526d45b0'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:54.231196 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-7251f892-f135-4016-9fa0-e9c905d94a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:54.242406 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-d053d849-0c2f-4de0-8f04-0a97230fa054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75da46e7e0d04849bd46c2f0526d45b0'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:54.251381 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 974/1945] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:54 2022] DELETE /identity/v3/users/75da46e7e0d04849bd46c2f0526d45b0 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:54.310520 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251f892-f135-4016-9fa0-e9c905d94a3b admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:54.371271 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bd5f9-dad3-47e7-9519-f3ce55109e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:54.372323 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bd5f9-dad3-47e7-9519-f3ce55109e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:54.372579 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bd5f9-dad3-47e7-9519-f3ce55109e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:54.372921 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bd5f9-dad3-47e7-9519-f3ce55109e2b admin admin] PATH_INFO: `/v3/users/a1fda66f18e94055a5e772c6d6bdabe1` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:54.374292 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bd5f9-dad3-47e7-9519-f3ce55109e2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1fda66f18e94055a5e772c6d6bdabe1)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:54.376258 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bd5f9-dad3-47e7-9519-f3ce55109e2b admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:54.433793 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-3d0bd5f9-dad3-47e7-9519-f3ce55109e2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1fda66f18e94055a5e772c6d6bdabe1'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:54.434822 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-3d0bd5f9-dad3-47e7-9519-f3ce55109e2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1fda66f18e94055a5e772c6d6bdabe1'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:54.447109 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-3d0bd5f9-dad3-47e7-9519-f3ce55109e2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1fda66f18e94055a5e772c6d6bdabe1'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:54.458696 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-3d0bd5f9-dad3-47e7-9519-f3ce55109e2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1fda66f18e94055a5e772c6d6bdabe1'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:54.471203 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-3d0bd5f9-dad3-47e7-9519-f3ce55109e2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1fda66f18e94055a5e772c6d6bdabe1'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:54.481980 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 972/1946] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:52:54 2022] DELETE /identity/v3/users/a1fda66f18e94055a5e772c6d6bdabe1 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:55.144080 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053d849-0c2f-4de0-8f04-0a97230fa054 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:55.165522 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bd5f9-dad3-47e7-9519-f3ce55109e2b admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:55.167330 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-d053d849-0c2f-4de0-8f04-0a97230fa054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:55.168297 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-3d0bd5f9-dad3-47e7-9519-f3ce55109e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:55.195676 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053d849-0c2f-4de0-8f04-0a97230fa054 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:55.285737 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bd5f9-dad3-47e7-9519-f3ce55109e2b admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:55.290623 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf666b36-f6db-4123-983d-861db90e3923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:55.291144 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bf827-457b-4faa-bb4d-ecadca424fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:55.291498 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf666b36-f6db-4123-983d-861db90e3923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.291777 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf666b36-f6db-4123-983d-861db90e3923 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.292095 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf666b36-f6db-4123-983d-861db90e3923 admin admin] PATH_INFO: `/v3/projects/a780458a624a407ab005dbad47cbd596` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.293289 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf666b36-f6db-4123-983d-861db90e3923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a780458a624a407ab005dbad47cbd596)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:55.293950 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bf827-457b-4faa-bb4d-ecadca424fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.294507 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bf827-457b-4faa-bb4d-ecadca424fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.294980 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bf827-457b-4faa-bb4d-ecadca424fbb admin admin] PATH_INFO: `/v3/projects/068281cf53334c499f302d973e0898b1` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.295500 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf666b36-f6db-4123-983d-861db90e3923 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:55.297399 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94bf827-457b-4faa-bb4d-ecadca424fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=068281cf53334c499f302d973e0898b1)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:55.299715 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94bf827-457b-4faa-bb4d-ecadca424fbb admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:55.356155 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-bf666b36-f6db-4123-983d-861db90e3923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a780458a624a407ab005dbad47cbd596', 'request_id': 'req-bf666b36-f6db-4123-983d-861db90e3923'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:55.365173 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-bf666b36-f6db-4123-983d-861db90e3923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a780458a624a407ab005dbad47cbd596', 'request_id': 'req-bf666b36-f6db-4123-983d-861db90e3923'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:55.366962 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-d94bf827-457b-4faa-bb4d-ecadca424fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '068281cf53334c499f302d973e0898b1', 'request_id': 'req-d94bf827-457b-4faa-bb4d-ecadca424fbb'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:55.375710 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-d94bf827-457b-4faa-bb4d-ecadca424fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '068281cf53334c499f302d973e0898b1', 'request_id': 'req-d94bf827-457b-4faa-bb4d-ecadca424fbb'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:55.376983 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-bf666b36-f6db-4123-983d-861db90e3923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a780458a624a407ab005dbad47cbd596', 'request_id': 'req-bf666b36-f6db-4123-983d-861db90e3923'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:55.386378 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-d94bf827-457b-4faa-bb4d-ecadca424fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '068281cf53334c499f302d973e0898b1', 'request_id': 'req-d94bf827-457b-4faa-bb4d-ecadca424fbb'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:55.395799 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-bf666b36-f6db-4123-983d-861db90e3923 admin admin] The token cache is being invalidate because project a780458a624a407ab005dbad47cbd596 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:55.396353 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-bf666b36-f6db-4123-983d-861db90e3923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:55.397137 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-bf666b36-f6db-4123-983d-861db90e3923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:55.403272 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 973/1947] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:55 2022] DELETE /identity/v3/projects/a780458a624a407ab005dbad47cbd596 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:55.404477 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-d94bf827-457b-4faa-bb4d-ecadca424fbb admin admin] The token cache is being invalidate because project 068281cf53334c499f302d973e0898b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:52:55.404772 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-d94bf827-457b-4faa-bb4d-ecadca424fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:55.405404 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad43c52-d03a-4825-82ee-8d4a0e7a35bd None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.405683 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-d94bf827-457b-4faa-bb4d-ecadca424fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:52:55.405904 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad43c52-d03a-4825-82ee-8d4a0e7a35bd None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.406551 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad43c52-d03a-4825-82ee-8d4a0e7a35bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.411985 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 975/1948] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:52:55 2022] DELETE /identity/v3/projects/068281cf53334c499f302d973e0898b1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:55.414943 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5472b8-1d9d-48a0-9f68-c873d0d48860 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.415386 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5472b8-1d9d-48a0-9f68-c873d0d48860 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.415828 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5472b8-1d9d-48a0-9f68-c873d0d48860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.427731 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-7ad43c52-d03a-4825-82ee-8d4a0e7a35bd None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:55.429097 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-7ad43c52-d03a-4825-82ee-8d4a0e7a35bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:55.444546 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-de5472b8-1d9d-48a0-9f68-c873d0d48860 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:55.446337 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-de5472b8-1d9d-48a0-9f68-c873d0d48860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:55.549535 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 974/1949] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:55.559287 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 976/1950] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:55.561460 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11b5cc-92ec-4ba6-a884-dad547d6d329 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.562050 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9adc83-b747-4a80-b5a0-d6eb9b6ae6a5 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.562182 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11b5cc-92ec-4ba6-a884-dad547d6d329 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.562345 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9adc83-b747-4a80-b5a0-d6eb9b6ae6a5 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.562618 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9adc83-b747-4a80-b5a0-d6eb9b6ae6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.563018 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b11b5cc-92ec-4ba6-a884-dad547d6d329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.586219 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-2b9adc83-b747-4a80-b5a0-d6eb9b6ae6a5 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:55.587570 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-2b9adc83-b747-4a80-b5a0-d6eb9b6ae6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:55.588697 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-8b11b5cc-92ec-4ba6-a884-dad547d6d329 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:55.590847 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-8b11b5cc-92ec-4ba6-a884-dad547d6d329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:55.599672 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 977/1951] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:55.600854 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9adc83-b747-4a80-b5a0-d6eb9b6ae6a5 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:55.604967 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 975/1952] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:55.609291 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11b5cc-92ec-4ba6-a884-dad547d6d329 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:55.614615 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9adc83-b747-4a80-b5a0-d6eb9b6ae6a5 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:55.619965 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcd6d7-2b08-4d9f-9caa-a046f2c0433c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:55.620472 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcd6d7-2b08-4d9f-9caa-a046f2c0433c admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.620756 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcd6d7-2b08-4d9f-9caa-a046f2c0433c admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.621033 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcd6d7-2b08-4d9f-9caa-a046f2c0433c admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.621838 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afcd6d7-2b08-4d9f-9caa-a046f2c0433c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:55.622148 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afcd6d7-2b08-4d9f-9caa-a046f2c0433c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:55.624196 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afcd6d7-2b08-4d9f-9caa-a046f2c0433c admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:55.626442 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b11b5cc-92ec-4ba6-a884-dad547d6d329 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:55.632894 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6fc5f-d261-4eeb-a549-00415089ec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:55.634146 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6fc5f-d261-4eeb-a549-00415089ec46 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.634908 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6fc5f-d261-4eeb-a549-00415089ec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.635194 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6fc5f-d261-4eeb-a549-00415089ec46 admin admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.636226 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6fc5f-d261-4eeb-a549-00415089ec46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:52:55.636534 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6fc5f-d261-4eeb-a549-00415089ec46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:55.638218 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6fc5f-d261-4eeb-a549-00415089ec46 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:55.640050 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 978/1953] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:52:55.643839 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcd6d7-2b08-4d9f-9caa-a046f2c0433c admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:55.654934 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcd6d7-2b08-4d9f-9caa-a046f2c0433c admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:55.656577 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 976/1954] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:52:55.661255 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6fc5f-d261-4eeb-a549-00415089ec46 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:55.662273 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672d619-0c3b-476c-a714-1407607792bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:55.662942 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672d619-0c3b-476c-a714-1407607792bf admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.663228 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672d619-0c3b-476c-a714-1407607792bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.664990 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672d619-0c3b-476c-a714-1407607792bf admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.669157 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672d619-0c3b-476c-a714-1407607792bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:55.671331 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7672d619-0c3b-476c-a714-1407607792bf admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:55.678631 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6fc5f-d261-4eeb-a549-00415089ec46 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:55.684469 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f598162-5149-4ae4-8385-5bcdbce449d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:55.685256 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f598162-5149-4ae4-8385-5bcdbce449d2 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.685569 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f598162-5149-4ae4-8385-5bcdbce449d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.685905 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f598162-5149-4ae4-8385-5bcdbce449d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.686552 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f598162-5149-4ae4-8385-5bcdbce449d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:55.688437 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f598162-5149-4ae4-8385-5bcdbce449d2 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:55.712235 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 979/1955] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:55 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:55.716735 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672d619-0c3b-476c-a714-1407607792bf admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:55.733044 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 977/1956] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:55 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:55.733445 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f598162-5149-4ae4-8385-5bcdbce449d2 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:55.802292 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7672d619-0c3b-476c-a714-1407607792bf admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:55.810605 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc27139-3822-4207-81a0-f98793e3d321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:55.811917 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc27139-3822-4207-81a0-f98793e3d321 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.811917 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc27139-3822-4207-81a0-f98793e3d321 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.812227 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc27139-3822-4207-81a0-f98793e3d321 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.813371 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f598162-5149-4ae4-8385-5bcdbce449d2 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:55.813645 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc27139-3822-4207-81a0-f98793e3d321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:55.816302 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc27139-3822-4207-81a0-f98793e3d321 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:55.820560 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec44276-5b3f-47e5-af0e-cef3cef79c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:55.821462 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec44276-5b3f-47e5-af0e-cef3cef79c03 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.821753 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec44276-5b3f-47e5-af0e-cef3cef79c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.822031 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec44276-5b3f-47e5-af0e-cef3cef79c03 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.822751 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec44276-5b3f-47e5-af0e-cef3cef79c03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:55.825101 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec44276-5b3f-47e5-af0e-cef3cef79c03 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:55.846858 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 980/1957] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:55 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:55.852007 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc27139-3822-4207-81a0-f98793e3d321 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:55.862420 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 978/1958] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:55 2022] POST /identity/v3/users => generated 286 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:52:55.865203 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc27139-3822-4207-81a0-f98793e3d321 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:55.867350 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec44276-5b3f-47e5-af0e-cef3cef79c03 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:55.872572 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf7866-5c2d-4ecf-8344-3d8903d41b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:55.872899 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf7866-5c2d-4ecf-8344-3d8903d41b2e admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.873270 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf7866-5c2d-4ecf-8344-3d8903d41b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.873674 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf7866-5c2d-4ecf-8344-3d8903d41b2e admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.874806 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf7866-5c2d-4ecf-8344-3d8903d41b2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:55.876341 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf7866-5c2d-4ecf-8344-3d8903d41b2e admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:55.884672 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec44276-5b3f-47e5-af0e-cef3cef79c03 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:55.889235 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 981/1959] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:55.891964 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db855b-f533-4c2a-843e-037ead7be0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:55.892828 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db855b-f533-4c2a-843e-037ead7be0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.893000 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf7866-5c2d-4ecf-8344-3d8903d41b2e admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:55.893476 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db855b-f533-4c2a-843e-037ead7be0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.893896 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db855b-f533-4c2a-843e-037ead7be0e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.895000 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db855b-f533-4c2a-843e-037ead7be0e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:55.896879 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db855b-f533-4c2a-843e-037ead7be0e4 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:55.905452 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf7866-5c2d-4ecf-8344-3d8903d41b2e admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:55.912726 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07668160-5121-4492-b298-5a8d22d592e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:55.913523 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 979/1960] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:55.913639 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07668160-5121-4492-b298-5a8d22d592e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.914011 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07668160-5121-4492-b298-5a8d22d592e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.914374 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07668160-5121-4492-b298-5a8d22d592e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.915687 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07668160-5121-4492-b298-5a8d22d592e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:55.916401 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db855b-f533-4c2a-843e-037ead7be0e4 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:55.917789 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07668160-5121-4492-b298-5a8d22d592e3 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:55.929440 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db855b-f533-4c2a-843e-037ead7be0e4 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:55.933530 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 982/1961] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:52:55.934188 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840eaa44-73fa-4a25-a269-d4d7f1cb15c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:55.934986 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840eaa44-73fa-4a25-a269-d4d7f1cb15c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.935333 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840eaa44-73fa-4a25-a269-d4d7f1cb15c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.935902 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840eaa44-73fa-4a25-a269-d4d7f1cb15c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.936880 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840eaa44-73fa-4a25-a269-d4d7f1cb15c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:55.938565 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840eaa44-73fa-4a25-a269-d4d7f1cb15c5 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:55.939005 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07668160-5121-4492-b298-5a8d22d592e3 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:55.951250 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07668160-5121-4492-b298-5a8d22d592e3 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:55.956835 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c593f2-0ced-459c-b5b8-14a2c6adb232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:55.957515 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 980/1962] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:55.958213 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c593f2-0ced-459c-b5b8-14a2c6adb232 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.958490 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c593f2-0ced-459c-b5b8-14a2c6adb232 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.958756 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c593f2-0ced-459c-b5b8-14a2c6adb232 admin admin] PATH_INFO: `/v3/projects/7b7c23d887ea48609cad5a847ec3aa30/users/a3342c97ac614a7a84a0bbd109647bf5/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.962336 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840eaa44-73fa-4a25-a269-d4d7f1cb15c5 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:55.975982 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c593f2-0ced-459c-b5b8-14a2c6adb232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b7c23d887ea48609cad5a847ec3aa30, user_id=a3342c97ac614a7a84a0bbd109647bf5, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:55.979199 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c593f2-0ced-459c-b5b8-14a2c6adb232 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:55.980398 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840eaa44-73fa-4a25-a269-d4d7f1cb15c5 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:55.986260 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936dd8f-c8fd-4d47-afbb-54c86c6154d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:55.987474 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936dd8f-c8fd-4d47-afbb-54c86c6154d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:55.987836 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936dd8f-c8fd-4d47-afbb-54c86c6154d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:55.988255 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936dd8f-c8fd-4d47-afbb-54c86c6154d1 admin admin] PATH_INFO: `/v3/projects/a86db2a4dc46459abc7da2a15972a423/users/debb126d9cd5472aa8c27d4fe9065b33/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:55.999361 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 983/1963] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:55 2022] PUT /identity/v3/projects/7b7c23d887ea48609cad5a847ec3aa30/users/a3342c97ac614a7a84a0bbd109647bf5/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:56.007488 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936dd8f-c8fd-4d47-afbb-54c86c6154d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a86db2a4dc46459abc7da2a15972a423, user_id=debb126d9cd5472aa8c27d4fe9065b33, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:56.009728 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838512e-1cb4-4d02-9d59-dd6f9c4dca6d None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:56.010016 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838512e-1cb4-4d02-9d59-dd6f9c4dca6d None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:56.010424 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838512e-1cb4-4d02-9d59-dd6f9c4dca6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:56.010821 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936dd8f-c8fd-4d47-afbb-54c86c6154d1 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:56.035064 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 981/1964] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:55 2022] PUT /identity/v3/projects/a86db2a4dc46459abc7da2a15972a423/users/debb126d9cd5472aa8c27d4fe9065b33/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:56.040990 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-a838512e-1cb4-4d02-9d59-dd6f9c4dca6d None None] MFA Rules not processed for user `a3342c97ac614a7a84a0bbd109647bf5`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:56.042407 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-a838512e-1cb4-4d02-9d59-dd6f9c4dca6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:56.045233 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dfc53-ef87-4238-b264-48aec9af0aef None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:56.045616 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dfc53-ef87-4238-b264-48aec9af0aef None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:56.045998 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257dfc53-ef87-4238-b264-48aec9af0aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:56.086604 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-257dfc53-ef87-4238-b264-48aec9af0aef None None] MFA Rules not processed for user `debb126d9cd5472aa8c27d4fe9065b33`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:56.088890 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-257dfc53-ef87-4238-b264-48aec9af0aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:56.175841 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 984/1965] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:56.180019 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838512e-1cb4-4d02-9d59-dd6f9c4dca6d None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:56.192696 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 982/1966] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:52:56.200927 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257dfc53-ef87-4238-b264-48aec9af0aef None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:56.205926 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-257dfc53-ef87-4238-b264-48aec9af0aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:56.246371 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838512e-1cb4-4d02-9d59-dd6f9c4dca6d None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:56.251222 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c906e8-cf81-4663-b1e5-4d1bde39c89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:56.251907 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c906e8-cf81-4663-b1e5-4d1bde39c89a admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:56.252189 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c906e8-cf81-4663-b1e5-4d1bde39c89a admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:56.252958 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c906e8-cf81-4663-b1e5-4d1bde39c89a admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:56.253424 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c906e8-cf81-4663-b1e5-4d1bde39c89a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:56.255431 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c906e8-cf81-4663-b1e5-4d1bde39c89a admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:56.276472 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257dfc53-ef87-4238-b264-48aec9af0aef None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:56.281020 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b4351-97c9-4a1c-bc07-0615414c24d3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b8e066deb49e6b48804cbbe5cd6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:56.281876 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b4351-97c9-4a1c-bc07-0615414c24d3 service glance] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:56.282351 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b4351-97c9-4a1c-bc07-0615414c24d3 service glance] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:56.282469 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b4351-97c9-4a1c-bc07-0615414c24d3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:56.290413 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 985/1967] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:56 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:56.292475 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b4351-97c9-4a1c-bc07-0615414c24d3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:56.294263 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b4351-97c9-4a1c-bc07-0615414c24d3 service glance] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:56.295083 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c906e8-cf81-4663-b1e5-4d1bde39c89a admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:56.316494 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 983/1968] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:52:56.388267 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c906e8-cf81-4663-b1e5-4d1bde39c89a admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:56.394086 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afaff3-4ef7-40d7-b7af-1a4d3b7f2466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:56.394887 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afaff3-4ef7-40d7-b7af-1a4d3b7f2466 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:56.395240 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afaff3-4ef7-40d7-b7af-1a4d3b7f2466 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:56.395586 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afaff3-4ef7-40d7-b7af-1a4d3b7f2466 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:56.396505 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afaff3-4ef7-40d7-b7af-1a4d3b7f2466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:56.398558 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afaff3-4ef7-40d7-b7af-1a4d3b7f2466 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:56.439794 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 986/1969] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:56 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:56.443656 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b4351-97c9-4a1c-bc07-0615414c24d3 service glance] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:56.477189 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b4351-97c9-4a1c-bc07-0615414c24d3 service glance] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:56.486523 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23225b9a-c5cc-4cdb-8d0f-6d846486f3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:56.487372 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23225b9a-c5cc-4cdb-8d0f-6d846486f3ca admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:56.487907 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23225b9a-c5cc-4cdb-8d0f-6d846486f3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:56.488377 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23225b9a-c5cc-4cdb-8d0f-6d846486f3ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:56.489562 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23225b9a-c5cc-4cdb-8d0f-6d846486f3ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:56.493727 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23225b9a-c5cc-4cdb-8d0f-6d846486f3ca admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:56.511260 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 984/1970] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:56.512686 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afaff3-4ef7-40d7-b7af-1a4d3b7f2466 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:56.523311 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afaff3-4ef7-40d7-b7af-1a4d3b7f2466 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:56.529119 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492885f3-08f7-4b66-97f1-081abfc1225f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:56.529872 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492885f3-08f7-4b66-97f1-081abfc1225f admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:56.530148 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492885f3-08f7-4b66-97f1-081abfc1225f admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:56.530420 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492885f3-08f7-4b66-97f1-081abfc1225f admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:56.531147 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492885f3-08f7-4b66-97f1-081abfc1225f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:56.532745 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492885f3-08f7-4b66-97f1-081abfc1225f admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:56.544923 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 987/1971] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:52:56.549315 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23225b9a-c5cc-4cdb-8d0f-6d846486f3ca admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:56.561785 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23225b9a-c5cc-4cdb-8d0f-6d846486f3ca admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:56.568723 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3cc14-ceb0-400d-8b93-7735c8293a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:56.569205 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3cc14-ceb0-400d-8b93-7735c8293a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:56.570410 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3cc14-ceb0-400d-8b93-7735c8293a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:56.570410 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3cc14-ceb0-400d-8b93-7735c8293a24 admin admin] PATH_INFO: `/v3/projects/96d2a2ed803d45acbc6c9e69b62d62fd/users/7bb030ed0e3b424c8f14310fa503cb4a/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:56.595597 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3cc14-ceb0-400d-8b93-7735c8293a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d2a2ed803d45acbc6c9e69b62d62fd, user_id=7bb030ed0e3b424c8f14310fa503cb4a, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:56.599260 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3cc14-ceb0-400d-8b93-7735c8293a24 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:56.624246 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 985/1972] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:56 2022] PUT /identity/v3/projects/96d2a2ed803d45acbc6c9e69b62d62fd/users/7bb030ed0e3b424c8f14310fa503cb4a/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:56.634819 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac7388-ce2e-4eea-8911-03d40ca1663c None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:56.635112 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac7388-ce2e-4eea-8911-03d40ca1663c None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:56.635390 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac7388-ce2e-4eea-8911-03d40ca1663c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:56.690523 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-f3ac7388-ce2e-4eea-8911-03d40ca1663c None None] MFA Rules not processed for user `7bb030ed0e3b424c8f14310fa503cb4a`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:56.691583 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-f3ac7388-ce2e-4eea-8911-03d40ca1663c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:56.807688 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 988/1973] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:56.810815 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3cc14-ceb0-400d-8b93-7735c8293a24 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:56.898876 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3cc14-ceb0-400d-8b93-7735c8293a24 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:56.907553 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eedac8-34e2-4895-91e4-e71109804008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:56.908864 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eedac8-34e2-4895-91e4-e71109804008 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:56.909475 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eedac8-34e2-4895-91e4-e71109804008 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:56.909991 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eedac8-34e2-4895-91e4-e71109804008 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:56.911098 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eedac8-34e2-4895-91e4-e71109804008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:56.914802 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eedac8-34e2-4895-91e4-e71109804008 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:56.957435 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 986/1974] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:52:56 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:56.959309 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac7388-ce2e-4eea-8911-03d40ca1663c None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:56.990384 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac7388-ce2e-4eea-8911-03d40ca1663c None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:57.066867 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f0d94-3801-49a1-a50c-49772d08da20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:57.067737 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f0d94-3801-49a1-a50c-49772d08da20 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:57.068024 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f0d94-3801-49a1-a50c-49772d08da20 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:57.068300 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f0d94-3801-49a1-a50c-49772d08da20 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:57.069074 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f0d94-3801-49a1-a50c-49772d08da20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:57.071094 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f0d94-3801-49a1-a50c-49772d08da20 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:57.095921 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 989/1975] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:52:56 2022] POST /identity/v3/users => generated 296 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:52:57.099828 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eedac8-34e2-4895-91e4-e71109804008 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:57.110176 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eedac8-34e2-4895-91e4-e71109804008 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:57.115004 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01b3db-f36d-47fd-930f-26531a0dc95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:57.115741 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01b3db-f36d-47fd-930f-26531a0dc95a admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:57.116085 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01b3db-f36d-47fd-930f-26531a0dc95a admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:57.116443 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab01b3db-f36d-47fd-930f-26531a0dc95a admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:57.117242 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01b3db-f36d-47fd-930f-26531a0dc95a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:57.118997 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab01b3db-f36d-47fd-930f-26531a0dc95a admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:57.130242 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 987/1976] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:52:57.134452 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f0d94-3801-49a1-a50c-49772d08da20 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:57.144513 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f0d94-3801-49a1-a50c-49772d08da20 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:57.149437 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a9839-0863-41c7-a88a-e37518880b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:57.150528 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a9839-0863-41c7-a88a-e37518880b69 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:57.150812 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a9839-0863-41c7-a88a-e37518880b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:57.151082 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a9839-0863-41c7-a88a-e37518880b69 admin admin] PATH_INFO: `/v3/projects/54e0da083bd04dac986f3a27208fd38c/users/ed7769aecd5346f9bc22c8a946462748/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:57.166496 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a9839-0863-41c7-a88a-e37518880b69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e0da083bd04dac986f3a27208fd38c, user_id=ed7769aecd5346f9bc22c8a946462748, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:57.169186 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a9839-0863-41c7-a88a-e37518880b69 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:57.186533 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 990/1977] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:57 2022] PUT /identity/v3/projects/54e0da083bd04dac986f3a27208fd38c/users/ed7769aecd5346f9bc22c8a946462748/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:52:57.191397 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01b3db-f36d-47fd-930f-26531a0dc95a admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:57.207473 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab01b3db-f36d-47fd-930f-26531a0dc95a admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:57.266748 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b050c-9abe-4380-8a69-b6be05548b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:57.267431 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b050c-9abe-4380-8a69-b6be05548b60 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:57.267714 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b050c-9abe-4380-8a69-b6be05548b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:57.267991 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b050c-9abe-4380-8a69-b6be05548b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:57.268722 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b050c-9abe-4380-8a69-b6be05548b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:57.270345 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b050c-9abe-4380-8a69-b6be05548b60 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:57.280450 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 988/1978] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:52:57.284794 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a9839-0863-41c7-a88a-e37518880b69 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:57.298962 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a9839-0863-41c7-a88a-e37518880b69 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:57.304377 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3bcf6-4ae5-4d97-998f-0c72078e0f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:57.305462 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3bcf6-4ae5-4d97-998f-0c72078e0f18 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:57.305853 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3bcf6-4ae5-4d97-998f-0c72078e0f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:57.306215 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3bcf6-4ae5-4d97-998f-0c72078e0f18 admin admin] PATH_INFO: `/v3/projects/54e0da083bd04dac986f3a27208fd38c/users/ed7769aecd5346f9bc22c8a946462748/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:57.309276 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3bcf6-4ae5-4d97-998f-0c72078e0f18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e0da083bd04dac986f3a27208fd38c, user_id=ed7769aecd5346f9bc22c8a946462748, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:57.312902 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a3bcf6-4ae5-4d97-998f-0c72078e0f18 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:57.325500 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 991/1979] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:52:57 2022] PUT /identity/v3/projects/54e0da083bd04dac986f3a27208fd38c/users/ed7769aecd5346f9bc22c8a946462748/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:52:57.334837 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dab0f-916f-4135-9929-ba62c2d55852 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:57.335134 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dab0f-916f-4135-9929-ba62c2d55852 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:57.335416 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46dab0f-916f-4135-9929-ba62c2d55852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:57.363095 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-e46dab0f-916f-4135-9929-ba62c2d55852 None None] MFA Rules not processed for user `ed7769aecd5346f9bc22c8a946462748`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:52:57.364285 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-e46dab0f-916f-4135-9929-ba62c2d55852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:57.435807 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 989/1980] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:52:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:52:57.447563 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3bcf6-4ae5-4d97-998f-0c72078e0f18 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:57.449241 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-58a3bcf6-4ae5-4d97-998f-0c72078e0f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:57.538573 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a3bcf6-4ae5-4d97-998f-0c72078e0f18 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:57.543707 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242e523-e5b9-4e34-a1af-f0b1fda128e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:57.544796 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242e523-e5b9-4e34-a1af-f0b1fda128e4 service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:57.545674 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242e523-e5b9-4e34-a1af-f0b1fda128e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:57.546275 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5242e523-e5b9-4e34-a1af-f0b1fda128e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:57.558307 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5242e523-e5b9-4e34-a1af-f0b1fda128e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:57.560256 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5242e523-e5b9-4e34-a1af-f0b1fda128e4 service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:57.576123 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 992/1981] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:52:57.619569 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dab0f-916f-4135-9929-ba62c2d55852 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:52:57.620999 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-e46dab0f-916f-4135-9929-ba62c2d55852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:52:57.633197 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46dab0f-916f-4135-9929-ba62c2d55852 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:52:57.636831 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c6173-04df-45f7-a54f-06d2ee014ddd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:52:57.637483 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c6173-04df-45f7-a54f-06d2ee014ddd service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:52:57.637762 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c6173-04df-45f7-a54f-06d2ee014ddd service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:52:57.638086 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c6173-04df-45f7-a54f-06d2ee014ddd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:52:57.690474 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c6173-04df-45f7-a54f-06d2ee014ddd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:52:57.691883 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c6173-04df-45f7-a54f-06d2ee014ddd service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:52:57.700688 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 990/1982] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:52:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:04.799836 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242e523-e5b9-4e34-a1af-f0b1fda128e4 service cinder] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:04.866594 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5242e523-e5b9-4e34-a1af-f0b1fda128e4 service cinder] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:04.871270 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ca1bc-ee76-4050-a9d4-e79af5aff306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:04.872143 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ca1bc-ee76-4050-a9d4-e79af5aff306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:04.872425 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ca1bc-ee76-4050-a9d4-e79af5aff306 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:04.872698 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ca1bc-ee76-4050-a9d4-e79af5aff306 admin admin] PATH_INFO: `/v3/users/a3342c97ac614a7a84a0bbd109647bf5` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:04.873955 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ca1bc-ee76-4050-a9d4-e79af5aff306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3342c97ac614a7a84a0bbd109647bf5)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:04.875870 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410ca1bc-ee76-4050-a9d4-e79af5aff306 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:04.927183 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-410ca1bc-ee76-4050-a9d4-e79af5aff306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3342c97ac614a7a84a0bbd109647bf5'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:04.927877 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-410ca1bc-ee76-4050-a9d4-e79af5aff306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3342c97ac614a7a84a0bbd109647bf5'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:04.937058 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-410ca1bc-ee76-4050-a9d4-e79af5aff306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3342c97ac614a7a84a0bbd109647bf5'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:04.943924 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-410ca1bc-ee76-4050-a9d4-e79af5aff306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3342c97ac614a7a84a0bbd109647bf5'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:04.955780 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-410ca1bc-ee76-4050-a9d4-e79af5aff306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3342c97ac614a7a84a0bbd109647bf5'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:04.962005 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 993/1983] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:04 2022] DELETE /identity/v3/users/a3342c97ac614a7a84a0bbd109647bf5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:04.966731 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de313eaa-4c10-4e7a-b066-da207df2f4d9 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:04.967242 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de313eaa-4c10-4e7a-b066-da207df2f4d9 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:04.967415 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de313eaa-4c10-4e7a-b066-da207df2f4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:04.985565 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-de313eaa-4c10-4e7a-b066-da207df2f4d9 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:04.986965 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-de313eaa-4c10-4e7a-b066-da207df2f4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:05.059601 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 991/1984] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:05.066445 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ca1bc-ee76-4050-a9d4-e79af5aff306 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:05.067878 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-410ca1bc-ee76-4050-a9d4-e79af5aff306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:05.127203 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ca1bc-ee76-4050-a9d4-e79af5aff306 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:05.131127 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499e6e0-aad0-4e5f-8c7d-d3bf344bccf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:05.131787 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499e6e0-aad0-4e5f-8c7d-d3bf344bccf6 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:05.132067 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499e6e0-aad0-4e5f-8c7d-d3bf344bccf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:05.132348 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499e6e0-aad0-4e5f-8c7d-d3bf344bccf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:05.141808 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499e6e0-aad0-4e5f-8c7d-d3bf344bccf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:05.143303 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499e6e0-aad0-4e5f-8c7d-d3bf344bccf6 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:05.153106 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 994/1985] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:53:05.467620 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de313eaa-4c10-4e7a-b066-da207df2f4d9 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:05.469285 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-de313eaa-4c10-4e7a-b066-da207df2f4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:05.482368 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de313eaa-4c10-4e7a-b066-da207df2f4d9 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:05.489089 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d7f45-d1b2-418f-9c57-ead617d46e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:05.490467 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d7f45-d1b2-418f-9c57-ead617d46e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:05.490656 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d7f45-d1b2-418f-9c57-ead617d46e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:05.490930 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d7f45-d1b2-418f-9c57-ead617d46e22 admin admin] PATH_INFO: `/v3/projects/7b7c23d887ea48609cad5a847ec3aa30` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:05.492262 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d7f45-d1b2-418f-9c57-ead617d46e22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b7c23d887ea48609cad5a847ec3aa30)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:05.495638 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d7f45-d1b2-418f-9c57-ead617d46e22 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:05.547234 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0b8d7f45-d1b2-418f-9c57-ead617d46e22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b7c23d887ea48609cad5a847ec3aa30', 'request_id': 'req-0b8d7f45-d1b2-418f-9c57-ead617d46e22'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:05.553242 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0b8d7f45-d1b2-418f-9c57-ead617d46e22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b7c23d887ea48609cad5a847ec3aa30', 'request_id': 'req-0b8d7f45-d1b2-418f-9c57-ead617d46e22'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:05.562797 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0b8d7f45-d1b2-418f-9c57-ead617d46e22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b7c23d887ea48609cad5a847ec3aa30', 'request_id': 'req-0b8d7f45-d1b2-418f-9c57-ead617d46e22'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:05.574387 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0b8d7f45-d1b2-418f-9c57-ead617d46e22 admin admin] The token cache is being invalidate because project 7b7c23d887ea48609cad5a847ec3aa30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:05.574672 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0b8d7f45-d1b2-418f-9c57-ead617d46e22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:05.575283 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0b8d7f45-d1b2-418f-9c57-ead617d46e22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:05.576898 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 992/1986] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:05 2022] DELETE /identity/v3/projects/7b7c23d887ea48609cad5a847ec3aa30 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:05.581030 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499e6e0-aad0-4e5f-8c7d-d3bf344bccf6 service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:05.591790 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499e6e0-aad0-4e5f-8c7d-d3bf344bccf6 service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:05.655095 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8982ef-6563-480c-8378-805cfa02c740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:05.657066 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8982ef-6563-480c-8378-805cfa02c740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:05.657066 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8982ef-6563-480c-8378-805cfa02c740 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:05.657816 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8982ef-6563-480c-8378-805cfa02c740 admin admin] PATH_INFO: `/v3/users/7bb030ed0e3b424c8f14310fa503cb4a` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:05.659135 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8982ef-6563-480c-8378-805cfa02c740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb030ed0e3b424c8f14310fa503cb4a)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:05.661061 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8982ef-6563-480c-8378-805cfa02c740 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:05.714901 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-7a8982ef-6563-480c-8378-805cfa02c740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb030ed0e3b424c8f14310fa503cb4a'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:05.715600 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-7a8982ef-6563-480c-8378-805cfa02c740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb030ed0e3b424c8f14310fa503cb4a'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:05.725415 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-7a8982ef-6563-480c-8378-805cfa02c740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb030ed0e3b424c8f14310fa503cb4a'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:05.732681 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-7a8982ef-6563-480c-8378-805cfa02c740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb030ed0e3b424c8f14310fa503cb4a'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:05.744571 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-7a8982ef-6563-480c-8378-805cfa02c740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb030ed0e3b424c8f14310fa503cb4a'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:05.751117 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 995/1987] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:05 2022] DELETE /identity/v3/users/7bb030ed0e3b424c8f14310fa503cb4a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:06.036663 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d7f45-d1b2-418f-9c57-ead617d46e22 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:06.038423 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-0b8d7f45-d1b2-418f-9c57-ead617d46e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:06.055981 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d7f45-d1b2-418f-9c57-ead617d46e22 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:06.116497 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51afa7a-7a84-4591-bb18-dedc543f10b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:06.117408 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51afa7a-7a84-4591-bb18-dedc543f10b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:06.117735 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51afa7a-7a84-4591-bb18-dedc543f10b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:06.117958 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51afa7a-7a84-4591-bb18-dedc543f10b5 admin admin] PATH_INFO: `/v3/projects/96d2a2ed803d45acbc6c9e69b62d62fd` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:06.119148 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51afa7a-7a84-4591-bb18-dedc543f10b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96d2a2ed803d45acbc6c9e69b62d62fd)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:06.121106 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51afa7a-7a84-4591-bb18-dedc543f10b5 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:06.168538 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c51afa7a-7a84-4591-bb18-dedc543f10b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96d2a2ed803d45acbc6c9e69b62d62fd', 'request_id': 'req-c51afa7a-7a84-4591-bb18-dedc543f10b5'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:06.174678 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c51afa7a-7a84-4591-bb18-dedc543f10b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96d2a2ed803d45acbc6c9e69b62d62fd', 'request_id': 'req-c51afa7a-7a84-4591-bb18-dedc543f10b5'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:06.183177 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c51afa7a-7a84-4591-bb18-dedc543f10b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96d2a2ed803d45acbc6c9e69b62d62fd', 'request_id': 'req-c51afa7a-7a84-4591-bb18-dedc543f10b5'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:06.193933 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c51afa7a-7a84-4591-bb18-dedc543f10b5 admin admin] The token cache is being invalidate because project 96d2a2ed803d45acbc6c9e69b62d62fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:06.194340 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c51afa7a-7a84-4591-bb18-dedc543f10b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:06.195168 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c51afa7a-7a84-4591-bb18-dedc543f10b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:06.197378 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 993/1988] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:06 2022] DELETE /identity/v3/projects/96d2a2ed803d45acbc6c9e69b62d62fd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:53:06.201504 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8982ef-6563-480c-8378-805cfa02c740 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:06.203128 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-7a8982ef-6563-480c-8378-805cfa02c740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:06.216806 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8982ef-6563-480c-8378-805cfa02c740 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:06.272092 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d863501-f380-4c9b-9703-5d5cac6761fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:06.273105 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d863501-f380-4c9b-9703-5d5cac6761fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:06.273466 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d863501-f380-4c9b-9703-5d5cac6761fd admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:06.273813 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d863501-f380-4c9b-9703-5d5cac6761fd admin admin] PATH_INFO: `/v3/users/ed7769aecd5346f9bc22c8a946462748` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:06.275051 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d863501-f380-4c9b-9703-5d5cac6761fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed7769aecd5346f9bc22c8a946462748)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:06.277039 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d863501-f380-4c9b-9703-5d5cac6761fd admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:06.325009 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-4d863501-f380-4c9b-9703-5d5cac6761fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed7769aecd5346f9bc22c8a946462748'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:06.325755 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-4d863501-f380-4c9b-9703-5d5cac6761fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed7769aecd5346f9bc22c8a946462748'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:06.337024 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-4d863501-f380-4c9b-9703-5d5cac6761fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed7769aecd5346f9bc22c8a946462748'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:06.343912 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-4d863501-f380-4c9b-9703-5d5cac6761fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed7769aecd5346f9bc22c8a946462748'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:06.355735 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-4d863501-f380-4c9b-9703-5d5cac6761fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed7769aecd5346f9bc22c8a946462748'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:06.361699 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 996/1989] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:06 2022] DELETE /identity/v3/users/ed7769aecd5346f9bc22c8a946462748 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:06.677688 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51afa7a-7a84-4591-bb18-dedc543f10b5 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:06.679506 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-c51afa7a-7a84-4591-bb18-dedc543f10b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:06.715928 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51afa7a-7a84-4591-bb18-dedc543f10b5 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:06.772896 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5afa5c6-2df1-4491-8411-797173e11060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:06.773827 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afa5c6-2df1-4491-8411-797173e11060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:06.774125 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afa5c6-2df1-4491-8411-797173e11060 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:06.774368 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5afa5c6-2df1-4491-8411-797173e11060 admin admin] PATH_INFO: `/v3/projects/54e0da083bd04dac986f3a27208fd38c` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:06.775644 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5afa5c6-2df1-4491-8411-797173e11060 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54e0da083bd04dac986f3a27208fd38c)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:06.777650 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5afa5c6-2df1-4491-8411-797173e11060 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:06.825981 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c5afa5c6-2df1-4491-8411-797173e11060 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54e0da083bd04dac986f3a27208fd38c', 'request_id': 'req-c5afa5c6-2df1-4491-8411-797173e11060'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:06.832940 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c5afa5c6-2df1-4491-8411-797173e11060 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54e0da083bd04dac986f3a27208fd38c', 'request_id': 'req-c5afa5c6-2df1-4491-8411-797173e11060'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:06.842281 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c5afa5c6-2df1-4491-8411-797173e11060 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54e0da083bd04dac986f3a27208fd38c', 'request_id': 'req-c5afa5c6-2df1-4491-8411-797173e11060'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:06.854517 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c5afa5c6-2df1-4491-8411-797173e11060 admin admin] The token cache is being invalidate because project 54e0da083bd04dac986f3a27208fd38c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:06.854899 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c5afa5c6-2df1-4491-8411-797173e11060 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:06.855465 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c5afa5c6-2df1-4491-8411-797173e11060 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:06.857273 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 994/1990] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:06 2022] DELETE /identity/v3/projects/54e0da083bd04dac986f3a27208fd38c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:06.863373 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b71240-3bfa-4719-b1ae-92d104076cbb None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:06.863665 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b71240-3bfa-4719-b1ae-92d104076cbb None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:06.863943 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b71240-3bfa-4719-b1ae-92d104076cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:06.882578 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-42b71240-3bfa-4719-b1ae-92d104076cbb None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:06.884027 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-42b71240-3bfa-4719-b1ae-92d104076cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:06.946364 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 997/1991] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:06.956302 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d5017-668a-4c7d-a0cb-2a0c62673cc1 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:06.956595 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d5017-668a-4c7d-a0cb-2a0c62673cc1 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:06.957437 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d5017-668a-4c7d-a0cb-2a0c62673cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:06.977015 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-db1d5017-668a-4c7d-a0cb-2a0c62673cc1 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:06.978271 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-db1d5017-668a-4c7d-a0cb-2a0c62673cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:06.986607 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 995/1992] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:06.990797 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b71240-3bfa-4719-b1ae-92d104076cbb None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:07.001518 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b71240-3bfa-4719-b1ae-92d104076cbb None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:07.006412 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94162f5b-5913-4623-9793-050e4ae30c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:07.007073 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94162f5b-5913-4623-9793-050e4ae30c6b admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:07.007350 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94162f5b-5913-4623-9793-050e4ae30c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:07.007621 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94162f5b-5913-4623-9793-050e4ae30c6b admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:07.008353 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94162f5b-5913-4623-9793-050e4ae30c6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:53:07.008786 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94162f5b-5913-4623-9793-050e4ae30c6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:07.010409 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94162f5b-5913-4623-9793-050e4ae30c6b admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:07.031710 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 998/1993] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:53:07.033479 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d5017-668a-4c7d-a0cb-2a0c62673cc1 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:07.043918 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d5017-668a-4c7d-a0cb-2a0c62673cc1 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:07.048764 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293fa44-726e-4d2f-91cc-2830718f1bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:07.049557 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293fa44-726e-4d2f-91cc-2830718f1bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:07.049912 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293fa44-726e-4d2f-91cc-2830718f1bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:07.050252 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b293fa44-726e-4d2f-91cc-2830718f1bc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:07.051006 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293fa44-726e-4d2f-91cc-2830718f1bc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:07.052938 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b293fa44-726e-4d2f-91cc-2830718f1bc7 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:07.080224 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 996/1994] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:53:07 2022] POST /identity/v3/projects => generated 359 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:53:07.084714 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94162f5b-5913-4623-9793-050e4ae30c6b admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:07.094712 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94162f5b-5913-4623-9793-050e4ae30c6b admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:07.148990 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a65bc-b84d-4af1-95f9-98f6d5af339b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:07.149699 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a65bc-b84d-4af1-95f9-98f6d5af339b admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:07.149976 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a65bc-b84d-4af1-95f9-98f6d5af339b admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:07.150242 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a65bc-b84d-4af1-95f9-98f6d5af339b admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:07.150940 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a65bc-b84d-4af1-95f9-98f6d5af339b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:07.152962 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a65bc-b84d-4af1-95f9-98f6d5af339b admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:07.179685 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 999/1995] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:53:07 2022] POST /identity/v3/users => generated 280 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:07.181146 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293fa44-726e-4d2f-91cc-2830718f1bc7 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:07.192542 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b293fa44-726e-4d2f-91cc-2830718f1bc7 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:07.197919 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306b7f6-ad82-4548-aede-debebfdf0492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:07.198158 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306b7f6-ad82-4548-aede-debebfdf0492 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:07.198400 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306b7f6-ad82-4548-aede-debebfdf0492 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:07.198679 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306b7f6-ad82-4548-aede-debebfdf0492 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:07.199434 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306b7f6-ad82-4548-aede-debebfdf0492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:07.201341 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306b7f6-ad82-4548-aede-debebfdf0492 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:07.212573 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 997/1996] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:07.216879 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a65bc-b84d-4af1-95f9-98f6d5af339b admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:07.227598 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a65bc-b84d-4af1-95f9-98f6d5af339b admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:07.232651 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6b690-cedb-463c-9d22-bf2786282e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:07.233381 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6b690-cedb-463c-9d22-bf2786282e5b admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:07.233674 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6b690-cedb-463c-9d22-bf2786282e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:07.233951 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6b690-cedb-463c-9d22-bf2786282e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:07.234683 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6b690-cedb-463c-9d22-bf2786282e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:07.236334 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6b690-cedb-463c-9d22-bf2786282e5b admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:07.246472 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1000/1997] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:07.250791 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306b7f6-ad82-4548-aede-debebfdf0492 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:07.260825 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306b7f6-ad82-4548-aede-debebfdf0492 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:07.266304 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5da88-a476-4528-a76f-d523976094a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:07.267245 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5da88-a476-4528-a76f-d523976094a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:07.267523 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5da88-a476-4528-a76f-d523976094a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:07.267841 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5da88-a476-4528-a76f-d523976094a0 admin admin] PATH_INFO: `/v3/projects/5715bc6d84454e5394994a486ebfc9f2/users/6fe115d23bea4d30ba3f055c7315bb6d/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:07.283436 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5da88-a476-4528-a76f-d523976094a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5715bc6d84454e5394994a486ebfc9f2, user_id=6fe115d23bea4d30ba3f055c7315bb6d, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:07.286163 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5da88-a476-4528-a76f-d523976094a0 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:07.301294 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 998/1998] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:07 2022] PUT /identity/v3/projects/5715bc6d84454e5394994a486ebfc9f2/users/6fe115d23bea4d30ba3f055c7315bb6d/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:53:07.312809 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8912a7d-7280-46d1-9876-0c69d2b4a8c6 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:07.313200 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8912a7d-7280-46d1-9876-0c69d2b4a8c6 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:07.313572 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8912a7d-7280-46d1-9876-0c69d2b4a8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:07.340890 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-a8912a7d-7280-46d1-9876-0c69d2b4a8c6 None None] MFA Rules not processed for user `6fe115d23bea4d30ba3f055c7315bb6d`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:07.342170 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-a8912a7d-7280-46d1-9876-0c69d2b4a8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:07.407300 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1001/1999] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:07 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:53:07.443466 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5da88-a476-4528-a76f-d523976094a0 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:07.445109 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-6de5da88-a476-4528-a76f-d523976094a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:07.514014 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5da88-a476-4528-a76f-d523976094a0 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:07.517809 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e83bfc-32eb-4350-8828-d0c88769fa88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:07.518461 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e83bfc-32eb-4350-8828-d0c88769fa88 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:07.518762 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e83bfc-32eb-4350-8828-d0c88769fa88 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:07.519003 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e83bfc-32eb-4350-8828-d0c88769fa88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:07.530930 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e83bfc-32eb-4350-8828-d0c88769fa88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:07.532730 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e83bfc-32eb-4350-8828-d0c88769fa88 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:07.543474 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 999/2000] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:07 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:07.558251 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8912a7d-7280-46d1-9876-0c69d2b4a8c6 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:07.620565 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8912a7d-7280-46d1-9876-0c69d2b4a8c6 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:07.625342 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5698b6-349b-423d-aef6-95220cf81366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:07.626246 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5698b6-349b-423d-aef6-95220cf81366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:07.626599 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5698b6-349b-423d-aef6-95220cf81366 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:07.626886 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5698b6-349b-423d-aef6-95220cf81366 admin admin] PATH_INFO: `/v3/users/6fe115d23bea4d30ba3f055c7315bb6d` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:07.628128 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5698b6-349b-423d-aef6-95220cf81366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fe115d23bea4d30ba3f055c7315bb6d)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:07.630137 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5698b6-349b-423d-aef6-95220cf81366 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:07.689819 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ee5698b6-349b-423d-aef6-95220cf81366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fe115d23bea4d30ba3f055c7315bb6d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:07.690663 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ee5698b6-349b-423d-aef6-95220cf81366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fe115d23bea4d30ba3f055c7315bb6d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:07.700005 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ee5698b6-349b-423d-aef6-95220cf81366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fe115d23bea4d30ba3f055c7315bb6d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:07.709395 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ee5698b6-349b-423d-aef6-95220cf81366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fe115d23bea4d30ba3f055c7315bb6d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:07.722824 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ee5698b6-349b-423d-aef6-95220cf81366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fe115d23bea4d30ba3f055c7315bb6d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:07.732765 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1002/2001] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:07 2022] DELETE /identity/v3/users/6fe115d23bea4d30ba3f055c7315bb6d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:07.734219 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f704dc-0432-47b6-92e4-6229782a1421 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:07.734675 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f704dc-0432-47b6-92e4-6229782a1421 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:07.734772 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f704dc-0432-47b6-92e4-6229782a1421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:07.755021 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-34f704dc-0432-47b6-92e4-6229782a1421 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:07.756452 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-34f704dc-0432-47b6-92e4-6229782a1421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:07.823944 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1000/2002] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:07.843129 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5698b6-349b-423d-aef6-95220cf81366 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:07.845210 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-ee5698b6-349b-423d-aef6-95220cf81366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:07.911546 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5698b6-349b-423d-aef6-95220cf81366 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:07.915142 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bcd35-b0e9-4ad4-92cc-a67539680811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:07.915787 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bcd35-b0e9-4ad4-92cc-a67539680811 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:07.916065 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bcd35-b0e9-4ad4-92cc-a67539680811 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:07.916340 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bcd35-b0e9-4ad4-92cc-a67539680811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:07.925233 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bcd35-b0e9-4ad4-92cc-a67539680811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:07.926766 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bcd35-b0e9-4ad4-92cc-a67539680811 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:07.936034 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1003/2003] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:08.375587 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f704dc-0432-47b6-92e4-6229782a1421 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:08.377178 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-34f704dc-0432-47b6-92e4-6229782a1421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:08.390070 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f704dc-0432-47b6-92e4-6229782a1421 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:08.396032 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a3ba6-0d2a-45c5-a747-1c5238e776e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:08.397154 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a3ba6-0d2a-45c5-a747-1c5238e776e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:08.397474 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a3ba6-0d2a-45c5-a747-1c5238e776e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:08.397747 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a3ba6-0d2a-45c5-a747-1c5238e776e5 admin admin] PATH_INFO: `/v3/projects/5715bc6d84454e5394994a486ebfc9f2` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:08.398954 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a3ba6-0d2a-45c5-a747-1c5238e776e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5715bc6d84454e5394994a486ebfc9f2)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:08.400875 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a3ba6-0d2a-45c5-a747-1c5238e776e5 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:08.457676 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-829a3ba6-0d2a-45c5-a747-1c5238e776e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5715bc6d84454e5394994a486ebfc9f2', 'request_id': 'req-829a3ba6-0d2a-45c5-a747-1c5238e776e5'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:08.464574 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-829a3ba6-0d2a-45c5-a747-1c5238e776e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5715bc6d84454e5394994a486ebfc9f2', 'request_id': 'req-829a3ba6-0d2a-45c5-a747-1c5238e776e5'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:08.477768 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-829a3ba6-0d2a-45c5-a747-1c5238e776e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5715bc6d84454e5394994a486ebfc9f2', 'request_id': 'req-829a3ba6-0d2a-45c5-a747-1c5238e776e5'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:08.488537 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-829a3ba6-0d2a-45c5-a747-1c5238e776e5 admin admin] The token cache is being invalidate because project 5715bc6d84454e5394994a486ebfc9f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:08.488828 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-829a3ba6-0d2a-45c5-a747-1c5238e776e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:08.489630 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-829a3ba6-0d2a-45c5-a747-1c5238e776e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:08.491180 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1001/2004] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:08 2022] DELETE /identity/v3/projects/5715bc6d84454e5394994a486ebfc9f2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:08.496370 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd47d0-d380-4b21-a57c-cbe53c6fb152 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:08.497174 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd47d0-d380-4b21-a57c-cbe53c6fb152 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:08.497506 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd47d0-d380-4b21-a57c-cbe53c6fb152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:08.516001 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-8ccd47d0-d380-4b21-a57c-cbe53c6fb152 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:08.517245 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-8ccd47d0-d380-4b21-a57c-cbe53c6fb152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:08.576968 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1004/2005] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:08.585603 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f8354-7db7-4a78-94a1-02e2dfb2361a None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:08.586018 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f8354-7db7-4a78-94a1-02e2dfb2361a None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:08.586393 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f8354-7db7-4a78-94a1-02e2dfb2361a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:08.611950 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-0b7f8354-7db7-4a78-94a1-02e2dfb2361a None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:08.613130 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-0b7f8354-7db7-4a78-94a1-02e2dfb2361a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:08.621624 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1002/2006] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:08.626025 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd47d0-d380-4b21-a57c-cbe53c6fb152 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:08.636771 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd47d0-d380-4b21-a57c-cbe53c6fb152 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:08.641347 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e5ef6-3d4d-4c06-9e0b-3b9a9aef8809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:08.642040 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e5ef6-3d4d-4c06-9e0b-3b9a9aef8809 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:08.642323 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e5ef6-3d4d-4c06-9e0b-3b9a9aef8809 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:08.642593 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e5ef6-3d4d-4c06-9e0b-3b9a9aef8809 admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:08.643476 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e5ef6-3d4d-4c06-9e0b-3b9a9aef8809 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:53:08.643832 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e5ef6-3d4d-4c06-9e0b-3b9a9aef8809 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:08.645880 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e5ef6-3d4d-4c06-9e0b-3b9a9aef8809 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:08.665839 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1005/2007] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:53:08.667335 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f8354-7db7-4a78-94a1-02e2dfb2361a None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:08.676926 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f8354-7db7-4a78-94a1-02e2dfb2361a None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:08.681890 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f648f71-e37e-4d24-8ecd-da67c651254a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:08.682574 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f648f71-e37e-4d24-8ecd-da67c651254a admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:08.682857 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f648f71-e37e-4d24-8ecd-da67c651254a admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:08.683130 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f648f71-e37e-4d24-8ecd-da67c651254a admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:08.683837 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f648f71-e37e-4d24-8ecd-da67c651254a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:08.685795 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f648f71-e37e-4d24-8ecd-da67c651254a admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:08.712576 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1003/2008] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:53:08 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:08.716483 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e5ef6-3d4d-4c06-9e0b-3b9a9aef8809 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:08.726353 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e5ef6-3d4d-4c06-9e0b-3b9a9aef8809 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:08.781848 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7863df-e0fa-49cd-a686-26f5a847407d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:08.782520 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7863df-e0fa-49cd-a686-26f5a847407d admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:08.782803 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7863df-e0fa-49cd-a686-26f5a847407d admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:08.783079 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7863df-e0fa-49cd-a686-26f5a847407d admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:08.783786 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7863df-e0fa-49cd-a686-26f5a847407d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:08.785746 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7863df-e0fa-49cd-a686-26f5a847407d admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:08.812914 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1006/2009] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:53:08 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:53:08.814962 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f648f71-e37e-4d24-8ecd-da67c651254a admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:08.826209 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f648f71-e37e-4d24-8ecd-da67c651254a admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:08.831140 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a97c9-1aa8-47ac-be2d-df25e7b521ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:08.832162 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a97c9-1aa8-47ac-be2d-df25e7b521ca admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:08.832460 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a97c9-1aa8-47ac-be2d-df25e7b521ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:08.832741 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a97c9-1aa8-47ac-be2d-df25e7b521ca admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:08.833570 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a97c9-1aa8-47ac-be2d-df25e7b521ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:08.835283 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a97c9-1aa8-47ac-be2d-df25e7b521ca admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:08.848455 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1004/2010] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:08.852678 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7863df-e0fa-49cd-a686-26f5a847407d admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:08.862958 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7863df-e0fa-49cd-a686-26f5a847407d admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:08.868003 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecd5f9-b01f-4525-ba1a-032d6f7a9869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:08.868653 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecd5f9-b01f-4525-ba1a-032d6f7a9869 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:08.868939 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecd5f9-b01f-4525-ba1a-032d6f7a9869 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:08.869237 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecd5f9-b01f-4525-ba1a-032d6f7a9869 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:08.869996 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecd5f9-b01f-4525-ba1a-032d6f7a9869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:08.871574 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecd5f9-b01f-4525-ba1a-032d6f7a9869 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:08.882423 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1007/2011] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:08.886667 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a97c9-1aa8-47ac-be2d-df25e7b521ca admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:08.900865 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a97c9-1aa8-47ac-be2d-df25e7b521ca admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:08.906366 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50af78-72f2-43c2-8702-db59215f50a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:08.907303 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50af78-72f2-43c2-8702-db59215f50a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:08.907583 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50af78-72f2-43c2-8702-db59215f50a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:08.907879 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50af78-72f2-43c2-8702-db59215f50a6 admin admin] PATH_INFO: `/v3/projects/6ed7fd1094fa41bfa755002b23487092/users/6859bbddd3f44ef5966ad7581da37cb4/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:08.923114 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50af78-72f2-43c2-8702-db59215f50a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed7fd1094fa41bfa755002b23487092, user_id=6859bbddd3f44ef5966ad7581da37cb4, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:08.925801 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50af78-72f2-43c2-8702-db59215f50a6 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:08.940271 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1005/2012] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:08 2022] PUT /identity/v3/projects/6ed7fd1094fa41bfa755002b23487092/users/6859bbddd3f44ef5966ad7581da37cb4/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:53:08.951311 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54087794-6f14-488c-8f8f-dd3df918377f None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:08.951589 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54087794-6f14-488c-8f8f-dd3df918377f None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:08.951958 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54087794-6f14-488c-8f8f-dd3df918377f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:08.981098 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-54087794-6f14-488c-8f8f-dd3df918377f None None] MFA Rules not processed for user `6859bbddd3f44ef5966ad7581da37cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:08.982380 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-54087794-6f14-488c-8f8f-dd3df918377f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:08.996956 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50af78-72f2-43c2-8702-db59215f50a6 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:08.997170 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-0c50af78-72f2-43c2-8702-db59215f50a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:09.048103 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1008/2013] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:53:09.059706 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54087794-6f14-488c-8f8f-dd3df918377f None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:09.061128 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-54087794-6f14-488c-8f8f-dd3df918377f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:09.066313 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50af78-72f2-43c2-8702-db59215f50a6 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:09.071109 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487ad7e-7c9e-4e5b-bc47-15df0c86f148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:09.071987 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487ad7e-7c9e-4e5b-bc47-15df0c86f148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:09.072269 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487ad7e-7c9e-4e5b-bc47-15df0c86f148 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:09.072544 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487ad7e-7c9e-4e5b-bc47-15df0c86f148 admin admin] PATH_INFO: `/v3/users/eb3d4d59cb7443d4ab31a227f51bb466` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:09.073910 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487ad7e-7c9e-4e5b-bc47-15df0c86f148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb3d4d59cb7443d4ab31a227f51bb466)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:09.075696 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487ad7e-7c9e-4e5b-bc47-15df0c86f148 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:09.116965 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54087794-6f14-488c-8f8f-dd3df918377f None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:09.120611 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3b15c-3275-4b3f-af10-69be8dd335f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:09.121264 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3b15c-3275-4b3f-af10-69be8dd335f4 service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:09.121663 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3b15c-3275-4b3f-af10-69be8dd335f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:09.121946 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3b15c-3275-4b3f-af10-69be8dd335f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:09.123018 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-1487ad7e-7c9e-4e5b-bc47-15df0c86f148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb3d4d59cb7443d4ab31a227f51bb466'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:09.123690 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-1487ad7e-7c9e-4e5b-bc47-15df0c86f148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb3d4d59cb7443d4ab31a227f51bb466'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:09.130576 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3b15c-3275-4b3f-af10-69be8dd335f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:09.132053 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3b15c-3275-4b3f-af10-69be8dd335f4 service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:09.132210 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-1487ad7e-7c9e-4e5b-bc47-15df0c86f148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb3d4d59cb7443d4ab31a227f51bb466'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:09.140820 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1009/2014] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:53:09.144623 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-1487ad7e-7c9e-4e5b-bc47-15df0c86f148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb3d4d59cb7443d4ab31a227f51bb466'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:09.151655 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-1487ad7e-7c9e-4e5b-bc47-15df0c86f148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb3d4d59cb7443d4ab31a227f51bb466'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:09.158823 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1006/2015] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:08 2022] DELETE /identity/v3/users/eb3d4d59cb7443d4ab31a227f51bb466 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:53:09.163586 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9313e4-caa1-4725-afdc-6c284a4a1791 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:09.163949 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9313e4-caa1-4725-afdc-6c284a4a1791 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:09.164293 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9313e4-caa1-4725-afdc-6c284a4a1791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:09.167987 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487ad7e-7c9e-4e5b-bc47-15df0c86f148 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:09.169518 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-1487ad7e-7c9e-4e5b-bc47-15df0c86f148 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:09.181221 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-bf9313e4-caa1-4725-afdc-6c284a4a1791 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:09.182433 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-bf9313e4-caa1-4725-afdc-6c284a4a1791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:09.233665 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487ad7e-7c9e-4e5b-bc47-15df0c86f148 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:09.238203 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1ea98-7cf2-415d-a7f1-32bc41327b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:09.239527 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1ea98-7cf2-415d-a7f1-32bc41327b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:09.239527 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1ea98-7cf2-415d-a7f1-32bc41327b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:09.239691 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1ea98-7cf2-415d-a7f1-32bc41327b71 admin admin] PATH_INFO: `/v3/users/6859bbddd3f44ef5966ad7581da37cb4` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:09.239760 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1010/2016] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:09.240857 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1ea98-7cf2-415d-a7f1-32bc41327b71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6859bbddd3f44ef5966ad7581da37cb4)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:09.242785 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1ea98-7cf2-415d-a7f1-32bc41327b71 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:09.250009 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9313e4-caa1-4725-afdc-6c284a4a1791 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:09.251500 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-bf9313e4-caa1-4725-afdc-6c284a4a1791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:09.294575 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-e2d1ea98-7cf2-415d-a7f1-32bc41327b71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6859bbddd3f44ef5966ad7581da37cb4'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:09.295251 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-e2d1ea98-7cf2-415d-a7f1-32bc41327b71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6859bbddd3f44ef5966ad7581da37cb4'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:09.303542 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-e2d1ea98-7cf2-415d-a7f1-32bc41327b71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6859bbddd3f44ef5966ad7581da37cb4'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:09.314300 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9313e4-caa1-4725-afdc-6c284a4a1791 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:09.315418 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-e2d1ea98-7cf2-415d-a7f1-32bc41327b71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6859bbddd3f44ef5966ad7581da37cb4'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:09.317948 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a587c-eaf7-4cc5-ad80-b956db2e07f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:09.318595 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a587c-eaf7-4cc5-ad80-b956db2e07f6 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:09.318878 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a587c-eaf7-4cc5-ad80-b956db2e07f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:09.319157 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a587c-eaf7-4cc5-ad80-b956db2e07f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:09.320950 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-ee7a587c-eaf7-4cc5-ad80-b956db2e07f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:09.322629 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-e2d1ea98-7cf2-415d-a7f1-32bc41327b71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6859bbddd3f44ef5966ad7581da37cb4'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:09.328868 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1007/2017] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:09 2022] DELETE /identity/v3/users/6859bbddd3f44ef5966ad7581da37cb4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:09.333640 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a587c-eaf7-4cc5-ad80-b956db2e07f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:09.333826 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f95f7-2fad-4fa7-842b-ecb4f71f90b9 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:09.334112 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f95f7-2fad-4fa7-842b-ecb4f71f90b9 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:09.334381 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f95f7-2fad-4fa7-842b-ecb4f71f90b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:09.335089 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a587c-eaf7-4cc5-ad80-b956db2e07f6 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:09.344658 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1011/2018] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:09.351579 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-f65f95f7-2fad-4fa7-842b-ecb4f71f90b9 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:09.352775 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f65f95f7-2fad-4fa7-842b-ecb4f71f90b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:09.416238 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1008/2019] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:09.427612 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a587c-eaf7-4cc5-ad80-b956db2e07f6 service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:09.429261 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-ee7a587c-eaf7-4cc5-ad80-b956db2e07f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:09.440133 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a587c-eaf7-4cc5-ad80-b956db2e07f6 service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:09.490295 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68740e-64e3-4ef2-8a88-e164f4504d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:09.490998 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68740e-64e3-4ef2-8a88-e164f4504d76 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:09.491226 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68740e-64e3-4ef2-8a88-e164f4504d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:09.491504 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68740e-64e3-4ef2-8a88-e164f4504d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:09.504647 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68740e-64e3-4ef2-8a88-e164f4504d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:09.506156 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68740e-64e3-4ef2-8a88-e164f4504d76 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:09.519722 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1012/2020] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:09.741974 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f95f7-2fad-4fa7-842b-ecb4f71f90b9 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:09.743636 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f65f95f7-2fad-4fa7-842b-ecb4f71f90b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:09.755484 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f95f7-2fad-4fa7-842b-ecb4f71f90b9 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:09.781664 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82307f47-4ae1-4917-9d43-e2684605a06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:09.782746 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82307f47-4ae1-4917-9d43-e2684605a06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:09.783036 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82307f47-4ae1-4917-9d43-e2684605a06e admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:09.783319 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82307f47-4ae1-4917-9d43-e2684605a06e admin admin] PATH_INFO: `/v3/projects/0adc54f7ae0a44859dca5e1a6c5a7c7a` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:09.784714 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82307f47-4ae1-4917-9d43-e2684605a06e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0adc54f7ae0a44859dca5e1a6c5a7c7a)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:09.786654 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82307f47-4ae1-4917-9d43-e2684605a06e admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:09.838678 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-82307f47-4ae1-4917-9d43-e2684605a06e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0adc54f7ae0a44859dca5e1a6c5a7c7a', 'request_id': 'req-82307f47-4ae1-4917-9d43-e2684605a06e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:09.844966 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-82307f47-4ae1-4917-9d43-e2684605a06e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0adc54f7ae0a44859dca5e1a6c5a7c7a', 'request_id': 'req-82307f47-4ae1-4917-9d43-e2684605a06e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:09.855300 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-82307f47-4ae1-4917-9d43-e2684605a06e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0adc54f7ae0a44859dca5e1a6c5a7c7a', 'request_id': 'req-82307f47-4ae1-4917-9d43-e2684605a06e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:09.866711 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-82307f47-4ae1-4917-9d43-e2684605a06e admin admin] The token cache is being invalidate because project 0adc54f7ae0a44859dca5e1a6c5a7c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:09.867140 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-82307f47-4ae1-4917-9d43-e2684605a06e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:09.867946 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-82307f47-4ae1-4917-9d43-e2684605a06e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:09.869856 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1009/2021] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:09 2022] DELETE /identity/v3/projects/0adc54f7ae0a44859dca5e1a6c5a7c7a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:09.875152 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103a57e-6e9d-4816-bb85-c3832484f29c None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:09.875854 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103a57e-6e9d-4816-bb85-c3832484f29c None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:09.876585 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103a57e-6e9d-4816-bb85-c3832484f29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:09.896718 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-c103a57e-6e9d-4816-bb85-c3832484f29c None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:09.898033 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-c103a57e-6e9d-4816-bb85-c3832484f29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:09.928790 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82307f47-4ae1-4917-9d43-e2684605a06e admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:09.930440 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-82307f47-4ae1-4917-9d43-e2684605a06e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:09.967023 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1013/2022] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:53:09.976724 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0f6ce-4f6b-46f5-a74b-6a934937ea06 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:09.977173 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0f6ce-4f6b-46f5-a74b-6a934937ea06 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:09.977745 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0f6ce-4f6b-46f5-a74b-6a934937ea06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:09.997739 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-ffb0f6ce-4f6b-46f5-a74b-6a934937ea06 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:09.999214 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-ffb0f6ce-4f6b-46f5-a74b-6a934937ea06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:10.008032 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1014/2023] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:10.012308 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0f6ce-4f6b-46f5-a74b-6a934937ea06 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:10.021743 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0f6ce-4f6b-46f5-a74b-6a934937ea06 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:10.022390 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82307f47-4ae1-4917-9d43-e2684605a06e admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:10.026414 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa4682-0dee-4d82-99b2-143a5aa96f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:10.027078 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa4682-0dee-4d82-99b2-143a5aa96f11 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:10.027365 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa4682-0dee-4d82-99b2-143a5aa96f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:10.027481 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74dd98b-dbe4-4189-a77e-84c4c8da26d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:10.027645 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa4682-0dee-4d82-99b2-143a5aa96f11 admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:10.028373 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa4682-0dee-4d82-99b2-143a5aa96f11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:53:10.028554 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dd98b-dbe4-4189-a77e-84c4c8da26d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:10.028967 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dd98b-dbe4-4189-a77e-84c4c8da26d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:10.029067 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa4682-0dee-4d82-99b2-143a5aa96f11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:10.029475 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dd98b-dbe4-4189-a77e-84c4c8da26d8 admin admin] PATH_INFO: `/v3/projects/6ed7fd1094fa41bfa755002b23487092` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:10.030690 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa4682-0dee-4d82-99b2-143a5aa96f11 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:10.030813 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74dd98b-dbe4-4189-a77e-84c4c8da26d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ed7fd1094fa41bfa755002b23487092)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:10.032737 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74dd98b-dbe4-4189-a77e-84c4c8da26d8 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:10.042382 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1015/2024] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:53:10.046996 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa4682-0dee-4d82-99b2-143a5aa96f11 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:10.058203 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa4682-0dee-4d82-99b2-143a5aa96f11 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:10.062891 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc89ff1-649d-4880-9b4b-e475487aeb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:10.063777 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc89ff1-649d-4880-9b4b-e475487aeb4a admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:10.064069 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc89ff1-649d-4880-9b4b-e475487aeb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:10.064381 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc89ff1-649d-4880-9b4b-e475487aeb4a admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:10.065211 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc89ff1-649d-4880-9b4b-e475487aeb4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:10.067381 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc89ff1-649d-4880-9b4b-e475487aeb4a admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:10.083236 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c74dd98b-dbe4-4189-a77e-84c4c8da26d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed7fd1094fa41bfa755002b23487092', 'request_id': 'req-c74dd98b-dbe4-4189-a77e-84c4c8da26d8'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:10.090225 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c74dd98b-dbe4-4189-a77e-84c4c8da26d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed7fd1094fa41bfa755002b23487092', 'request_id': 'req-c74dd98b-dbe4-4189-a77e-84c4c8da26d8'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:10.096037 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1016/2025] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:53:10 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:53:10.101374 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c74dd98b-dbe4-4189-a77e-84c4c8da26d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed7fd1094fa41bfa755002b23487092', 'request_id': 'req-c74dd98b-dbe4-4189-a77e-84c4c8da26d8'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:10.101777 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc89ff1-649d-4880-9b4b-e475487aeb4a admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:10.114524 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c74dd98b-dbe4-4189-a77e-84c4c8da26d8 admin admin] The token cache is being invalidate because project 6ed7fd1094fa41bfa755002b23487092 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:10.114807 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c74dd98b-dbe4-4189-a77e-84c4c8da26d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:10.115481 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c74dd98b-dbe4-4189-a77e-84c4c8da26d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:10.117040 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1010/2026] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:09 2022] DELETE /identity/v3/projects/6ed7fd1094fa41bfa755002b23487092 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:53:10.169466 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc89ff1-649d-4880-9b4b-e475487aeb4a admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:10.174337 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19507e-493c-48e6-96f6-5e2ab0c68812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:10.175066 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19507e-493c-48e6-96f6-5e2ab0c68812 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:10.175349 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19507e-493c-48e6-96f6-5e2ab0c68812 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:10.175623 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d19507e-493c-48e6-96f6-5e2ab0c68812 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:10.176326 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19507e-493c-48e6-96f6-5e2ab0c68812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:10.178363 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d19507e-493c-48e6-96f6-5e2ab0c68812 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:10.204185 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1017/2027] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:53:10 2022] POST /identity/v3/users => generated 284 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:10.208932 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74dd98b-dbe4-4189-a77e-84c4c8da26d8 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:10.210444 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-c74dd98b-dbe4-4189-a77e-84c4c8da26d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:10.285344 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74dd98b-dbe4-4189-a77e-84c4c8da26d8 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:10.290535 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757b22a-3d0d-4ca6-b72d-fee3425e0109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:10.291216 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757b22a-3d0d-4ca6-b72d-fee3425e0109 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:10.291509 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757b22a-3d0d-4ca6-b72d-fee3425e0109 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:10.291783 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757b22a-3d0d-4ca6-b72d-fee3425e0109 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:10.292492 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757b22a-3d0d-4ca6-b72d-fee3425e0109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:10.294529 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757b22a-3d0d-4ca6-b72d-fee3425e0109 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:10.305782 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1011/2028] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:10.310142 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19507e-493c-48e6-96f6-5e2ab0c68812 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:10.320921 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d19507e-493c-48e6-96f6-5e2ab0c68812 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:10.326473 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90693e7b-75ae-48f0-9326-bf335415a570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:10.327176 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90693e7b-75ae-48f0-9326-bf335415a570 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:10.327444 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90693e7b-75ae-48f0-9326-bf335415a570 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:10.327721 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90693e7b-75ae-48f0-9326-bf335415a570 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:10.328447 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90693e7b-75ae-48f0-9326-bf335415a570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:10.330096 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90693e7b-75ae-48f0-9326-bf335415a570 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:10.340882 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1018/2029] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:10.345288 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757b22a-3d0d-4ca6-b72d-fee3425e0109 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:10.356740 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757b22a-3d0d-4ca6-b72d-fee3425e0109 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:10.362037 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eddfcf-70da-4e9d-8c96-35f38401f85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:10.362931 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eddfcf-70da-4e9d-8c96-35f38401f85e admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:10.363215 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eddfcf-70da-4e9d-8c96-35f38401f85e admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:10.363491 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eddfcf-70da-4e9d-8c96-35f38401f85e admin admin] PATH_INFO: `/v3/projects/52d2159af6bd4f0087f8f428b54244b8/users/f0e73667b0134ab085b53482f59bdd63/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:10.378863 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eddfcf-70da-4e9d-8c96-35f38401f85e admin admin] RBAC: Authorizing `identity:create_grant(project_id=52d2159af6bd4f0087f8f428b54244b8, user_id=f0e73667b0134ab085b53482f59bdd63, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:10.381566 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eddfcf-70da-4e9d-8c96-35f38401f85e admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:10.398287 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1012/2030] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:10 2022] PUT /identity/v3/projects/52d2159af6bd4f0087f8f428b54244b8/users/f0e73667b0134ab085b53482f59bdd63/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:10.408532 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dee659-993a-4c67-bf52-2aeb2f7f2cb5 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:10.408828 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dee659-993a-4c67-bf52-2aeb2f7f2cb5 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:10.409110 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dee659-993a-4c67-bf52-2aeb2f7f2cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:10.435360 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-c7dee659-993a-4c67-bf52-2aeb2f7f2cb5 None None] MFA Rules not processed for user `f0e73667b0134ab085b53482f59bdd63`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:10.436579 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-c7dee659-993a-4c67-bf52-2aeb2f7f2cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:10.505682 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1019/2031] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:10.517315 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eddfcf-70da-4e9d-8c96-35f38401f85e admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:10.519389 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-89eddfcf-70da-4e9d-8c96-35f38401f85e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:10.581072 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eddfcf-70da-4e9d-8c96-35f38401f85e admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:10.585251 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c50b8-0b3f-437c-898e-4f6e8fe54030 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b8e066deb49e6b48804cbbe5cd6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:10.585950 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c50b8-0b3f-437c-898e-4f6e8fe54030 service glance] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:10.586228 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c50b8-0b3f-437c-898e-4f6e8fe54030 service glance] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:10.586503 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c50b8-0b3f-437c-898e-4f6e8fe54030 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:10.596105 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c50b8-0b3f-437c-898e-4f6e8fe54030 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:10.597569 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c50b8-0b3f-437c-898e-4f6e8fe54030 service glance] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:10.609657 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1013/2032] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:10 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:14.946967 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dee659-993a-4c67-bf52-2aeb2f7f2cb5 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:14.948379 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-c7dee659-993a-4c67-bf52-2aeb2f7f2cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:15.012342 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dee659-993a-4c67-bf52-2aeb2f7f2cb5 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:15.017881 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f74614-316c-42e4-a2aa-a2772ddc2421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:15.018784 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f74614-316c-42e4-a2aa-a2772ddc2421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:15.019060 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f74614-316c-42e4-a2aa-a2772ddc2421 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:15.019330 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f74614-316c-42e4-a2aa-a2772ddc2421 admin admin] PATH_INFO: `/v3/users/6f10c9a6369247a6a53bb4552fabea8c` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:15.020590 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f74614-316c-42e4-a2aa-a2772ddc2421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f10c9a6369247a6a53bb4552fabea8c)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:15.022655 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f74614-316c-42e4-a2aa-a2772ddc2421 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:15.074168 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-92f74614-316c-42e4-a2aa-a2772ddc2421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f10c9a6369247a6a53bb4552fabea8c'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:15.074860 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-92f74614-316c-42e4-a2aa-a2772ddc2421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f10c9a6369247a6a53bb4552fabea8c'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:15.083738 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-92f74614-316c-42e4-a2aa-a2772ddc2421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f10c9a6369247a6a53bb4552fabea8c'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:15.090893 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-92f74614-316c-42e4-a2aa-a2772ddc2421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f10c9a6369247a6a53bb4552fabea8c'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:15.111438 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-92f74614-316c-42e4-a2aa-a2772ddc2421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f10c9a6369247a6a53bb4552fabea8c'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:15.122143 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1020/2033] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:14 2022] DELETE /identity/v3/users/6f10c9a6369247a6a53bb4552fabea8c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:15.317419 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c50b8-0b3f-437c-898e-4f6e8fe54030 service glance] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:15.338726 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c50b8-0b3f-437c-898e-4f6e8fe54030 service glance] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:15.417031 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76c52f-5c49-4bdc-ba68-9d4d4e97fba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:15.418026 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76c52f-5c49-4bdc-ba68-9d4d4e97fba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:15.418183 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76c52f-5c49-4bdc-ba68-9d4d4e97fba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:15.418463 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76c52f-5c49-4bdc-ba68-9d4d4e97fba5 admin admin] PATH_INFO: `/v3/projects/d28c418d3a754eaf96737e31d1880818` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:15.419639 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76c52f-5c49-4bdc-ba68-9d4d4e97fba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d28c418d3a754eaf96737e31d1880818)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:15.421663 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76c52f-5c49-4bdc-ba68-9d4d4e97fba5 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:15.470147 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-aa76c52f-5c49-4bdc-ba68-9d4d4e97fba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd28c418d3a754eaf96737e31d1880818', 'request_id': 'req-aa76c52f-5c49-4bdc-ba68-9d4d4e97fba5'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:15.476524 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-aa76c52f-5c49-4bdc-ba68-9d4d4e97fba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd28c418d3a754eaf96737e31d1880818', 'request_id': 'req-aa76c52f-5c49-4bdc-ba68-9d4d4e97fba5'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:15.486046 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-aa76c52f-5c49-4bdc-ba68-9d4d4e97fba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd28c418d3a754eaf96737e31d1880818', 'request_id': 'req-aa76c52f-5c49-4bdc-ba68-9d4d4e97fba5'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:15.496554 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-aa76c52f-5c49-4bdc-ba68-9d4d4e97fba5 admin admin] The token cache is being invalidate because project d28c418d3a754eaf96737e31d1880818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:15.496876 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-aa76c52f-5c49-4bdc-ba68-9d4d4e97fba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:15.500475 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-aa76c52f-5c49-4bdc-ba68-9d4d4e97fba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:15.502572 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1014/2034] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:15 2022] DELETE /identity/v3/projects/d28c418d3a754eaf96737e31d1880818 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:53:15.507365 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3302319-78db-46f2-a270-bfed027c1a3c None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:15.507653 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3302319-78db-46f2-a270-bfed027c1a3c None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:15.507920 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3302319-78db-46f2-a270-bfed027c1a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:15.520600 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76c52f-5c49-4bdc-ba68-9d4d4e97fba5 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:15.522003 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-aa76c52f-5c49-4bdc-ba68-9d4d4e97fba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:15.526141 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-b3302319-78db-46f2-a270-bfed027c1a3c None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:15.527312 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-b3302319-78db-46f2-a270-bfed027c1a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:15.582950 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76c52f-5c49-4bdc-ba68-9d4d4e97fba5 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:15.585065 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1021/2035] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:15.587921 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53898acc-a299-4940-b130-08e69c052058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:15.591202 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53898acc-a299-4940-b130-08e69c052058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:15.591202 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53898acc-a299-4940-b130-08e69c052058 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:15.591202 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53898acc-a299-4940-b130-08e69c052058 admin admin] PATH_INFO: `/v3/users/b8afc39f51864dfb999c499993299362` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:15.593309 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53898acc-a299-4940-b130-08e69c052058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8afc39f51864dfb999c499993299362)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:15.595339 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53898acc-a299-4940-b130-08e69c052058 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:15.596662 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acffd24-ff02-4105-a045-78e6e81d48fb None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:15.596952 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acffd24-ff02-4105-a045-78e6e81d48fb None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:15.597256 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acffd24-ff02-4105-a045-78e6e81d48fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:15.615047 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-2acffd24-ff02-4105-a045-78e6e81d48fb None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:15.616244 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-2acffd24-ff02-4105-a045-78e6e81d48fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:15.624636 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1022/2036] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:15.628571 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acffd24-ff02-4105-a045-78e6e81d48fb None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:15.638133 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acffd24-ff02-4105-a045-78e6e81d48fb None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:15.643434 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-53898acc-a299-4940-b130-08e69c052058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8afc39f51864dfb999c499993299362'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:15.643584 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015c341-f0dd-44a6-957d-0212d507a30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:15.644116 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015c341-f0dd-44a6-957d-0212d507a30e admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:15.644244 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-53898acc-a299-4940-b130-08e69c052058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8afc39f51864dfb999c499993299362'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:15.644401 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015c341-f0dd-44a6-957d-0212d507a30e admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:15.644678 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015c341-f0dd-44a6-957d-0212d507a30e admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:15.645469 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015c341-f0dd-44a6-957d-0212d507a30e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:53:15.645777 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015c341-f0dd-44a6-957d-0212d507a30e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:15.647416 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015c341-f0dd-44a6-957d-0212d507a30e admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:15.653409 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-53898acc-a299-4940-b130-08e69c052058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8afc39f51864dfb999c499993299362'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:15.663040 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1023/2037] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:53:15.664480 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015c341-f0dd-44a6-957d-0212d507a30e admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:15.668722 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-53898acc-a299-4940-b130-08e69c052058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8afc39f51864dfb999c499993299362'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:15.669729 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-a015c341-f0dd-44a6-957d-0212d507a30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:15.675869 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-53898acc-a299-4940-b130-08e69c052058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8afc39f51864dfb999c499993299362'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:15.682010 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1015/2038] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:15 2022] DELETE /identity/v3/users/b8afc39f51864dfb999c499993299362 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:53:15.683774 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015c341-f0dd-44a6-957d-0212d507a30e admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:15.686593 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab42763-6e38-4d6a-8844-851616f98014 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:15.686947 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab42763-6e38-4d6a-8844-851616f98014 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:15.687457 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab42763-6e38-4d6a-8844-851616f98014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:15.704580 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-2ab42763-6e38-4d6a-8844-851616f98014 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:15.705822 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-2ab42763-6e38-4d6a-8844-851616f98014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:15.741376 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3ec75-9e3e-439b-ae0d-dd6bb9e8a5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:15.742341 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3ec75-9e3e-439b-ae0d-dd6bb9e8a5ed admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:15.742711 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3ec75-9e3e-439b-ae0d-dd6bb9e8a5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:15.743048 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3ec75-9e3e-439b-ae0d-dd6bb9e8a5ed admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:15.743811 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3ec75-9e3e-439b-ae0d-dd6bb9e8a5ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:15.745888 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3ec75-9e3e-439b-ae0d-dd6bb9e8a5ed admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:15.764949 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1016/2039] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:15.772480 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1024/2040] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:53:15 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:15.775006 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab42763-6e38-4d6a-8844-851616f98014 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:15.776498 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3ec75-9e3e-439b-ae0d-dd6bb9e8a5ed admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:15.776659 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-2ab42763-6e38-4d6a-8844-851616f98014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:15.831502 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab42763-6e38-4d6a-8844-851616f98014 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:15.838147 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3ec75-9e3e-439b-ae0d-dd6bb9e8a5ed admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:15.843500 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b286298-518f-49df-a900-3d4cff401530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:15.844172 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b286298-518f-49df-a900-3d4cff401530 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:15.844476 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b286298-518f-49df-a900-3d4cff401530 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:15.844750 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b286298-518f-49df-a900-3d4cff401530 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:15.845473 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b286298-518f-49df-a900-3d4cff401530 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:15.847406 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b286298-518f-49df-a900-3d4cff401530 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:15.868925 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1025/2041] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:53:15 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:53:15.873040 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b286298-518f-49df-a900-3d4cff401530 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:15.881453 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aab910-4d49-4c0f-89a9-cadd9a23403d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:15.881453 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aab910-4d49-4c0f-89a9-cadd9a23403d service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:15.881453 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aab910-4d49-4c0f-89a9-cadd9a23403d service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:15.881453 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aab910-4d49-4c0f-89a9-cadd9a23403d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:15.883461 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b286298-518f-49df-a900-3d4cff401530 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:15.888189 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6432a18-66c7-40b7-9c8c-6665910954a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:15.888855 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6432a18-66c7-40b7-9c8c-6665910954a8 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:15.889163 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6432a18-66c7-40b7-9c8c-6665910954a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:15.889483 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6432a18-66c7-40b7-9c8c-6665910954a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:15.890207 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6432a18-66c7-40b7-9c8c-6665910954a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:15.891838 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6432a18-66c7-40b7-9c8c-6665910954a8 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:15.892344 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aab910-4d49-4c0f-89a9-cadd9a23403d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:15.893878 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aab910-4d49-4c0f-89a9-cadd9a23403d service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:15.901839 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1026/2042] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:53:15.903854 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1017/2043] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:15.905958 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6432a18-66c7-40b7-9c8c-6665910954a8 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:15.917093 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6432a18-66c7-40b7-9c8c-6665910954a8 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:15.923505 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3f1d0-7fdd-4b97-ba6a-5ce693c07e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:15.924220 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3f1d0-7fdd-4b97-ba6a-5ce693c07e18 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:15.924583 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3f1d0-7fdd-4b97-ba6a-5ce693c07e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:15.924859 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3f1d0-7fdd-4b97-ba6a-5ce693c07e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:15.925794 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3f1d0-7fdd-4b97-ba6a-5ce693c07e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:15.927739 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3f1d0-7fdd-4b97-ba6a-5ce693c07e18 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:15.939150 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1027/2044] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:15.943559 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aab910-4d49-4c0f-89a9-cadd9a23403d service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:15.964479 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aab910-4d49-4c0f-89a9-cadd9a23403d service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:15.971556 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426854dc-53f2-4157-bc3d-b0c334a923bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:15.972474 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426854dc-53f2-4157-bc3d-b0c334a923bf admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:15.972755 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426854dc-53f2-4157-bc3d-b0c334a923bf admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:15.973026 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426854dc-53f2-4157-bc3d-b0c334a923bf admin admin] PATH_INFO: `/v3/projects/3f51337f0fa1461c9f2b388e12176174/users/4f705be9921a4daabe961e170fe7efd2/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:15.994325 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426854dc-53f2-4157-bc3d-b0c334a923bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f51337f0fa1461c9f2b388e12176174, user_id=4f705be9921a4daabe961e170fe7efd2, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:15.997233 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426854dc-53f2-4157-bc3d-b0c334a923bf admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:16.014144 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1018/2045] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:15 2022] PUT /identity/v3/projects/3f51337f0fa1461c9f2b388e12176174/users/4f705be9921a4daabe961e170fe7efd2/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:16.019364 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e08b5-4017-4ef4-b7a3-eaa0f0bf4fa5 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:16.019856 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e08b5-4017-4ef4-b7a3-eaa0f0bf4fa5 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:16.019947 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e08b5-4017-4ef4-b7a3-eaa0f0bf4fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:16.039082 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-026e08b5-4017-4ef4-b7a3-eaa0f0bf4fa5 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:16.040300 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-026e08b5-4017-4ef4-b7a3-eaa0f0bf4fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:16.109159 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1028/2046] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:16.119045 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426854dc-53f2-4157-bc3d-b0c334a923bf admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:16.180776 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426854dc-53f2-4157-bc3d-b0c334a923bf admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:16.184488 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc445f3-c883-4beb-8a99-9c18913512fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:16.185140 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc445f3-c883-4beb-8a99-9c18913512fe service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:16.185457 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc445f3-c883-4beb-8a99-9c18913512fe service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:16.185731 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc445f3-c883-4beb-8a99-9c18913512fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:16.194706 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc445f3-c883-4beb-8a99-9c18913512fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:16.196207 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc445f3-c883-4beb-8a99-9c18913512fe service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:16.205790 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1019/2047] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:16.225575 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e08b5-4017-4ef4-b7a3-eaa0f0bf4fa5 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:16.227470 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-026e08b5-4017-4ef4-b7a3-eaa0f0bf4fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:16.241710 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e08b5-4017-4ef4-b7a3-eaa0f0bf4fa5 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:16.249112 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf24d85-e043-445b-8a12-a208e0c9c8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:16.249112 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf24d85-e043-445b-8a12-a208e0c9c8db admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:16.249112 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf24d85-e043-445b-8a12-a208e0c9c8db admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:16.249112 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf24d85-e043-445b-8a12-a208e0c9c8db admin admin] PATH_INFO: `/v3/projects/220289d8ac4246bfb015d989d61c6ef5` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:16.250237 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf24d85-e043-445b-8a12-a208e0c9c8db admin admin] RBAC: Authorizing `identity:delete_project(project_id=220289d8ac4246bfb015d989d61c6ef5)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:16.252812 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf24d85-e043-445b-8a12-a208e0c9c8db admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:16.308047 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-baf24d85-e043-445b-8a12-a208e0c9c8db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '220289d8ac4246bfb015d989d61c6ef5', 'request_id': 'req-baf24d85-e043-445b-8a12-a208e0c9c8db'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:16.317402 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-baf24d85-e043-445b-8a12-a208e0c9c8db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '220289d8ac4246bfb015d989d61c6ef5', 'request_id': 'req-baf24d85-e043-445b-8a12-a208e0c9c8db'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:16.329166 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-baf24d85-e043-445b-8a12-a208e0c9c8db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '220289d8ac4246bfb015d989d61c6ef5', 'request_id': 'req-baf24d85-e043-445b-8a12-a208e0c9c8db'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:16.341458 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-baf24d85-e043-445b-8a12-a208e0c9c8db admin admin] The token cache is being invalidate because project 220289d8ac4246bfb015d989d61c6ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:16.341863 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-baf24d85-e043-445b-8a12-a208e0c9c8db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:16.342624 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-baf24d85-e043-445b-8a12-a208e0c9c8db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:16.344297 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1029/2048] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:16 2022] DELETE /identity/v3/projects/220289d8ac4246bfb015d989d61c6ef5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:16.348306 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc445f3-c883-4beb-8a99-9c18913512fe service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:16.358268 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc445f3-c883-4beb-8a99-9c18913512fe service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:16.422764 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bd4a9-9056-4bfa-88e9-9f9095ffe0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:16.423688 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bd4a9-9056-4bfa-88e9-9f9095ffe0c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:16.423966 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bd4a9-9056-4bfa-88e9-9f9095ffe0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:16.424262 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bd4a9-9056-4bfa-88e9-9f9095ffe0c4 admin admin] PATH_INFO: `/v3/users/afe8fdc751654d7c8b62de26a6e1114b` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:16.425494 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bd4a9-9056-4bfa-88e9-9f9095ffe0c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe8fdc751654d7c8b62de26a6e1114b)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:16.427454 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bd4a9-9056-4bfa-88e9-9f9095ffe0c4 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:16.480605 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-e51bd4a9-9056-4bfa-88e9-9f9095ffe0c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe8fdc751654d7c8b62de26a6e1114b'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:16.481277 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-e51bd4a9-9056-4bfa-88e9-9f9095ffe0c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe8fdc751654d7c8b62de26a6e1114b'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:16.490046 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-e51bd4a9-9056-4bfa-88e9-9f9095ffe0c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe8fdc751654d7c8b62de26a6e1114b'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:16.502187 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-e51bd4a9-9056-4bfa-88e9-9f9095ffe0c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe8fdc751654d7c8b62de26a6e1114b'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:16.509595 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-e51bd4a9-9056-4bfa-88e9-9f9095ffe0c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe8fdc751654d7c8b62de26a6e1114b'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:16.516644 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1020/2049] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:16 2022] DELETE /identity/v3/users/afe8fdc751654d7c8b62de26a6e1114b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:53:16.916032 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf24d85-e043-445b-8a12-a208e0c9c8db admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:16.918129 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-baf24d85-e043-445b-8a12-a208e0c9c8db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:16.940519 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf24d85-e043-445b-8a12-a208e0c9c8db admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:17.024858 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75ac03-a2de-475b-bb51-b43ef8a94ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:17.025760 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75ac03-a2de-475b-bb51-b43ef8a94ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:17.026035 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75ac03-a2de-475b-bb51-b43ef8a94ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:17.026302 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75ac03-a2de-475b-bb51-b43ef8a94ff4 admin admin] PATH_INFO: `/v3/projects/dc495702be6c4256923923d105822df5` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:17.029124 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75ac03-a2de-475b-bb51-b43ef8a94ff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc495702be6c4256923923d105822df5)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:17.031175 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75ac03-a2de-475b-bb51-b43ef8a94ff4 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:17.095954 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-9c75ac03-a2de-475b-bb51-b43ef8a94ff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc495702be6c4256923923d105822df5', 'request_id': 'req-9c75ac03-a2de-475b-bb51-b43ef8a94ff4'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:17.102382 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-9c75ac03-a2de-475b-bb51-b43ef8a94ff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc495702be6c4256923923d105822df5', 'request_id': 'req-9c75ac03-a2de-475b-bb51-b43ef8a94ff4'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:17.112438 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-9c75ac03-a2de-475b-bb51-b43ef8a94ff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc495702be6c4256923923d105822df5', 'request_id': 'req-9c75ac03-a2de-475b-bb51-b43ef8a94ff4'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:17.123252 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-9c75ac03-a2de-475b-bb51-b43ef8a94ff4 admin admin] The token cache is being invalidate because project dc495702be6c4256923923d105822df5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:17.123567 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-9c75ac03-a2de-475b-bb51-b43ef8a94ff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:17.124194 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-9c75ac03-a2de-475b-bb51-b43ef8a94ff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:17.125774 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1030/2050] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:16 2022] DELETE /identity/v3/projects/dc495702be6c4256923923d105822df5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:17.131455 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d81a8-5eb6-405b-b71d-cbe15208dc44 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:17.131758 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d81a8-5eb6-405b-b71d-cbe15208dc44 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:17.132042 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d81a8-5eb6-405b-b71d-cbe15208dc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:17.167861 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-235d81a8-5eb6-405b-b71d-cbe15208dc44 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:17.169123 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-235d81a8-5eb6-405b-b71d-cbe15208dc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:17.244430 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1021/2051] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:17.253598 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c151eb-1054-4ab8-8e34-88ca795f518b None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:17.254248 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c151eb-1054-4ab8-8e34-88ca795f518b None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:17.254532 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c151eb-1054-4ab8-8e34-88ca795f518b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:17.276233 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-a9c151eb-1054-4ab8-8e34-88ca795f518b None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:17.277505 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-a9c151eb-1054-4ab8-8e34-88ca795f518b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:17.288034 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1031/2052] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:53:17.292799 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d81a8-5eb6-405b-b71d-cbe15208dc44 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:17.304429 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d81a8-5eb6-405b-b71d-cbe15208dc44 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:17.310430 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33fa53-e770-48b2-9608-160a39e91990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:17.311293 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33fa53-e770-48b2-9608-160a39e91990 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:17.311746 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33fa53-e770-48b2-9608-160a39e91990 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:17.312022 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33fa53-e770-48b2-9608-160a39e91990 admin admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:17.312773 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33fa53-e770-48b2-9608-160a39e91990 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:53:17.313070 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33fa53-e770-48b2-9608-160a39e91990 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:17.314961 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33fa53-e770-48b2-9608-160a39e91990 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:17.329043 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1022/2053] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:53:17.335731 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c151eb-1054-4ab8-8e34-88ca795f518b None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:17.351359 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c151eb-1054-4ab8-8e34-88ca795f518b None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:17.356698 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8caa82-9e34-471b-ba5b-5f550d6bcfd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:17.357857 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8caa82-9e34-471b-ba5b-5f550d6bcfd8 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:17.358393 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8caa82-9e34-471b-ba5b-5f550d6bcfd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:17.358899 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8caa82-9e34-471b-ba5b-5f550d6bcfd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:17.359886 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8caa82-9e34-471b-ba5b-5f550d6bcfd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:17.362705 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8caa82-9e34-471b-ba5b-5f550d6bcfd8 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:17.396129 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1032/2054] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:53:17 2022] POST /identity/v3/projects => generated 369 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:17.400364 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33fa53-e770-48b2-9608-160a39e91990 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:17.413859 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33fa53-e770-48b2-9608-160a39e91990 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:17.482887 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb888316-a5c6-4dc7-8f91-960d0d86def1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:17.483564 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb888316-a5c6-4dc7-8f91-960d0d86def1 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:17.483840 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb888316-a5c6-4dc7-8f91-960d0d86def1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:17.484111 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb888316-a5c6-4dc7-8f91-960d0d86def1 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:17.484803 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb888316-a5c6-4dc7-8f91-960d0d86def1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:17.486778 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb888316-a5c6-4dc7-8f91-960d0d86def1 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:17.512202 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1023/2055] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:53:17 2022] POST /identity/v3/users => generated 285 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:53:17.516412 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8caa82-9e34-471b-ba5b-5f550d6bcfd8 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:17.527627 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8caa82-9e34-471b-ba5b-5f550d6bcfd8 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:17.532258 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b195360-2fed-46e3-b06d-ccae2346a82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:17.532939 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b195360-2fed-46e3-b06d-ccae2346a82a admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:17.533847 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b195360-2fed-46e3-b06d-ccae2346a82a admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:17.534286 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b195360-2fed-46e3-b06d-ccae2346a82a admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:17.535068 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b195360-2fed-46e3-b06d-ccae2346a82a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:17.537107 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b195360-2fed-46e3-b06d-ccae2346a82a admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:17.548208 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1033/2056] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:53:17.552431 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb888316-a5c6-4dc7-8f91-960d0d86def1 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:17.563440 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb888316-a5c6-4dc7-8f91-960d0d86def1 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:17.568048 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30651db2-230f-45dd-b411-783dca2e3094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:17.568723 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30651db2-230f-45dd-b411-783dca2e3094 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:17.569005 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30651db2-230f-45dd-b411-783dca2e3094 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:17.569275 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30651db2-230f-45dd-b411-783dca2e3094 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:17.570326 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30651db2-230f-45dd-b411-783dca2e3094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:17.571924 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30651db2-230f-45dd-b411-783dca2e3094 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:17.586658 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1024/2057] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:17.588471 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b195360-2fed-46e3-b06d-ccae2346a82a admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:17.601644 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b195360-2fed-46e3-b06d-ccae2346a82a admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:17.623088 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25ed5e-a941-43ca-b5be-2eda7761e369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:17.624071 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25ed5e-a941-43ca-b5be-2eda7761e369 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:17.624367 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25ed5e-a941-43ca-b5be-2eda7761e369 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:17.624633 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25ed5e-a941-43ca-b5be-2eda7761e369 admin admin] PATH_INFO: `/v3/projects/695b3596c25f4ec5a7c75e7b98d433b1/users/0f23fa5d321645dcb60c7c36e6623231/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:17.642356 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25ed5e-a941-43ca-b5be-2eda7761e369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=695b3596c25f4ec5a7c75e7b98d433b1, user_id=0f23fa5d321645dcb60c7c36e6623231, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:17.645188 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25ed5e-a941-43ca-b5be-2eda7761e369 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:17.664974 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1034/2058] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:17 2022] PUT /identity/v3/projects/695b3596c25f4ec5a7c75e7b98d433b1/users/0f23fa5d321645dcb60c7c36e6623231/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:17.675674 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6c7a9-fd1a-4428-90ca-d593cd6b92da None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:17.676189 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6c7a9-fd1a-4428-90ca-d593cd6b92da None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:17.676472 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6c7a9-fd1a-4428-90ca-d593cd6b92da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:17.710814 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-c8b6c7a9-fd1a-4428-90ca-d593cd6b92da None None] MFA Rules not processed for user `0f23fa5d321645dcb60c7c36e6623231`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:17.712505 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-c8b6c7a9-fd1a-4428-90ca-d593cd6b92da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:17.791290 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1025/2059] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:17.793069 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25ed5e-a941-43ca-b5be-2eda7761e369 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:17.890513 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25ed5e-a941-43ca-b5be-2eda7761e369 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:17.897450 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6dd835-179b-4b80-8a39-eb6918106495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:17.898143 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dd835-179b-4b80-8a39-eb6918106495 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:17.898611 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dd835-179b-4b80-8a39-eb6918106495 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:17.898903 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6dd835-179b-4b80-8a39-eb6918106495 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:17.899623 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6dd835-179b-4b80-8a39-eb6918106495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:17.901748 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6dd835-179b-4b80-8a39-eb6918106495 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:17.937901 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1035/2060] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:53:17 2022] POST /identity/v3/projects => generated 367 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:17.942548 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6c7a9-fd1a-4428-90ca-d593cd6b92da None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:17.954669 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6c7a9-fd1a-4428-90ca-d593cd6b92da None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:18.058593 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a69ac-779b-4ef5-8995-74e515939d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:18.059560 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a69ac-779b-4ef5-8995-74e515939d5b admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:18.059744 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a69ac-779b-4ef5-8995-74e515939d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:18.060100 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94a69ac-779b-4ef5-8995-74e515939d5b admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:18.061132 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a69ac-779b-4ef5-8995-74e515939d5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:18.063727 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94a69ac-779b-4ef5-8995-74e515939d5b admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:18.099152 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1026/2061] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:53:17 2022] POST /identity/v3/users => generated 290 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:18.103442 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6dd835-179b-4b80-8a39-eb6918106495 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:18.124834 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6dd835-179b-4b80-8a39-eb6918106495 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:18.130713 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637c98f-910d-4210-bf0c-31a2b0b7a9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:18.131408 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637c98f-910d-4210-bf0c-31a2b0b7a9bb admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:18.131690 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637c98f-910d-4210-bf0c-31a2b0b7a9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:18.131964 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637c98f-910d-4210-bf0c-31a2b0b7a9bb admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:18.132704 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637c98f-910d-4210-bf0c-31a2b0b7a9bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:18.134395 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637c98f-910d-4210-bf0c-31a2b0b7a9bb admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:18.146086 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1036/2062] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:18.150131 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a69ac-779b-4ef5-8995-74e515939d5b admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:18.160990 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94a69ac-779b-4ef5-8995-74e515939d5b admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:18.165634 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4cd35-b6e0-44b8-b7ae-2d8436bcb7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:18.166636 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4cd35-b6e0-44b8-b7ae-2d8436bcb7f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:18.166987 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4cd35-b6e0-44b8-b7ae-2d8436bcb7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:18.167331 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f4cd35-b6e0-44b8-b7ae-2d8436bcb7f7 admin admin] PATH_INFO: `/v3/projects/cf26bac8ebb74aa4a619e61cc7db0b12/users/622cfb47229f47bdb3778dcac7b03d50/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:18.183158 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4cd35-b6e0-44b8-b7ae-2d8436bcb7f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf26bac8ebb74aa4a619e61cc7db0b12, user_id=622cfb47229f47bdb3778dcac7b03d50, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:18.185997 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f4cd35-b6e0-44b8-b7ae-2d8436bcb7f7 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:18.201244 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1027/2063] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:18 2022] PUT /identity/v3/projects/cf26bac8ebb74aa4a619e61cc7db0b12/users/622cfb47229f47bdb3778dcac7b03d50/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:18.205221 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637c98f-910d-4210-bf0c-31a2b0b7a9bb admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:18.217242 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637c98f-910d-4210-bf0c-31a2b0b7a9bb admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:18.274593 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2718df10-6ec0-4952-bf93-5b4f6f8235f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:18.275188 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718df10-6ec0-4952-bf93-5b4f6f8235f2 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:18.275471 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718df10-6ec0-4952-bf93-5b4f6f8235f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:18.275747 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2718df10-6ec0-4952-bf93-5b4f6f8235f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:18.276484 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718df10-6ec0-4952-bf93-5b4f6f8235f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:18.278141 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2718df10-6ec0-4952-bf93-5b4f6f8235f2 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:18.288250 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1037/2064] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:18.292574 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4cd35-b6e0-44b8-b7ae-2d8436bcb7f7 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:18.302842 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f4cd35-b6e0-44b8-b7ae-2d8436bcb7f7 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:18.307497 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea558392-79b3-4d6b-a566-97a1562255af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:18.308451 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea558392-79b3-4d6b-a566-97a1562255af admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:18.308818 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea558392-79b3-4d6b-a566-97a1562255af admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:18.309190 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea558392-79b3-4d6b-a566-97a1562255af admin admin] PATH_INFO: `/v3/projects/cf26bac8ebb74aa4a619e61cc7db0b12/users/622cfb47229f47bdb3778dcac7b03d50/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:18.311329 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea558392-79b3-4d6b-a566-97a1562255af admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf26bac8ebb74aa4a619e61cc7db0b12, user_id=622cfb47229f47bdb3778dcac7b03d50, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:18.314072 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea558392-79b3-4d6b-a566-97a1562255af admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:18.327088 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1028/2065] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:18 2022] PUT /identity/v3/projects/cf26bac8ebb74aa4a619e61cc7db0b12/users/622cfb47229f47bdb3778dcac7b03d50/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:53:18.340316 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92e6aa-2a15-4720-a311-b470178c5db0 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:18.340674 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92e6aa-2a15-4720-a311-b470178c5db0 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:18.340879 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92e6aa-2a15-4720-a311-b470178c5db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:18.368521 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-2f92e6aa-2a15-4720-a311-b470178c5db0 None None] MFA Rules not processed for user `622cfb47229f47bdb3778dcac7b03d50`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:18.370150 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-2f92e6aa-2a15-4720-a311-b470178c5db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:18.453209 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1038/2066] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:18 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:53:18.465674 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea558392-79b3-4d6b-a566-97a1562255af admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:18.467769 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-ea558392-79b3-4d6b-a566-97a1562255af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:18.544463 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea558392-79b3-4d6b-a566-97a1562255af admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:18.548680 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80cc4f6-3db7-4d18-b9d9-afca79eefe0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:18.549607 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cc4f6-3db7-4d18-b9d9-afca79eefe0f service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:18.549947 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cc4f6-3db7-4d18-b9d9-afca79eefe0f service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:18.550284 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80cc4f6-3db7-4d18-b9d9-afca79eefe0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:18.563624 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80cc4f6-3db7-4d18-b9d9-afca79eefe0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:18.565867 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80cc4f6-3db7-4d18-b9d9-afca79eefe0f service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:18.579109 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1029/2067] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:18 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:18.675162 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92e6aa-2a15-4720-a311-b470178c5db0 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:18.677315 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-2f92e6aa-2a15-4720-a311-b470178c5db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:18.701321 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92e6aa-2a15-4720-a311-b470178c5db0 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:18.705713 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcce97-a293-4051-9ef7-6d33a33929c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:18.706215 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcce97-a293-4051-9ef7-6d33a33929c7 service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:18.706596 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcce97-a293-4051-9ef7-6d33a33929c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:18.706939 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcce97-a293-4051-9ef7-6d33a33929c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:18.840113 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcce97-a293-4051-9ef7-6d33a33929c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:18.843151 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcce97-a293-4051-9ef7-6d33a33929c7 service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:18.853953 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1039/2068] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:18 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:20.993399 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cc965-d1b3-424b-9f91-01de14400d5e None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:20.994534 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cc965-d1b3-424b-9f91-01de14400d5e None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:20.995012 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778cc965-d1b3-424b-9f91-01de14400d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:21.056933 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-778cc965-d1b3-424b-9f91-01de14400d5e None None] MFA Rules not processed for user `4f705be9921a4daabe961e170fe7efd2`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:21.060917 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-778cc965-d1b3-424b-9f91-01de14400d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:21.179121 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1030/2069] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:21.186587 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcce97-a293-4051-9ef7-6d33a33929c7 service cinder] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:21.189302 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-2bdcce97-a293-4051-9ef7-6d33a33929c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:21.289197 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcce97-a293-4051-9ef7-6d33a33929c7 service cinder] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:21.305961 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db51e3-b539-4a14-8de6-dd06bb630a4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:21.306641 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db51e3-b539-4a14-8de6-dd06bb630a4f service nova] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:21.306924 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db51e3-b539-4a14-8de6-dd06bb630a4f service nova] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:21.307385 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db51e3-b539-4a14-8de6-dd06bb630a4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:21.316002 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db51e3-b539-4a14-8de6-dd06bb630a4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:21.317695 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db51e3-b539-4a14-8de6-dd06bb630a4f service nova] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:21.327151 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1040/2070] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:22.798095 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cc965-d1b3-424b-9f91-01de14400d5e None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:22.823658 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900e969-f10a-43e4-a066-2c2a32607f15 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:22.824239 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900e969-f10a-43e4-a066-2c2a32607f15 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:22.824239 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5900e969-f10a-43e4-a066-2c2a32607f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:22.845896 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-5900e969-f10a-43e4-a066-2c2a32607f15 None None] MFA Rules not processed for user `4f705be9921a4daabe961e170fe7efd2`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:22.847174 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-5900e969-f10a-43e4-a066-2c2a32607f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:22.854650 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1041/2071] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:53:22.884145 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778cc965-d1b3-424b-9f91-01de14400d5e None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:22.889115 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01725d-66c1-4122-b6cb-af7236827b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:22.890100 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01725d-66c1-4122-b6cb-af7236827b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:22.890439 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01725d-66c1-4122-b6cb-af7236827b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:22.890926 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01725d-66c1-4122-b6cb-af7236827b84 admin admin] PATH_INFO: `/v3/users/0f23fa5d321645dcb60c7c36e6623231` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:22.892305 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01725d-66c1-4122-b6cb-af7236827b84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f23fa5d321645dcb60c7c36e6623231)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:22.894465 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01725d-66c1-4122-b6cb-af7236827b84 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:22.957624 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-2b01725d-66c1-4122-b6cb-af7236827b84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f23fa5d321645dcb60c7c36e6623231'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:22.958343 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-2b01725d-66c1-4122-b6cb-af7236827b84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f23fa5d321645dcb60c7c36e6623231'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:22.969535 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-2b01725d-66c1-4122-b6cb-af7236827b84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f23fa5d321645dcb60c7c36e6623231'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:22.983718 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-2b01725d-66c1-4122-b6cb-af7236827b84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f23fa5d321645dcb60c7c36e6623231'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:22.991523 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-2b01725d-66c1-4122-b6cb-af7236827b84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f23fa5d321645dcb60c7c36e6623231'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:22.999290 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1031/2072] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:22 2022] DELETE /identity/v3/users/0f23fa5d321645dcb60c7c36e6623231 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:23.004202 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acb15b-89af-47ea-9e27-a8fe967127d0 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:23.004485 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acb15b-89af-47ea-9e27-a8fe967127d0 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:23.004947 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acb15b-89af-47ea-9e27-a8fe967127d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:23.030637 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-80acb15b-89af-47ea-9e27-a8fe967127d0 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:23.032295 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-80acb15b-89af-47ea-9e27-a8fe967127d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:23.110886 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1042/2073] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:53:23.121305 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01725d-66c1-4122-b6cb-af7236827b84 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:23.123030 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-2b01725d-66c1-4122-b6cb-af7236827b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:23.219888 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01725d-66c1-4122-b6cb-af7236827b84 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:23.224595 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1289d2-7376-4df8-9b82-00b4ab58ef61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:23.225829 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1289d2-7376-4df8-9b82-00b4ab58ef61 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:23.226743 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1289d2-7376-4df8-9b82-00b4ab58ef61 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:23.227200 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1289d2-7376-4df8-9b82-00b4ab58ef61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:23.239967 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1289d2-7376-4df8-9b82-00b4ab58ef61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:23.241922 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1289d2-7376-4df8-9b82-00b4ab58ef61 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:23.261021 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1032/2074] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:23.739285 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acb15b-89af-47ea-9e27-a8fe967127d0 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:23.741864 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-80acb15b-89af-47ea-9e27-a8fe967127d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:23.770137 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acb15b-89af-47ea-9e27-a8fe967127d0 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:23.775515 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14db63-d3f5-460f-84c7-44cf1ab04bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:23.776394 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14db63-d3f5-460f-84c7-44cf1ab04bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:23.777100 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14db63-d3f5-460f-84c7-44cf1ab04bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:23.777489 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b14db63-d3f5-460f-84c7-44cf1ab04bc7 admin admin] PATH_INFO: `/v3/projects/695b3596c25f4ec5a7c75e7b98d433b1` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:23.778891 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14db63-d3f5-460f-84c7-44cf1ab04bc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=695b3596c25f4ec5a7c75e7b98d433b1)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:23.781091 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b14db63-d3f5-460f-84c7-44cf1ab04bc7 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:23.852613 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-7b14db63-d3f5-460f-84c7-44cf1ab04bc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '695b3596c25f4ec5a7c75e7b98d433b1', 'request_id': 'req-7b14db63-d3f5-460f-84c7-44cf1ab04bc7'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:23.858976 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-7b14db63-d3f5-460f-84c7-44cf1ab04bc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '695b3596c25f4ec5a7c75e7b98d433b1', 'request_id': 'req-7b14db63-d3f5-460f-84c7-44cf1ab04bc7'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:23.868499 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-7b14db63-d3f5-460f-84c7-44cf1ab04bc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '695b3596c25f4ec5a7c75e7b98d433b1', 'request_id': 'req-7b14db63-d3f5-460f-84c7-44cf1ab04bc7'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:23.880256 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-7b14db63-d3f5-460f-84c7-44cf1ab04bc7 admin admin] The token cache is being invalidate because project 695b3596c25f4ec5a7c75e7b98d433b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:23.880539 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-7b14db63-d3f5-460f-84c7-44cf1ab04bc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:23.881247 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-7b14db63-d3f5-460f-84c7-44cf1ab04bc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:23.883086 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1043/2075] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:23 2022] DELETE /identity/v3/projects/695b3596c25f4ec5a7c75e7b98d433b1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:23.886860 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1289d2-7376-4df8-9b82-00b4ab58ef61 service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:23.897284 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1289d2-7376-4df8-9b82-00b4ab58ef61 service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:23.996837 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee645e5-d025-43ee-9a80-4c7fb2b9a570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:23.997687 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee645e5-d025-43ee-9a80-4c7fb2b9a570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:23.998212 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee645e5-d025-43ee-9a80-4c7fb2b9a570 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:23.998502 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee645e5-d025-43ee-9a80-4c7fb2b9a570 admin admin] PATH_INFO: `/v3/users/622cfb47229f47bdb3778dcac7b03d50` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:23.999753 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee645e5-d025-43ee-9a80-4c7fb2b9a570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=622cfb47229f47bdb3778dcac7b03d50)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:24.001721 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee645e5-d025-43ee-9a80-4c7fb2b9a570 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:24.061335 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-8ee645e5-d025-43ee-9a80-4c7fb2b9a570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '622cfb47229f47bdb3778dcac7b03d50'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:24.062304 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-8ee645e5-d025-43ee-9a80-4c7fb2b9a570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '622cfb47229f47bdb3778dcac7b03d50'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:24.073149 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-8ee645e5-d025-43ee-9a80-4c7fb2b9a570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '622cfb47229f47bdb3778dcac7b03d50'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:24.089949 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-8ee645e5-d025-43ee-9a80-4c7fb2b9a570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '622cfb47229f47bdb3778dcac7b03d50'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:24.096772 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-8ee645e5-d025-43ee-9a80-4c7fb2b9a570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '622cfb47229f47bdb3778dcac7b03d50'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:24.103069 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1033/2076] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:23 2022] DELETE /identity/v3/users/622cfb47229f47bdb3778dcac7b03d50 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:24.461690 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14db63-d3f5-460f-84c7-44cf1ab04bc7 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:24.463388 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-7b14db63-d3f5-460f-84c7-44cf1ab04bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:24.477496 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b14db63-d3f5-460f-84c7-44cf1ab04bc7 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:24.587215 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fed8eb-8ce5-4699-a262-7018193e5c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:24.588483 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fed8eb-8ce5-4699-a262-7018193e5c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:24.588483 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fed8eb-8ce5-4699-a262-7018193e5c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:24.588675 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fed8eb-8ce5-4699-a262-7018193e5c5d admin admin] PATH_INFO: `/v3/projects/cf26bac8ebb74aa4a619e61cc7db0b12` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:24.589898 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fed8eb-8ce5-4699-a262-7018193e5c5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf26bac8ebb74aa4a619e61cc7db0b12)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:24.591929 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fed8eb-8ce5-4699-a262-7018193e5c5d admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:24.670432 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-67fed8eb-8ce5-4699-a262-7018193e5c5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf26bac8ebb74aa4a619e61cc7db0b12', 'request_id': 'req-67fed8eb-8ce5-4699-a262-7018193e5c5d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:24.678480 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-67fed8eb-8ce5-4699-a262-7018193e5c5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf26bac8ebb74aa4a619e61cc7db0b12', 'request_id': 'req-67fed8eb-8ce5-4699-a262-7018193e5c5d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:24.690958 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-67fed8eb-8ce5-4699-a262-7018193e5c5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf26bac8ebb74aa4a619e61cc7db0b12', 'request_id': 'req-67fed8eb-8ce5-4699-a262-7018193e5c5d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:24.716425 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-67fed8eb-8ce5-4699-a262-7018193e5c5d admin admin] The token cache is being invalidate because project cf26bac8ebb74aa4a619e61cc7db0b12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:24.716813 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-67fed8eb-8ce5-4699-a262-7018193e5c5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:24.721891 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-67fed8eb-8ce5-4699-a262-7018193e5c5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:24.727784 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1044/2077] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:24 2022] DELETE /identity/v3/projects/cf26bac8ebb74aa4a619e61cc7db0b12 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:24.729398 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71105fbf-9162-4a9e-b66c-0acf0be9881a None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:24.729683 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71105fbf-9162-4a9e-b66c-0acf0be9881a None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:24.729962 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71105fbf-9162-4a9e-b66c-0acf0be9881a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:24.761093 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-71105fbf-9162-4a9e-b66c-0acf0be9881a None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:24.763626 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-71105fbf-9162-4a9e-b66c-0acf0be9881a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:24.874069 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1034/2078] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:53:24.882429 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c66de5-a486-4e50-9b5c-5cd00356e126 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:24.882973 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c66de5-a486-4e50-9b5c-5cd00356e126 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:24.882973 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c66de5-a486-4e50-9b5c-5cd00356e126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:24.909244 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-91c66de5-a486-4e50-9b5c-5cd00356e126 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:24.910532 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-91c66de5-a486-4e50-9b5c-5cd00356e126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:24.918936 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1045/2079] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:24.923431 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71105fbf-9162-4a9e-b66c-0acf0be9881a None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:24.934457 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71105fbf-9162-4a9e-b66c-0acf0be9881a None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:24.940223 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b244432-fa22-439e-b291-f052301091d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:24.940901 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b244432-fa22-439e-b291-f052301091d1 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:24.941179 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b244432-fa22-439e-b291-f052301091d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:24.941484 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b244432-fa22-439e-b291-f052301091d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:24.942229 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b244432-fa22-439e-b291-f052301091d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:53:24.942530 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b244432-fa22-439e-b291-f052301091d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:24.944168 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b244432-fa22-439e-b291-f052301091d1 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:24.960380 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1035/2080] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:53:24.961737 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c66de5-a486-4e50-9b5c-5cd00356e126 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:24.971736 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c66de5-a486-4e50-9b5c-5cd00356e126 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:24.976410 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92369809-6cd4-4843-bdf3-ff6f96e53816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:24.977073 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92369809-6cd4-4843-bdf3-ff6f96e53816 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:24.977375 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92369809-6cd4-4843-bdf3-ff6f96e53816 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:24.977684 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92369809-6cd4-4843-bdf3-ff6f96e53816 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:24.978386 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92369809-6cd4-4843-bdf3-ff6f96e53816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:24.980310 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92369809-6cd4-4843-bdf3-ff6f96e53816 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:25.009402 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1046/2081] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:53:24 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:25.013681 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b244432-fa22-439e-b291-f052301091d1 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:25.024339 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b244432-fa22-439e-b291-f052301091d1 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:25.087003 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952a7ce-0011-4d62-99ea-e5ffc5b249f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:25.087783 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952a7ce-0011-4d62-99ea-e5ffc5b249f4 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:25.088166 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952a7ce-0011-4d62-99ea-e5ffc5b249f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:25.088506 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952a7ce-0011-4d62-99ea-e5ffc5b249f4 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:25.089274 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952a7ce-0011-4d62-99ea-e5ffc5b249f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:25.091289 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952a7ce-0011-4d62-99ea-e5ffc5b249f4 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:25.120583 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1036/2082] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:53:25 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:53:25.121835 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92369809-6cd4-4843-bdf3-ff6f96e53816 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:25.133643 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92369809-6cd4-4843-bdf3-ff6f96e53816 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:25.139457 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53961ee-eb5d-4bd3-9d4f-f769800ef520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:25.140150 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53961ee-eb5d-4bd3-9d4f-f769800ef520 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:25.140432 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53961ee-eb5d-4bd3-9d4f-f769800ef520 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:25.140708 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53961ee-eb5d-4bd3-9d4f-f769800ef520 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:25.141478 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53961ee-eb5d-4bd3-9d4f-f769800ef520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:25.143461 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53961ee-eb5d-4bd3-9d4f-f769800ef520 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:25.155823 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1047/2083] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:53:25.160031 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952a7ce-0011-4d62-99ea-e5ffc5b249f4 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:25.170347 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952a7ce-0011-4d62-99ea-e5ffc5b249f4 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:25.175912 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179faf13-ffb1-4c60-90b8-4fcd1a1046ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:25.177265 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179faf13-ffb1-4c60-90b8-4fcd1a1046ee admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:25.177597 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179faf13-ffb1-4c60-90b8-4fcd1a1046ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:25.177989 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179faf13-ffb1-4c60-90b8-4fcd1a1046ee admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:25.178768 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179faf13-ffb1-4c60-90b8-4fcd1a1046ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:25.180397 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179faf13-ffb1-4c60-90b8-4fcd1a1046ee admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:25.197328 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1037/2084] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:25.201745 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53961ee-eb5d-4bd3-9d4f-f769800ef520 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:25.213078 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53961ee-eb5d-4bd3-9d4f-f769800ef520 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:25.219145 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd24d1c-4fad-480d-99d5-d003afa426bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:25.220195 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd24d1c-4fad-480d-99d5-d003afa426bb admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:25.220583 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd24d1c-4fad-480d-99d5-d003afa426bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:25.220976 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd24d1c-4fad-480d-99d5-d003afa426bb admin admin] PATH_INFO: `/v3/projects/657848b222524f5cb76ebc5ee5c00a5e/users/34c0ad3999064e85a39938e23f393acc/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:25.239141 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd24d1c-4fad-480d-99d5-d003afa426bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=657848b222524f5cb76ebc5ee5c00a5e, user_id=34c0ad3999064e85a39938e23f393acc, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:25.243134 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd24d1c-4fad-480d-99d5-d003afa426bb admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:25.267607 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1048/2085] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:25 2022] PUT /identity/v3/projects/657848b222524f5cb76ebc5ee5c00a5e/users/34c0ad3999064e85a39938e23f393acc/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:53:25.279822 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329a48a-6c2a-40db-9e06-d007725c33b5 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:25.283223 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329a48a-6c2a-40db-9e06-d007725c33b5 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:25.283773 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329a48a-6c2a-40db-9e06-d007725c33b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:25.326450 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-8329a48a-6c2a-40db-9e06-d007725c33b5 None None] MFA Rules not processed for user `34c0ad3999064e85a39938e23f393acc`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:25.327688 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-8329a48a-6c2a-40db-9e06-d007725c33b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:25.423057 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd24d1c-4fad-480d-99d5-d003afa426bb admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:25.427707 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1038/2086] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:53:25.502453 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd24d1c-4fad-480d-99d5-d003afa426bb admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:25.508247 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20afee-7ce6-475f-b1d0-a34e3bc6b720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:25.509276 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20afee-7ce6-475f-b1d0-a34e3bc6b720 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:25.509718 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20afee-7ce6-475f-b1d0-a34e3bc6b720 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:25.510107 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20afee-7ce6-475f-b1d0-a34e3bc6b720 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:25.510924 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20afee-7ce6-475f-b1d0-a34e3bc6b720 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:25.512981 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20afee-7ce6-475f-b1d0-a34e3bc6b720 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:25.546304 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1049/2087] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:53:25 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:25.547779 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329a48a-6c2a-40db-9e06-d007725c33b5 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:25.558558 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329a48a-6c2a-40db-9e06-d007725c33b5 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:25.620053 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88939a-c60e-42ee-a67b-b76633613d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:25.620729 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88939a-c60e-42ee-a67b-b76633613d8b admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:25.621006 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88939a-c60e-42ee-a67b-b76633613d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:25.621274 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88939a-c60e-42ee-a67b-b76633613d8b admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:25.622001 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88939a-c60e-42ee-a67b-b76633613d8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:25.623966 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88939a-c60e-42ee-a67b-b76633613d8b admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:25.655945 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1039/2088] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:53:25 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:53:25.656881 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20afee-7ce6-475f-b1d0-a34e3bc6b720 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:25.667448 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20afee-7ce6-475f-b1d0-a34e3bc6b720 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:25.672035 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8adb0e4-b021-4df8-9a65-68e84a3ccbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:25.672693 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8adb0e4-b021-4df8-9a65-68e84a3ccbdb admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:25.672974 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8adb0e4-b021-4df8-9a65-68e84a3ccbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:25.673248 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8adb0e4-b021-4df8-9a65-68e84a3ccbdb admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:25.674013 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8adb0e4-b021-4df8-9a65-68e84a3ccbdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:25.675612 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8adb0e4-b021-4df8-9a65-68e84a3ccbdb admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:25.688841 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1050/2089] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:53:25.690158 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88939a-c60e-42ee-a67b-b76633613d8b admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:25.699938 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88939a-c60e-42ee-a67b-b76633613d8b admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:25.706158 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4c66a-3fe0-4526-966d-3d5b507a5a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:25.706845 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4c66a-3fe0-4526-966d-3d5b507a5a2e admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:25.707125 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4c66a-3fe0-4526-966d-3d5b507a5a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:25.707401 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4c66a-3fe0-4526-966d-3d5b507a5a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:25.708137 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4c66a-3fe0-4526-966d-3d5b507a5a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:25.709801 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4c66a-3fe0-4526-966d-3d5b507a5a2e admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:25.721269 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1040/2090] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:25.725486 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8adb0e4-b021-4df8-9a65-68e84a3ccbdb admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:25.737098 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8adb0e4-b021-4df8-9a65-68e84a3ccbdb admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:25.742342 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56306adf-8352-49a7-85e8-f8d118ef17f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:25.743322 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56306adf-8352-49a7-85e8-f8d118ef17f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:25.743675 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56306adf-8352-49a7-85e8-f8d118ef17f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:25.743954 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56306adf-8352-49a7-85e8-f8d118ef17f8 admin admin] PATH_INFO: `/v3/projects/f19a6da1f3d24852be826b5dabd8ed12/users/3b86f6172cb24e75afd597dd99704033/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:25.759371 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56306adf-8352-49a7-85e8-f8d118ef17f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19a6da1f3d24852be826b5dabd8ed12, user_id=3b86f6172cb24e75afd597dd99704033, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:25.762044 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56306adf-8352-49a7-85e8-f8d118ef17f8 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:25.776149 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1051/2091] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:25 2022] PUT /identity/v3/projects/f19a6da1f3d24852be826b5dabd8ed12/users/3b86f6172cb24e75afd597dd99704033/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:25.787965 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25b741-c30f-45b8-acd2-ee5e9d285432 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:25.788262 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25b741-c30f-45b8-acd2-ee5e9d285432 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:25.788538 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25b741-c30f-45b8-acd2-ee5e9d285432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:25.817273 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-ce25b741-c30f-45b8-acd2-ee5e9d285432 None None] MFA Rules not processed for user `3b86f6172cb24e75afd597dd99704033`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:25.818537 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-ce25b741-c30f-45b8-acd2-ee5e9d285432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:25.894046 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1041/2092] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:25.898772 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56306adf-8352-49a7-85e8-f8d118ef17f8 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:25.962292 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56306adf-8352-49a7-85e8-f8d118ef17f8 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:25.967135 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a62904-1d98-422c-bd55-bdf272e274eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:25.967803 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a62904-1d98-422c-bd55-bdf272e274eb admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:25.968085 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a62904-1d98-422c-bd55-bdf272e274eb admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:25.968361 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a62904-1d98-422c-bd55-bdf272e274eb admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:25.969074 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a62904-1d98-422c-bd55-bdf272e274eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:25.971019 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a62904-1d98-422c-bd55-bdf272e274eb admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:26.005093 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1052/2093] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:53:25 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:26.009229 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25b741-c30f-45b8-acd2-ee5e9d285432 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:26.021492 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25b741-c30f-45b8-acd2-ee5e9d285432 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:26.085374 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df217071-4bbb-4b75-8cf7-839ba64e3c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:26.086175 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df217071-4bbb-4b75-8cf7-839ba64e3c86 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:26.086527 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df217071-4bbb-4b75-8cf7-839ba64e3c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:26.086863 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df217071-4bbb-4b75-8cf7-839ba64e3c86 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:26.087631 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df217071-4bbb-4b75-8cf7-839ba64e3c86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:26.089713 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df217071-4bbb-4b75-8cf7-839ba64e3c86 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:26.116532 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1042/2094] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:53:26 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:53:26.122597 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a62904-1d98-422c-bd55-bdf272e274eb admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:26.131937 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a62904-1d98-422c-bd55-bdf272e274eb admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:26.138260 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bee649-0169-44ba-9338-83ca6395e45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:26.139069 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bee649-0169-44ba-9338-83ca6395e45b admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:26.139441 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bee649-0169-44ba-9338-83ca6395e45b admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:26.139783 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bee649-0169-44ba-9338-83ca6395e45b admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:26.140589 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bee649-0169-44ba-9338-83ca6395e45b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:26.142365 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bee649-0169-44ba-9338-83ca6395e45b admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:26.155094 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1053/2095] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:53:26.166750 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df217071-4bbb-4b75-8cf7-839ba64e3c86 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:26.177972 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df217071-4bbb-4b75-8cf7-839ba64e3c86 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:26.183516 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b21059-b6bd-4790-af0d-610898837d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:26.184420 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b21059-b6bd-4790-af0d-610898837d7a admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:26.184697 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b21059-b6bd-4790-af0d-610898837d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:26.189590 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b21059-b6bd-4790-af0d-610898837d7a admin admin] PATH_INFO: `/v3/projects/35fbe76bed2d470faf7539d650b60590/users/bc8c3f111f044efbb9c8340c7c7c962c/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:26.208394 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b21059-b6bd-4790-af0d-610898837d7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=35fbe76bed2d470faf7539d650b60590, user_id=bc8c3f111f044efbb9c8340c7c7c962c, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:26.211259 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b21059-b6bd-4790-af0d-610898837d7a admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:26.227484 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1043/2096] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:26 2022] PUT /identity/v3/projects/35fbe76bed2d470faf7539d650b60590/users/bc8c3f111f044efbb9c8340c7c7c962c/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:26.231784 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bee649-0169-44ba-9338-83ca6395e45b admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:26.242443 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bee649-0169-44ba-9338-83ca6395e45b admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:26.321315 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c93888-3755-4174-bfc8-5837779f9731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:26.322102 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c93888-3755-4174-bfc8-5837779f9731 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:26.322394 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c93888-3755-4174-bfc8-5837779f9731 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:26.322666 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c93888-3755-4174-bfc8-5837779f9731 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:26.323605 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c93888-3755-4174-bfc8-5837779f9731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:26.325172 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c93888-3755-4174-bfc8-5837779f9731 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:26.336492 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1054/2097] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:26.340905 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b21059-b6bd-4790-af0d-610898837d7a admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:26.360691 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b21059-b6bd-4790-af0d-610898837d7a admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:26.365717 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee96670-9bd3-4b81-b690-e29fe1cb8fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:26.366778 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee96670-9bd3-4b81-b690-e29fe1cb8fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:26.367057 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee96670-9bd3-4b81-b690-e29fe1cb8fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:26.367342 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee96670-9bd3-4b81-b690-e29fe1cb8fd0 admin admin] PATH_INFO: `/v3/projects/35fbe76bed2d470faf7539d650b60590/users/bc8c3f111f044efbb9c8340c7c7c962c/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:26.369330 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee96670-9bd3-4b81-b690-e29fe1cb8fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35fbe76bed2d470faf7539d650b60590, user_id=bc8c3f111f044efbb9c8340c7c7c962c, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:26.372157 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee96670-9bd3-4b81-b690-e29fe1cb8fd0 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:26.385597 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1044/2098] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:26 2022] PUT /identity/v3/projects/35fbe76bed2d470faf7539d650b60590/users/bc8c3f111f044efbb9c8340c7c7c962c/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:26.396409 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea9c0f-bd0f-4649-b5bd-9106edb215c9 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:26.397011 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea9c0f-bd0f-4649-b5bd-9106edb215c9 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:26.397311 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea9c0f-bd0f-4649-b5bd-9106edb215c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:26.437894 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-1eea9c0f-bd0f-4649-b5bd-9106edb215c9 None None] MFA Rules not processed for user `bc8c3f111f044efbb9c8340c7c7c962c`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:26.439120 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-1eea9c0f-bd0f-4649-b5bd-9106edb215c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:26.511230 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1055/2099] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:26.522279 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee96670-9bd3-4b81-b690-e29fe1cb8fd0 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:26.524042 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-7ee96670-9bd3-4b81-b690-e29fe1cb8fd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:26.582728 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee96670-9bd3-4b81-b690-e29fe1cb8fd0 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:26.586817 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a33981-8bdc-4e7b-8fe5-a825254eeb35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:26.587571 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a33981-8bdc-4e7b-8fe5-a825254eeb35 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:26.587850 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a33981-8bdc-4e7b-8fe5-a825254eeb35 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:26.588118 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a33981-8bdc-4e7b-8fe5-a825254eeb35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:26.598183 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a33981-8bdc-4e7b-8fe5-a825254eeb35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:26.599780 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a33981-8bdc-4e7b-8fe5-a825254eeb35 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:26.610566 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1045/2100] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:27.189935 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea9c0f-bd0f-4649-b5bd-9106edb215c9 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:27.204248 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea9c0f-bd0f-4649-b5bd-9106edb215c9 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:27.208212 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69926c11-bae7-4f19-bcf3-9f7b5bc500a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:27.208922 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69926c11-bae7-4f19-bcf3-9f7b5bc500a4 service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:27.209382 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69926c11-bae7-4f19-bcf3-9f7b5bc500a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:27.209805 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69926c11-bae7-4f19-bcf3-9f7b5bc500a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:27.273822 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69926c11-bae7-4f19-bcf3-9f7b5bc500a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:27.276071 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69926c11-bae7-4f19-bcf3-9f7b5bc500a4 service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:27.284820 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1056/2101] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:31.330927 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a33981-8bdc-4e7b-8fe5-a825254eeb35 service cinder] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:31.339995 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a33981-8bdc-4e7b-8fe5-a825254eeb35 service cinder] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:31.344923 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1bf9f9-686b-4718-80bc-b47562754003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:31.345931 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bf9f9-686b-4718-80bc-b47562754003 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:31.346359 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bf9f9-686b-4718-80bc-b47562754003 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:31.346777 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1bf9f9-686b-4718-80bc-b47562754003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:31.409228 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1bf9f9-686b-4718-80bc-b47562754003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:31.410809 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1bf9f9-686b-4718-80bc-b47562754003 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:31.419973 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1046/2102] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:34.777221 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69926c11-bae7-4f19-bcf3-9f7b5bc500a4 service cinder] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:34.841021 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69926c11-bae7-4f19-bcf3-9f7b5bc500a4 service cinder] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:34.845541 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada81a1-5efd-448f-98f1-e5ec30c67379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:34.846415 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada81a1-5efd-448f-98f1-e5ec30c67379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:34.846692 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada81a1-5efd-448f-98f1-e5ec30c67379 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:34.846965 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada81a1-5efd-448f-98f1-e5ec30c67379 admin admin] PATH_INFO: `/v3/users/34c0ad3999064e85a39938e23f393acc` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:34.848150 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada81a1-5efd-448f-98f1-e5ec30c67379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34c0ad3999064e85a39938e23f393acc)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:34.850113 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada81a1-5efd-448f-98f1-e5ec30c67379 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:34.895748 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-1ada81a1-5efd-448f-98f1-e5ec30c67379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34c0ad3999064e85a39938e23f393acc'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:34.896400 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-1ada81a1-5efd-448f-98f1-e5ec30c67379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34c0ad3999064e85a39938e23f393acc'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:34.904857 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-1ada81a1-5efd-448f-98f1-e5ec30c67379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34c0ad3999064e85a39938e23f393acc'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:34.912043 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-1ada81a1-5efd-448f-98f1-e5ec30c67379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34c0ad3999064e85a39938e23f393acc'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:34.925619 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-1ada81a1-5efd-448f-98f1-e5ec30c67379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34c0ad3999064e85a39938e23f393acc'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:34.931987 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1057/2103] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:34 2022] DELETE /identity/v3/users/34c0ad3999064e85a39938e23f393acc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:34.936591 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431e6bb-18b8-4982-888e-720676f70f39 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:34.937060 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431e6bb-18b8-4982-888e-720676f70f39 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:34.937150 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431e6bb-18b8-4982-888e-720676f70f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:34.954792 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-4431e6bb-18b8-4982-888e-720676f70f39 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:34.956317 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-4431e6bb-18b8-4982-888e-720676f70f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:35.016733 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1047/2104] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:35.028168 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada81a1-5efd-448f-98f1-e5ec30c67379 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:35.030345 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-1ada81a1-5efd-448f-98f1-e5ec30c67379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:35.095126 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada81a1-5efd-448f-98f1-e5ec30c67379 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:35.099204 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3eaf4f-e660-4dde-a127-a75c7aaae6f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:35.099900 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3eaf4f-e660-4dde-a127-a75c7aaae6f2 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:35.100226 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3eaf4f-e660-4dde-a127-a75c7aaae6f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:35.100451 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3eaf4f-e660-4dde-a127-a75c7aaae6f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:35.109946 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3eaf4f-e660-4dde-a127-a75c7aaae6f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:35.111382 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3eaf4f-e660-4dde-a127-a75c7aaae6f2 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:35.121000 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1058/2105] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:35.379577 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431e6bb-18b8-4982-888e-720676f70f39 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:35.381024 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-4431e6bb-18b8-4982-888e-720676f70f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:35.393375 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431e6bb-18b8-4982-888e-720676f70f39 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:35.398406 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852a26c-9c96-4675-a20f-a638f439bc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:35.399352 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852a26c-9c96-4675-a20f-a638f439bc29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:35.399625 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852a26c-9c96-4675-a20f-a638f439bc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:35.399909 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d852a26c-9c96-4675-a20f-a638f439bc29 admin admin] PATH_INFO: `/v3/projects/657848b222524f5cb76ebc5ee5c00a5e` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:35.401084 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852a26c-9c96-4675-a20f-a638f439bc29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=657848b222524f5cb76ebc5ee5c00a5e)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:35.402990 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d852a26c-9c96-4675-a20f-a638f439bc29 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:35.448135 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-d852a26c-9c96-4675-a20f-a638f439bc29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '657848b222524f5cb76ebc5ee5c00a5e', 'request_id': 'req-d852a26c-9c96-4675-a20f-a638f439bc29'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:35.454686 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-d852a26c-9c96-4675-a20f-a638f439bc29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '657848b222524f5cb76ebc5ee5c00a5e', 'request_id': 'req-d852a26c-9c96-4675-a20f-a638f439bc29'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:35.464885 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-d852a26c-9c96-4675-a20f-a638f439bc29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '657848b222524f5cb76ebc5ee5c00a5e', 'request_id': 'req-d852a26c-9c96-4675-a20f-a638f439bc29'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:35.476732 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-d852a26c-9c96-4675-a20f-a638f439bc29 admin admin] The token cache is being invalidate because project 657848b222524f5cb76ebc5ee5c00a5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:35.476998 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-d852a26c-9c96-4675-a20f-a638f439bc29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:35.477744 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-d852a26c-9c96-4675-a20f-a638f439bc29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:35.479323 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1048/2106] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:35 2022] DELETE /identity/v3/projects/657848b222524f5cb76ebc5ee5c00a5e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:35.483312 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3eaf4f-e660-4dde-a127-a75c7aaae6f2 service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:35.493118 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3eaf4f-e660-4dde-a127-a75c7aaae6f2 service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:35.551374 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506dc01c-467c-4090-acf3-a8171bbbb301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:35.552243 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dc01c-467c-4090-acf3-a8171bbbb301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:35.552518 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dc01c-467c-4090-acf3-a8171bbbb301 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:35.552787 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dc01c-467c-4090-acf3-a8171bbbb301 admin admin] PATH_INFO: `/v3/users/3b86f6172cb24e75afd597dd99704033` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:35.554012 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506dc01c-467c-4090-acf3-a8171bbbb301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b86f6172cb24e75afd597dd99704033)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:35.555929 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506dc01c-467c-4090-acf3-a8171bbbb301 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:35.605490 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-506dc01c-467c-4090-acf3-a8171bbbb301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b86f6172cb24e75afd597dd99704033'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:35.606161 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-506dc01c-467c-4090-acf3-a8171bbbb301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b86f6172cb24e75afd597dd99704033'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:35.614357 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-506dc01c-467c-4090-acf3-a8171bbbb301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b86f6172cb24e75afd597dd99704033'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:35.621035 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-506dc01c-467c-4090-acf3-a8171bbbb301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b86f6172cb24e75afd597dd99704033'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:35.632304 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-506dc01c-467c-4090-acf3-a8171bbbb301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b86f6172cb24e75afd597dd99704033'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:35.638080 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1059/2107] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:35 2022] DELETE /identity/v3/users/3b86f6172cb24e75afd597dd99704033 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:35.993678 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852a26c-9c96-4675-a20f-a638f439bc29 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:35.995497 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-d852a26c-9c96-4675-a20f-a638f439bc29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:36.009075 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d852a26c-9c96-4675-a20f-a638f439bc29 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:36.069194 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da2eb6-23d3-4105-b900-c377e679850f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:36.070230 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da2eb6-23d3-4105-b900-c377e679850f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:36.070569 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da2eb6-23d3-4105-b900-c377e679850f admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:36.070953 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da2eb6-23d3-4105-b900-c377e679850f admin admin] PATH_INFO: `/v3/projects/f19a6da1f3d24852be826b5dabd8ed12` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:36.072251 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da2eb6-23d3-4105-b900-c377e679850f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f19a6da1f3d24852be826b5dabd8ed12)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:36.074259 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da2eb6-23d3-4105-b900-c377e679850f admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:36.126486 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-98da2eb6-23d3-4105-b900-c377e679850f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f19a6da1f3d24852be826b5dabd8ed12', 'request_id': 'req-98da2eb6-23d3-4105-b900-c377e679850f'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:36.134178 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-98da2eb6-23d3-4105-b900-c377e679850f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f19a6da1f3d24852be826b5dabd8ed12', 'request_id': 'req-98da2eb6-23d3-4105-b900-c377e679850f'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:36.144151 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-98da2eb6-23d3-4105-b900-c377e679850f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f19a6da1f3d24852be826b5dabd8ed12', 'request_id': 'req-98da2eb6-23d3-4105-b900-c377e679850f'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:36.158306 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-98da2eb6-23d3-4105-b900-c377e679850f admin admin] The token cache is being invalidate because project f19a6da1f3d24852be826b5dabd8ed12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:36.158595 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-98da2eb6-23d3-4105-b900-c377e679850f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:36.159255 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-98da2eb6-23d3-4105-b900-c377e679850f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:36.163786 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1049/2108] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:35 2022] DELETE /identity/v3/projects/f19a6da1f3d24852be826b5dabd8ed12 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:36.166108 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506dc01c-467c-4090-acf3-a8171bbbb301 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:36.167557 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-506dc01c-467c-4090-acf3-a8171bbbb301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:36.192100 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506dc01c-467c-4090-acf3-a8171bbbb301 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:36.253263 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0bca5-0838-4ba9-ab50-aeb006a9521b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:36.254225 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0bca5-0838-4ba9-ab50-aeb006a9521b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:36.254497 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0bca5-0838-4ba9-ab50-aeb006a9521b admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:36.254768 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0bca5-0838-4ba9-ab50-aeb006a9521b admin admin] PATH_INFO: `/v3/users/bc8c3f111f044efbb9c8340c7c7c962c` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:36.255985 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0bca5-0838-4ba9-ab50-aeb006a9521b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc8c3f111f044efbb9c8340c7c7c962c)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:36.257981 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0bca5-0838-4ba9-ab50-aeb006a9521b admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:36.304510 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-afb0bca5-0838-4ba9-ab50-aeb006a9521b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc8c3f111f044efbb9c8340c7c7c962c'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:36.305191 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-afb0bca5-0838-4ba9-ab50-aeb006a9521b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc8c3f111f044efbb9c8340c7c7c962c'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:36.314166 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-afb0bca5-0838-4ba9-ab50-aeb006a9521b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc8c3f111f044efbb9c8340c7c7c962c'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:36.324643 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-afb0bca5-0838-4ba9-ab50-aeb006a9521b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc8c3f111f044efbb9c8340c7c7c962c'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:36.338514 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-afb0bca5-0838-4ba9-ab50-aeb006a9521b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc8c3f111f044efbb9c8340c7c7c962c'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:36.345593 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1060/2109] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:36 2022] DELETE /identity/v3/users/bc8c3f111f044efbb9c8340c7c7c962c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:36.658078 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da2eb6-23d3-4105-b900-c377e679850f admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:36.659478 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-98da2eb6-23d3-4105-b900-c377e679850f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:36.673920 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da2eb6-23d3-4105-b900-c377e679850f admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:36.740467 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3945c46-0724-45ca-ac3e-43aa5eaee5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:36.741346 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3945c46-0724-45ca-ac3e-43aa5eaee5b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:36.741654 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3945c46-0724-45ca-ac3e-43aa5eaee5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:36.741926 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3945c46-0724-45ca-ac3e-43aa5eaee5b4 admin admin] PATH_INFO: `/v3/projects/35fbe76bed2d470faf7539d650b60590` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:36.743145 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3945c46-0724-45ca-ac3e-43aa5eaee5b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35fbe76bed2d470faf7539d650b60590)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:36.745184 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3945c46-0724-45ca-ac3e-43aa5eaee5b4 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:36.794421 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c3945c46-0724-45ca-ac3e-43aa5eaee5b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35fbe76bed2d470faf7539d650b60590', 'request_id': 'req-c3945c46-0724-45ca-ac3e-43aa5eaee5b4'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:36.800770 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c3945c46-0724-45ca-ac3e-43aa5eaee5b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35fbe76bed2d470faf7539d650b60590', 'request_id': 'req-c3945c46-0724-45ca-ac3e-43aa5eaee5b4'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:36.810852 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c3945c46-0724-45ca-ac3e-43aa5eaee5b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35fbe76bed2d470faf7539d650b60590', 'request_id': 'req-c3945c46-0724-45ca-ac3e-43aa5eaee5b4'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:36.820584 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c3945c46-0724-45ca-ac3e-43aa5eaee5b4 admin admin] The token cache is being invalidate because project 35fbe76bed2d470faf7539d650b60590 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:36.820863 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c3945c46-0724-45ca-ac3e-43aa5eaee5b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:36.821514 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-c3945c46-0724-45ca-ac3e-43aa5eaee5b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:36.823052 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1050/2110] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:36 2022] DELETE /identity/v3/projects/35fbe76bed2d470faf7539d650b60590 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:36.829125 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a347f-5b8e-4f29-a602-315cc4e301cd None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:36.829473 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a347f-5b8e-4f29-a602-315cc4e301cd None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:36.829755 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a347f-5b8e-4f29-a602-315cc4e301cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:36.848697 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-0f5a347f-5b8e-4f29-a602-315cc4e301cd None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:36.849963 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-0f5a347f-5b8e-4f29-a602-315cc4e301cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:36.909924 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1061/2111] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:36.918680 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e1038-9cc0-4c57-a8ce-9b0b76ee3780 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:36.918954 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e1038-9cc0-4c57-a8ce-9b0b76ee3780 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:36.919245 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e1038-9cc0-4c57-a8ce-9b0b76ee3780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:36.943789 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-d07e1038-9cc0-4c57-a8ce-9b0b76ee3780 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:36.945258 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-d07e1038-9cc0-4c57-a8ce-9b0b76ee3780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:36.961725 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1051/2112] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:36.966001 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a347f-5b8e-4f29-a602-315cc4e301cd None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:36.976385 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a347f-5b8e-4f29-a602-315cc4e301cd None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:36.980987 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1cf1d-f194-4b5d-b281-68d87c9153e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:36.981679 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1cf1d-f194-4b5d-b281-68d87c9153e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:36.981968 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1cf1d-f194-4b5d-b281-68d87c9153e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:36.982317 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be1cf1d-f194-4b5d-b281-68d87c9153e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:36.983052 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1cf1d-f194-4b5d-b281-68d87c9153e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:53:36.983364 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1cf1d-f194-4b5d-b281-68d87c9153e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:36.985041 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be1cf1d-f194-4b5d-b281-68d87c9153e3 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:36.998298 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1062/2113] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:53:37.002592 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e1038-9cc0-4c57-a8ce-9b0b76ee3780 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:37.012347 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e1038-9cc0-4c57-a8ce-9b0b76ee3780 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:37.018640 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61796171-f195-4068-8ec4-4cde922a458b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:37.019549 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61796171-f195-4068-8ec4-4cde922a458b admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:37.021830 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61796171-f195-4068-8ec4-4cde922a458b admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:37.022163 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61796171-f195-4068-8ec4-4cde922a458b admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:37.022984 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61796171-f195-4068-8ec4-4cde922a458b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:37.026024 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61796171-f195-4068-8ec4-4cde922a458b admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:37.067732 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1052/2114] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:53:37 2022] POST /identity/v3/projects => generated 401 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:37.071807 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1cf1d-f194-4b5d-b281-68d87c9153e3 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:37.083079 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be1cf1d-f194-4b5d-b281-68d87c9153e3 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:37.146083 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420c7e1-94b4-4dc5-933a-d5b342bba861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:37.146787 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420c7e1-94b4-4dc5-933a-d5b342bba861 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:37.147068 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420c7e1-94b4-4dc5-933a-d5b342bba861 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:37.147340 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420c7e1-94b4-4dc5-933a-d5b342bba861 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:37.148065 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420c7e1-94b4-4dc5-933a-d5b342bba861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:37.150046 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420c7e1-94b4-4dc5-933a-d5b342bba861 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:37.180092 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1063/2115] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:53:37 2022] POST /identity/v3/users => generated 301 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:37.184039 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61796171-f195-4068-8ec4-4cde922a458b admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:37.194443 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61796171-f195-4068-8ec4-4cde922a458b admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:37.198979 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dba389-f29d-4c69-9b4f-0dfefd197b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:37.199638 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dba389-f29d-4c69-9b4f-0dfefd197b87 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:37.199915 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dba389-f29d-4c69-9b4f-0dfefd197b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:37.200186 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dba389-f29d-4c69-9b4f-0dfefd197b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:37.200916 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dba389-f29d-4c69-9b4f-0dfefd197b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:37.202578 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dba389-f29d-4c69-9b4f-0dfefd197b87 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:37.213524 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1053/2116] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:37.218629 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420c7e1-94b4-4dc5-933a-d5b342bba861 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:37.230843 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420c7e1-94b4-4dc5-933a-d5b342bba861 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:37.235961 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df03e6-5934-410b-a5e0-b883a20f2c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:37.236077 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df03e6-5934-410b-a5e0-b883a20f2c52 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:37.236392 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df03e6-5934-410b-a5e0-b883a20f2c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:37.236616 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df03e6-5934-410b-a5e0-b883a20f2c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:37.237452 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df03e6-5934-410b-a5e0-b883a20f2c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:37.238982 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df03e6-5934-410b-a5e0-b883a20f2c52 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:37.248943 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1064/2117] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:37.253285 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dba389-f29d-4c69-9b4f-0dfefd197b87 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:37.263228 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dba389-f29d-4c69-9b4f-0dfefd197b87 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:37.267895 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe38d7-d677-46c3-9676-97420ecb2633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:37.268774 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe38d7-d677-46c3-9676-97420ecb2633 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:37.269055 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe38d7-d677-46c3-9676-97420ecb2633 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:37.269332 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe38d7-d677-46c3-9676-97420ecb2633 admin admin] PATH_INFO: `/v3/projects/9207b43e615e4970a3c7ee3f9f2f9f1c/users/ad0c8fc995d64350969082f4c615b58f/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:37.285369 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe38d7-d677-46c3-9676-97420ecb2633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9207b43e615e4970a3c7ee3f9f2f9f1c, user_id=ad0c8fc995d64350969082f4c615b58f, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:37.288011 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fe38d7-d677-46c3-9676-97420ecb2633 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:37.303680 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1054/2118] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:37 2022] PUT /identity/v3/projects/9207b43e615e4970a3c7ee3f9f2f9f1c/users/ad0c8fc995d64350969082f4c615b58f/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:37.314665 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770499e7-1dc1-4589-a24d-6b8adc048507 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:37.315021 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770499e7-1dc1-4589-a24d-6b8adc048507 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:37.315339 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770499e7-1dc1-4589-a24d-6b8adc048507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:37.341908 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-770499e7-1dc1-4589-a24d-6b8adc048507 None None] MFA Rules not processed for user `ad0c8fc995d64350969082f4c615b58f`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:37.343251 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-770499e7-1dc1-4589-a24d-6b8adc048507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:37.413738 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1065/2119] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:37 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:37.415459 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe38d7-d677-46c3-9676-97420ecb2633 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:37.483105 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe38d7-d677-46c3-9676-97420ecb2633 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:37.487748 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59393fcb-c0d0-4452-9771-5ad82703977a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:37.488405 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59393fcb-c0d0-4452-9771-5ad82703977a admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:37.488711 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59393fcb-c0d0-4452-9771-5ad82703977a admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:37.488983 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59393fcb-c0d0-4452-9771-5ad82703977a admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:37.489744 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59393fcb-c0d0-4452-9771-5ad82703977a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:37.491624 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59393fcb-c0d0-4452-9771-5ad82703977a admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:37.519527 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1055/2120] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:53:37 2022] POST /identity/v3/projects => generated 401 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:37.523579 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770499e7-1dc1-4589-a24d-6b8adc048507 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:37.534433 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770499e7-1dc1-4589-a24d-6b8adc048507 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:37.588308 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b006f-e351-4fea-9da9-8215dfba5646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:37.588991 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b006f-e351-4fea-9da9-8215dfba5646 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:37.589277 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b006f-e351-4fea-9da9-8215dfba5646 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:37.589651 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b006f-e351-4fea-9da9-8215dfba5646 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:37.590353 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b006f-e351-4fea-9da9-8215dfba5646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:37.592288 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b006f-e351-4fea-9da9-8215dfba5646 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:37.613589 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1066/2121] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:53:37 2022] POST /identity/v3/users => generated 307 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:37.619467 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59393fcb-c0d0-4452-9771-5ad82703977a admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:37.632073 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59393fcb-c0d0-4452-9771-5ad82703977a admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:37.637325 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc39f8-aae8-4f39-9ee0-b6097114c832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:37.638009 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc39f8-aae8-4f39-9ee0-b6097114c832 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:37.638286 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc39f8-aae8-4f39-9ee0-b6097114c832 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:37.638557 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dc39f8-aae8-4f39-9ee0-b6097114c832 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:37.639312 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc39f8-aae8-4f39-9ee0-b6097114c832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:37.640886 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dc39f8-aae8-4f39-9ee0-b6097114c832 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:37.651598 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1056/2122] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:37.655808 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b006f-e351-4fea-9da9-8215dfba5646 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:37.671853 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b006f-e351-4fea-9da9-8215dfba5646 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:37.679227 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f8287-7d56-44cc-b3d6-f4712612ec79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:37.680361 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f8287-7d56-44cc-b3d6-f4712612ec79 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:37.680643 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f8287-7d56-44cc-b3d6-f4712612ec79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:37.680916 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f8287-7d56-44cc-b3d6-f4712612ec79 admin admin] PATH_INFO: `/v3/projects/063277c81088428dab18d7b6d384bfe6/users/ae4b55449b024276b2befbb6d64ba87d/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:37.697523 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f8287-7d56-44cc-b3d6-f4712612ec79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=063277c81088428dab18d7b6d384bfe6, user_id=ae4b55449b024276b2befbb6d64ba87d, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:37.700177 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f8287-7d56-44cc-b3d6-f4712612ec79 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:37.718113 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1067/2123] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:37 2022] PUT /identity/v3/projects/063277c81088428dab18d7b6d384bfe6/users/ae4b55449b024276b2befbb6d64ba87d/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:37.722193 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc39f8-aae8-4f39-9ee0-b6097114c832 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:37.732281 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dc39f8-aae8-4f39-9ee0-b6097114c832 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:37.791742 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51a7e7-b92e-4add-893f-97b6c559ef5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:37.792418 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51a7e7-b92e-4add-893f-97b6c559ef5b admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:37.792699 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51a7e7-b92e-4add-893f-97b6c559ef5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:37.792973 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51a7e7-b92e-4add-893f-97b6c559ef5b admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:37.793889 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51a7e7-b92e-4add-893f-97b6c559ef5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:37.795529 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51a7e7-b92e-4add-893f-97b6c559ef5b admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:37.806085 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1057/2124] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:37.810661 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f8287-7d56-44cc-b3d6-f4712612ec79 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:37.821481 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f8287-7d56-44cc-b3d6-f4712612ec79 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:37.826102 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe880f9-75b3-4d7b-b2ea-ce4f154f5896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:37.826983 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe880f9-75b3-4d7b-b2ea-ce4f154f5896 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:37.827314 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe880f9-75b3-4d7b-b2ea-ce4f154f5896 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:37.827584 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe880f9-75b3-4d7b-b2ea-ce4f154f5896 admin admin] PATH_INFO: `/v3/projects/063277c81088428dab18d7b6d384bfe6/users/ae4b55449b024276b2befbb6d64ba87d/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:37.829552 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe880f9-75b3-4d7b-b2ea-ce4f154f5896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=063277c81088428dab18d7b6d384bfe6, user_id=ae4b55449b024276b2befbb6d64ba87d, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:37.832512 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe880f9-75b3-4d7b-b2ea-ce4f154f5896 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:37.842581 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1068/2125] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:37 2022] PUT /identity/v3/projects/063277c81088428dab18d7b6d384bfe6/users/ae4b55449b024276b2befbb6d64ba87d/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:37.852790 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9fa0b-4a0e-4967-8f7d-7502c6b7d534 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:37.853087 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9fa0b-4a0e-4967-8f7d-7502c6b7d534 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:37.853454 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9fa0b-4a0e-4967-8f7d-7502c6b7d534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:37.880052 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-0dd9fa0b-4a0e-4967-8f7d-7502c6b7d534 None None] MFA Rules not processed for user `ae4b55449b024276b2befbb6d64ba87d`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:37.881245 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-0dd9fa0b-4a0e-4967-8f7d-7502c6b7d534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:37.949671 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1058/2126] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:37 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:37.961874 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe880f9-75b3-4d7b-b2ea-ce4f154f5896 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:37.963959 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-afe880f9-75b3-4d7b-b2ea-ce4f154f5896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:38.023814 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe880f9-75b3-4d7b-b2ea-ce4f154f5896 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:38.028245 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344bb62-bb06-4915-adea-156ac5d40af3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:38.028872 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344bb62-bb06-4915-adea-156ac5d40af3 service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:38.029148 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344bb62-bb06-4915-adea-156ac5d40af3 service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:38.029452 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344bb62-bb06-4915-adea-156ac5d40af3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:38.040310 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344bb62-bb06-4915-adea-156ac5d40af3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:38.041781 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8344bb62-bb06-4915-adea-156ac5d40af3 service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:38.051709 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1069/2127] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:37 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:38.130687 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9fa0b-4a0e-4967-8f7d-7502c6b7d534 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:38.132166 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-0dd9fa0b-4a0e-4967-8f7d-7502c6b7d534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:38.145582 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9fa0b-4a0e-4967-8f7d-7502c6b7d534 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:38.149477 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09465785-c8b7-4938-b7aa-4e8814a077a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:38.150110 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09465785-c8b7-4938-b7aa-4e8814a077a6 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:38.150387 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09465785-c8b7-4938-b7aa-4e8814a077a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:38.150653 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09465785-c8b7-4938-b7aa-4e8814a077a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:38.207384 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09465785-c8b7-4938-b7aa-4e8814a077a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:38.208719 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09465785-c8b7-4938-b7aa-4e8814a077a6 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:38.217664 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1059/2128] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:38 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:42.416341 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344bb62-bb06-4915-adea-156ac5d40af3 service cinder] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:42.418266 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-8344bb62-bb06-4915-adea-156ac5d40af3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:42.492067 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344bb62-bb06-4915-adea-156ac5d40af3 service cinder] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:42.496809 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62b034-33d3-4428-89b2-97796be74c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:42.501525 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62b034-33d3-4428-89b2-97796be74c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:42.501525 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62b034-33d3-4428-89b2-97796be74c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:42.501525 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b62b034-33d3-4428-89b2-97796be74c98 admin admin] PATH_INFO: `/v3/users/debb126d9cd5472aa8c27d4fe9065b33` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:42.502741 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62b034-33d3-4428-89b2-97796be74c98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=debb126d9cd5472aa8c27d4fe9065b33)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:42.506999 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b62b034-33d3-4428-89b2-97796be74c98 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:42.561907 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-1b62b034-33d3-4428-89b2-97796be74c98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'debb126d9cd5472aa8c27d4fe9065b33'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:42.562599 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-1b62b034-33d3-4428-89b2-97796be74c98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'debb126d9cd5472aa8c27d4fe9065b33'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:42.575014 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-1b62b034-33d3-4428-89b2-97796be74c98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'debb126d9cd5472aa8c27d4fe9065b33'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:42.583491 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-1b62b034-33d3-4428-89b2-97796be74c98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'debb126d9cd5472aa8c27d4fe9065b33'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:42.595911 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-1b62b034-33d3-4428-89b2-97796be74c98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'debb126d9cd5472aa8c27d4fe9065b33'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:42.602371 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1070/2129] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:42 2022] DELETE /identity/v3/users/debb126d9cd5472aa8c27d4fe9065b33 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:42.606856 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de070f-fa09-46f3-81a5-d2fd5fef4f21 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:42.607353 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de070f-fa09-46f3-81a5-d2fd5fef4f21 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:42.607430 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de070f-fa09-46f3-81a5-d2fd5fef4f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:42.624522 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-e9de070f-fa09-46f3-81a5-d2fd5fef4f21 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:42.625780 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-e9de070f-fa09-46f3-81a5-d2fd5fef4f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:42.685304 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1060/2130] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:42.695236 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62b034-33d3-4428-89b2-97796be74c98 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:42.696743 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-1b62b034-33d3-4428-89b2-97796be74c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:42.755053 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b62b034-33d3-4428-89b2-97796be74c98 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:42.759014 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb753b-b045-4ed5-94cf-6e37dd098086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:42.759644 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb753b-b045-4ed5-94cf-6e37dd098086 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:42.759920 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb753b-b045-4ed5-94cf-6e37dd098086 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:42.760198 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb753b-b045-4ed5-94cf-6e37dd098086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:42.769140 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb753b-b045-4ed5-94cf-6e37dd098086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:42.770596 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddb753b-b045-4ed5-94cf-6e37dd098086 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:42.780187 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1071/2131] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:43.091884 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de070f-fa09-46f3-81a5-d2fd5fef4f21 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:43.094556 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-e9de070f-fa09-46f3-81a5-d2fd5fef4f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:43.108783 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de070f-fa09-46f3-81a5-d2fd5fef4f21 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:43.135306 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4288ca08-621d-430f-8efe-184ef5f0eff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:43.136213 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288ca08-621d-430f-8efe-184ef5f0eff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:43.136473 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288ca08-621d-430f-8efe-184ef5f0eff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:43.136739 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4288ca08-621d-430f-8efe-184ef5f0eff0 admin admin] PATH_INFO: `/v3/projects/a86db2a4dc46459abc7da2a15972a423` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:43.137969 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288ca08-621d-430f-8efe-184ef5f0eff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a86db2a4dc46459abc7da2a15972a423)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:43.139951 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4288ca08-621d-430f-8efe-184ef5f0eff0 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:43.192729 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-4288ca08-621d-430f-8efe-184ef5f0eff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a86db2a4dc46459abc7da2a15972a423', 'request_id': 'req-4288ca08-621d-430f-8efe-184ef5f0eff0'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:43.199748 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-4288ca08-621d-430f-8efe-184ef5f0eff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a86db2a4dc46459abc7da2a15972a423', 'request_id': 'req-4288ca08-621d-430f-8efe-184ef5f0eff0'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:43.209190 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-4288ca08-621d-430f-8efe-184ef5f0eff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a86db2a4dc46459abc7da2a15972a423', 'request_id': 'req-4288ca08-621d-430f-8efe-184ef5f0eff0'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:43.222185 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-4288ca08-621d-430f-8efe-184ef5f0eff0 admin admin] The token cache is being invalidate because project a86db2a4dc46459abc7da2a15972a423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:43.222455 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-4288ca08-621d-430f-8efe-184ef5f0eff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:43.224780 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-4288ca08-621d-430f-8efe-184ef5f0eff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:43.226418 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1061/2132] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:43 2022] DELETE /identity/v3/projects/a86db2a4dc46459abc7da2a15972a423 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:43.231384 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809aead-ddf9-42d3-9c7d-3a7de50cb3e8 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:43.231675 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809aead-ddf9-42d3-9c7d-3a7de50cb3e8 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:43.231953 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809aead-ddf9-42d3-9c7d-3a7de50cb3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:43.249883 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-c809aead-ddf9-42d3-9c7d-3a7de50cb3e8 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:43.251164 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-c809aead-ddf9-42d3-9c7d-3a7de50cb3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:43.309870 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1072/2133] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:43.318922 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9c884-8721-478d-b99d-69045fa9076e None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:43.319216 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9c884-8721-478d-b99d-69045fa9076e None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:43.319491 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9c884-8721-478d-b99d-69045fa9076e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:43.337950 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-19d9c884-8721-478d-b99d-69045fa9076e None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:43.339130 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-19d9c884-8721-478d-b99d-69045fa9076e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:43.347442 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1062/2134] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:43.351707 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809aead-ddf9-42d3-9c7d-3a7de50cb3e8 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:43.361989 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809aead-ddf9-42d3-9c7d-3a7de50cb3e8 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:43.367053 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e55aee-6ec9-43b4-a94d-f716dd7d929f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:43.367762 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e55aee-6ec9-43b4-a94d-f716dd7d929f admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:43.368023 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e55aee-6ec9-43b4-a94d-f716dd7d929f admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:43.368293 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e55aee-6ec9-43b4-a94d-f716dd7d929f admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:43.369018 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e55aee-6ec9-43b4-a94d-f716dd7d929f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:53:43.369336 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e55aee-6ec9-43b4-a94d-f716dd7d929f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:43.371366 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e55aee-6ec9-43b4-a94d-f716dd7d929f admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:43.384067 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1073/2135] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:53:43.388731 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9c884-8721-478d-b99d-69045fa9076e None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:43.399619 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9c884-8721-478d-b99d-69045fa9076e None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:43.407076 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3333d3e-f1f8-4458-abc2-5554dc926f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:43.407747 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3333d3e-f1f8-4458-abc2-5554dc926f4e admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:43.408015 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3333d3e-f1f8-4458-abc2-5554dc926f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:43.408328 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3333d3e-f1f8-4458-abc2-5554dc926f4e admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:43.409067 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3333d3e-f1f8-4458-abc2-5554dc926f4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:43.411052 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3333d3e-f1f8-4458-abc2-5554dc926f4e admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:43.445112 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1063/2136] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:53:43 2022] POST /identity/v3/projects => generated 363 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:53:43.449313 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e55aee-6ec9-43b4-a94d-f716dd7d929f admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:43.461513 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e55aee-6ec9-43b4-a94d-f716dd7d929f admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:43.531544 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c025ed-5142-4d7d-8fca-540ad1a2e775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:43.532221 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c025ed-5142-4d7d-8fca-540ad1a2e775 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:43.532503 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c025ed-5142-4d7d-8fca-540ad1a2e775 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:43.532779 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c025ed-5142-4d7d-8fca-540ad1a2e775 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:43.533521 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c025ed-5142-4d7d-8fca-540ad1a2e775 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:43.535452 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c025ed-5142-4d7d-8fca-540ad1a2e775 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:43.555837 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1074/2137] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:53:43 2022] POST /identity/v3/users => generated 282 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:43.560182 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3333d3e-f1f8-4458-abc2-5554dc926f4e admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:43.570631 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3333d3e-f1f8-4458-abc2-5554dc926f4e admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:43.575682 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc8c2e-03b9-4af6-b909-18443622bf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:43.576417 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc8c2e-03b9-4af6-b909-18443622bf94 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:43.576752 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc8c2e-03b9-4af6-b909-18443622bf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:43.577022 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc8c2e-03b9-4af6-b909-18443622bf94 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:43.577923 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc8c2e-03b9-4af6-b909-18443622bf94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:43.580235 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc8c2e-03b9-4af6-b909-18443622bf94 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:43.591576 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1064/2138] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:43.595931 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c025ed-5142-4d7d-8fca-540ad1a2e775 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:43.606160 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c025ed-5142-4d7d-8fca-540ad1a2e775 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:43.611831 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d58ab-0714-4918-948b-3e2f53eaca2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:43.612536 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d58ab-0714-4918-948b-3e2f53eaca2c admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:43.612813 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d58ab-0714-4918-948b-3e2f53eaca2c admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:43.613081 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d58ab-0714-4918-948b-3e2f53eaca2c admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:43.613919 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d58ab-0714-4918-948b-3e2f53eaca2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:43.615456 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d58ab-0714-4918-948b-3e2f53eaca2c admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:43.629152 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1075/2139] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:43.630493 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc8c2e-03b9-4af6-b909-18443622bf94 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:43.640456 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc8c2e-03b9-4af6-b909-18443622bf94 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:43.646404 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f38e9d-99f2-4966-96a5-42771361061c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:43.647510 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f38e9d-99f2-4966-96a5-42771361061c admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:43.647767 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f38e9d-99f2-4966-96a5-42771361061c admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:43.648041 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f38e9d-99f2-4966-96a5-42771361061c admin admin] PATH_INFO: `/v3/projects/ba742270457445738a58b72256eb1708/users/3b7de5a9bfef45dc825310817793d96e/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:43.663700 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f38e9d-99f2-4966-96a5-42771361061c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba742270457445738a58b72256eb1708, user_id=3b7de5a9bfef45dc825310817793d96e, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:43.666448 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f38e9d-99f2-4966-96a5-42771361061c admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:43.682028 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1065/2140] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:43 2022] PUT /identity/v3/projects/ba742270457445738a58b72256eb1708/users/3b7de5a9bfef45dc825310817793d96e/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:53:43.695460 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8474f66-9338-4229-8740-2ede550a5594 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:43.695783 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8474f66-9338-4229-8740-2ede550a5594 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:43.696012 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8474f66-9338-4229-8740-2ede550a5594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:43.726907 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-b8474f66-9338-4229-8740-2ede550a5594 None None] MFA Rules not processed for user `3b7de5a9bfef45dc825310817793d96e`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:43.728312 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-b8474f66-9338-4229-8740-2ede550a5594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:43.791498 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1076/2141] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:43 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:43.803431 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f38e9d-99f2-4966-96a5-42771361061c admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:43.805546 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-c9f38e9d-99f2-4966-96a5-42771361061c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:43.861886 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f38e9d-99f2-4966-96a5-42771361061c admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:43.865696 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec81fd-2be1-415d-9327-ea5f70307dfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:43.866336 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec81fd-2be1-415d-9327-ea5f70307dfb service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:43.866613 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec81fd-2be1-415d-9327-ea5f70307dfb service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:43.866882 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec81fd-2be1-415d-9327-ea5f70307dfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:43.876178 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec81fd-2be1-415d-9327-ea5f70307dfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:43.877668 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec81fd-2be1-415d-9327-ea5f70307dfb service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:43.886991 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1066/2142] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:43 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:44.391341 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8474f66-9338-4229-8740-2ede550a5594 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:44.392945 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-b8474f66-9338-4229-8740-2ede550a5594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:44.465415 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8474f66-9338-4229-8740-2ede550a5594 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:44.471091 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e0e9c-dd39-49c0-9110-ed08c68ba909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:44.471972 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e0e9c-dd39-49c0-9110-ed08c68ba909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:44.472221 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e0e9c-dd39-49c0-9110-ed08c68ba909 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:44.472517 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e0e9c-dd39-49c0-9110-ed08c68ba909 admin admin] PATH_INFO: `/v3/users/ad0c8fc995d64350969082f4c615b58f` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:44.473862 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e0e9c-dd39-49c0-9110-ed08c68ba909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad0c8fc995d64350969082f4c615b58f)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:44.475807 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e0e9c-dd39-49c0-9110-ed08c68ba909 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:44.523395 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-6c7e0e9c-dd39-49c0-9110-ed08c68ba909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad0c8fc995d64350969082f4c615b58f'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:44.524221 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-6c7e0e9c-dd39-49c0-9110-ed08c68ba909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad0c8fc995d64350969082f4c615b58f'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:44.532997 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-6c7e0e9c-dd39-49c0-9110-ed08c68ba909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad0c8fc995d64350969082f4c615b58f'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:44.540833 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-6c7e0e9c-dd39-49c0-9110-ed08c68ba909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad0c8fc995d64350969082f4c615b58f'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:44.553512 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-6c7e0e9c-dd39-49c0-9110-ed08c68ba909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad0c8fc995d64350969082f4c615b58f'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:44.559461 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1077/2143] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:44 2022] DELETE /identity/v3/users/ad0c8fc995d64350969082f4c615b58f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:44.564241 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bc47f-696a-40ef-a468-3ef01f2b2e35 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:44.564545 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bc47f-696a-40ef-a468-3ef01f2b2e35 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:44.564834 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bc47f-696a-40ef-a468-3ef01f2b2e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:44.582968 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-a75bc47f-696a-40ef-a468-3ef01f2b2e35 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:44.584139 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-a75bc47f-696a-40ef-a468-3ef01f2b2e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:44.641250 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1067/2144] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:44.651780 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e0e9c-dd39-49c0-9110-ed08c68ba909 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:44.653477 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-6c7e0e9c-dd39-49c0-9110-ed08c68ba909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:44.709059 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e0e9c-dd39-49c0-9110-ed08c68ba909 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:44.712771 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed04b2e-c710-4f9b-9732-50e6b678588e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:44.713457 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed04b2e-c710-4f9b-9732-50e6b678588e service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:44.713741 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed04b2e-c710-4f9b-9732-50e6b678588e service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:44.714018 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed04b2e-c710-4f9b-9732-50e6b678588e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:44.723270 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed04b2e-c710-4f9b-9732-50e6b678588e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:44.724643 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed04b2e-c710-4f9b-9732-50e6b678588e service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:44.734112 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1078/2145] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:45.008648 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bc47f-696a-40ef-a468-3ef01f2b2e35 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:45.010217 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-a75bc47f-696a-40ef-a468-3ef01f2b2e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:45.022785 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bc47f-696a-40ef-a468-3ef01f2b2e35 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:45.028484 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bae26-0cd0-4a63-b8c4-d604ebd35cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:45.029550 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bae26-0cd0-4a63-b8c4-d604ebd35cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:45.029941 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bae26-0cd0-4a63-b8c4-d604ebd35cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:45.030128 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733bae26-0cd0-4a63-b8c4-d604ebd35cd3 admin admin] PATH_INFO: `/v3/projects/9207b43e615e4970a3c7ee3f9f2f9f1c` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:45.031688 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bae26-0cd0-4a63-b8c4-d604ebd35cd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9207b43e615e4970a3c7ee3f9f2f9f1c)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:45.033847 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733bae26-0cd0-4a63-b8c4-d604ebd35cd3 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:45.082475 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-733bae26-0cd0-4a63-b8c4-d604ebd35cd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9207b43e615e4970a3c7ee3f9f2f9f1c', 'request_id': 'req-733bae26-0cd0-4a63-b8c4-d604ebd35cd3'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:45.088477 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-733bae26-0cd0-4a63-b8c4-d604ebd35cd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9207b43e615e4970a3c7ee3f9f2f9f1c', 'request_id': 'req-733bae26-0cd0-4a63-b8c4-d604ebd35cd3'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:45.097266 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-733bae26-0cd0-4a63-b8c4-d604ebd35cd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9207b43e615e4970a3c7ee3f9f2f9f1c', 'request_id': 'req-733bae26-0cd0-4a63-b8c4-d604ebd35cd3'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:45.107023 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-733bae26-0cd0-4a63-b8c4-d604ebd35cd3 admin admin] The token cache is being invalidate because project 9207b43e615e4970a3c7ee3f9f2f9f1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:45.107307 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-733bae26-0cd0-4a63-b8c4-d604ebd35cd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:45.107920 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-733bae26-0cd0-4a63-b8c4-d604ebd35cd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:45.109533 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1068/2146] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:45 2022] DELETE /identity/v3/projects/9207b43e615e4970a3c7ee3f9f2f9f1c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:45.113728 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed04b2e-c710-4f9b-9732-50e6b678588e service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:45.123427 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed04b2e-c710-4f9b-9732-50e6b678588e service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:45.184715 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cdb16-da0a-4532-bca8-59011b9c2ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:45.185638 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cdb16-da0a-4532-bca8-59011b9c2ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:45.185918 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cdb16-da0a-4532-bca8-59011b9c2ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:45.186191 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cdb16-da0a-4532-bca8-59011b9c2ee1 admin admin] PATH_INFO: `/v3/users/ae4b55449b024276b2befbb6d64ba87d` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:45.187398 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cdb16-da0a-4532-bca8-59011b9c2ee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae4b55449b024276b2befbb6d64ba87d)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:45.189379 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77cdb16-da0a-4532-bca8-59011b9c2ee1 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:45.234769 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-a77cdb16-da0a-4532-bca8-59011b9c2ee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae4b55449b024276b2befbb6d64ba87d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:45.235480 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-a77cdb16-da0a-4532-bca8-59011b9c2ee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae4b55449b024276b2befbb6d64ba87d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:45.244156 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-a77cdb16-da0a-4532-bca8-59011b9c2ee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae4b55449b024276b2befbb6d64ba87d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:45.250836 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-a77cdb16-da0a-4532-bca8-59011b9c2ee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae4b55449b024276b2befbb6d64ba87d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:45.262406 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-a77cdb16-da0a-4532-bca8-59011b9c2ee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae4b55449b024276b2befbb6d64ba87d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:45.268415 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1079/2147] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:45 2022] DELETE /identity/v3/users/ae4b55449b024276b2befbb6d64ba87d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:45.539756 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bae26-0cd0-4a63-b8c4-d604ebd35cd3 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:45.541291 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-733bae26-0cd0-4a63-b8c4-d604ebd35cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:45.554367 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733bae26-0cd0-4a63-b8c4-d604ebd35cd3 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:45.611538 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397e611d-5bd0-4e9c-ab01-fcd886deb81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:45.612385 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e611d-5bd0-4e9c-ab01-fcd886deb81d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:45.612684 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e611d-5bd0-4e9c-ab01-fcd886deb81d admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:45.612951 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397e611d-5bd0-4e9c-ab01-fcd886deb81d admin admin] PATH_INFO: `/v3/projects/063277c81088428dab18d7b6d384bfe6` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:45.614176 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e611d-5bd0-4e9c-ab01-fcd886deb81d admin admin] RBAC: Authorizing `identity:delete_project(project_id=063277c81088428dab18d7b6d384bfe6)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:45.616042 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397e611d-5bd0-4e9c-ab01-fcd886deb81d admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:45.662023 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-397e611d-5bd0-4e9c-ab01-fcd886deb81d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '063277c81088428dab18d7b6d384bfe6', 'request_id': 'req-397e611d-5bd0-4e9c-ab01-fcd886deb81d'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:45.667889 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-397e611d-5bd0-4e9c-ab01-fcd886deb81d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '063277c81088428dab18d7b6d384bfe6', 'request_id': 'req-397e611d-5bd0-4e9c-ab01-fcd886deb81d'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:45.676443 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-397e611d-5bd0-4e9c-ab01-fcd886deb81d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '063277c81088428dab18d7b6d384bfe6', 'request_id': 'req-397e611d-5bd0-4e9c-ab01-fcd886deb81d'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:45.686751 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-397e611d-5bd0-4e9c-ab01-fcd886deb81d admin admin] The token cache is being invalidate because project 063277c81088428dab18d7b6d384bfe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:45.687078 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-397e611d-5bd0-4e9c-ab01-fcd886deb81d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:45.691815 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-397e611d-5bd0-4e9c-ab01-fcd886deb81d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:45.693376 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1069/2148] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:45 2022] DELETE /identity/v3/projects/063277c81088428dab18d7b6d384bfe6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:53:45.698443 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6d072-5190-4d6c-9ac7-674f5f860d2e None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:45.698898 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6d072-5190-4d6c-9ac7-674f5f860d2e None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:45.699108 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a6d072-5190-4d6c-9ac7-674f5f860d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:45.717477 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-d8a6d072-5190-4d6c-9ac7-674f5f860d2e None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:45.718662 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-d8a6d072-5190-4d6c-9ac7-674f5f860d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:45.778117 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1080/2149] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:45.787384 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b14d9-d438-4156-8d4c-2586659d052b None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:45.787648 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b14d9-d438-4156-8d4c-2586659d052b None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:45.788124 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b14d9-d438-4156-8d4c-2586659d052b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:45.817536 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-248b14d9-d438-4156-8d4c-2586659d052b None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:45.818745 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-248b14d9-d438-4156-8d4c-2586659d052b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:45.826766 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1070/2150] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:45.831462 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6d072-5190-4d6c-9ac7-674f5f860d2e None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:45.847423 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a6d072-5190-4d6c-9ac7-674f5f860d2e None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:45.847423 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e50478-215e-4b26-96c1-f133e180f990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:45.847423 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e50478-215e-4b26-96c1-f133e180f990 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:45.848057 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e50478-215e-4b26-96c1-f133e180f990 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:45.848057 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e50478-215e-4b26-96c1-f133e180f990 admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:45.848506 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e50478-215e-4b26-96c1-f133e180f990 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:53:45.848810 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e50478-215e-4b26-96c1-f133e180f990 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:45.850444 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e50478-215e-4b26-96c1-f133e180f990 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:45.862791 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1081/2151] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:53:45.867110 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b14d9-d438-4156-8d4c-2586659d052b None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:45.876398 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b14d9-d438-4156-8d4c-2586659d052b None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:45.881267 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050fdc4-83ba-4b64-a176-b25d9d3cf377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:45.881938 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050fdc4-83ba-4b64-a176-b25d9d3cf377 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:45.882253 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050fdc4-83ba-4b64-a176-b25d9d3cf377 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:45.882509 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050fdc4-83ba-4b64-a176-b25d9d3cf377 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:45.883213 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050fdc4-83ba-4b64-a176-b25d9d3cf377 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:45.885094 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050fdc4-83ba-4b64-a176-b25d9d3cf377 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:45.915438 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1071/2152] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:53:45 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:45.917239 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e50478-215e-4b26-96c1-f133e180f990 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:45.930017 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e50478-215e-4b26-96c1-f133e180f990 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:45.986469 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb122c6-7605-445f-b90d-b5864fb84f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:45.987128 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb122c6-7605-445f-b90d-b5864fb84f15 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:45.987400 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb122c6-7605-445f-b90d-b5864fb84f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:45.987672 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb122c6-7605-445f-b90d-b5864fb84f15 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:45.988351 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb122c6-7605-445f-b90d-b5864fb84f15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:45.990317 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb122c6-7605-445f-b90d-b5864fb84f15 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:46.010971 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1082/2153] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:53:45 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:46.015093 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050fdc4-83ba-4b64-a176-b25d9d3cf377 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:46.025402 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050fdc4-83ba-4b64-a176-b25d9d3cf377 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:46.030411 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871aa342-efc6-4633-9cb8-b788013af931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:46.030969 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871aa342-efc6-4633-9cb8-b788013af931 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:46.031246 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871aa342-efc6-4633-9cb8-b788013af931 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:46.031513 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871aa342-efc6-4633-9cb8-b788013af931 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:46.032241 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871aa342-efc6-4633-9cb8-b788013af931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:46.033948 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871aa342-efc6-4633-9cb8-b788013af931 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:46.044489 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1072/2154] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:46.048527 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb122c6-7605-445f-b90d-b5864fb84f15 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:46.059004 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb122c6-7605-445f-b90d-b5864fb84f15 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:46.064380 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be855d-8296-480e-b452-d61e83c689a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:46.065028 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be855d-8296-480e-b452-d61e83c689a1 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:46.065308 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be855d-8296-480e-b452-d61e83c689a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:46.065619 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be855d-8296-480e-b452-d61e83c689a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:46.066348 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be855d-8296-480e-b452-d61e83c689a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:46.067956 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be855d-8296-480e-b452-d61e83c689a1 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:46.077782 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1083/2155] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:46.082295 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871aa342-efc6-4633-9cb8-b788013af931 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:46.093339 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871aa342-efc6-4633-9cb8-b788013af931 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:46.100723 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b2986-2323-4de0-b110-a74eb0d7af49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:46.102024 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b2986-2323-4de0-b110-a74eb0d7af49 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:46.102390 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b2986-2323-4de0-b110-a74eb0d7af49 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:46.102779 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b2986-2323-4de0-b110-a74eb0d7af49 admin admin] PATH_INFO: `/v3/projects/5f4281c58b0d4e11bef9e4fe6f22410a/users/9f4e745def3d4b75ae4e885883182b5d/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:46.120487 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b2986-2323-4de0-b110-a74eb0d7af49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f4281c58b0d4e11bef9e4fe6f22410a, user_id=9f4e745def3d4b75ae4e885883182b5d, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:46.123128 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b2986-2323-4de0-b110-a74eb0d7af49 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:46.137479 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1073/2156] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:46 2022] PUT /identity/v3/projects/5f4281c58b0d4e11bef9e4fe6f22410a/users/9f4e745def3d4b75ae4e885883182b5d/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:46.147930 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdf5e9-4878-47d2-b478-a0db8cbf00ed None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:46.148215 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdf5e9-4878-47d2-b478-a0db8cbf00ed None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:46.148486 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdf5e9-4878-47d2-b478-a0db8cbf00ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:46.176937 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-7abdf5e9-4878-47d2-b478-a0db8cbf00ed None None] MFA Rules not processed for user `9f4e745def3d4b75ae4e885883182b5d`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:46.178182 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-7abdf5e9-4878-47d2-b478-a0db8cbf00ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:46.254348 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1084/2157] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:46.259253 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b2986-2323-4de0-b110-a74eb0d7af49 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:46.319230 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b2986-2323-4de0-b110-a74eb0d7af49 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:46.324202 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f35290-b413-471b-bcda-85ea6153765a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:46.324848 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f35290-b413-471b-bcda-85ea6153765a admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:46.325123 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f35290-b413-471b-bcda-85ea6153765a admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:46.325388 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f35290-b413-471b-bcda-85ea6153765a admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:46.326088 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f35290-b413-471b-bcda-85ea6153765a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:46.327947 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f35290-b413-471b-bcda-85ea6153765a admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:46.355775 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1074/2158] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:53:46 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:46.360209 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdf5e9-4878-47d2-b478-a0db8cbf00ed None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:46.371792 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdf5e9-4878-47d2-b478-a0db8cbf00ed None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:46.429301 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803eb89-efde-41e2-9900-c1215b770fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:46.430105 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803eb89-efde-41e2-9900-c1215b770fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:46.430389 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803eb89-efde-41e2-9900-c1215b770fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:46.430656 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803eb89-efde-41e2-9900-c1215b770fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:46.431338 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803eb89-efde-41e2-9900-c1215b770fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:46.433263 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803eb89-efde-41e2-9900-c1215b770fe8 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:46.456175 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1085/2159] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:53:46 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:53:46.460515 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f35290-b413-471b-bcda-85ea6153765a admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:46.470937 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f35290-b413-471b-bcda-85ea6153765a admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:46.475878 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbafe82-78e5-4751-bc4b-9d1e8a4b1610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:46.476540 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbafe82-78e5-4751-bc4b-9d1e8a4b1610 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:46.476815 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbafe82-78e5-4751-bc4b-9d1e8a4b1610 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:46.477082 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbafe82-78e5-4751-bc4b-9d1e8a4b1610 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:46.477840 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbafe82-78e5-4751-bc4b-9d1e8a4b1610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:46.479448 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbafe82-78e5-4751-bc4b-9d1e8a4b1610 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:46.490162 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1075/2160] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:46.494428 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803eb89-efde-41e2-9900-c1215b770fe8 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:46.505170 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803eb89-efde-41e2-9900-c1215b770fe8 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:46.509753 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3c65b-8ab4-4afd-a853-98c9f40c7eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:46.510626 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3c65b-8ab4-4afd-a853-98c9f40c7eea admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:46.510902 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3c65b-8ab4-4afd-a853-98c9f40c7eea admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:46.511172 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3c65b-8ab4-4afd-a853-98c9f40c7eea admin admin] PATH_INFO: `/v3/projects/2d14c7415c8c43f3895c79ab8ceed942/users/f8f8cac92f1b4273b8afaacb52184683/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:46.525814 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3c65b-8ab4-4afd-a853-98c9f40c7eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d14c7415c8c43f3895c79ab8ceed942, user_id=f8f8cac92f1b4273b8afaacb52184683, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:46.528447 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3c65b-8ab4-4afd-a853-98c9f40c7eea admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:46.543657 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1086/2161] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:46 2022] PUT /identity/v3/projects/2d14c7415c8c43f3895c79ab8ceed942/users/f8f8cac92f1b4273b8afaacb52184683/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:46.547834 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbafe82-78e5-4751-bc4b-9d1e8a4b1610 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:46.558091 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbafe82-78e5-4751-bc4b-9d1e8a4b1610 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:46.626174 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6f6eb-e3c1-4e97-9ed6-eeff18f2b5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:46.626897 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6f6eb-e3c1-4e97-9ed6-eeff18f2b5ce admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:46.627171 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6f6eb-e3c1-4e97-9ed6-eeff18f2b5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:46.627441 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6f6eb-e3c1-4e97-9ed6-eeff18f2b5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:46.628474 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6f6eb-e3c1-4e97-9ed6-eeff18f2b5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:46.630131 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6f6eb-e3c1-4e97-9ed6-eeff18f2b5ce admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:46.642490 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1076/2162] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:46.647090 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3c65b-8ab4-4afd-a853-98c9f40c7eea admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:46.659399 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3c65b-8ab4-4afd-a853-98c9f40c7eea admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:46.665692 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60665391-cada-457c-835d-003a6a0047b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:46.666619 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60665391-cada-457c-835d-003a6a0047b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:46.666892 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60665391-cada-457c-835d-003a6a0047b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:46.667159 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60665391-cada-457c-835d-003a6a0047b9 admin admin] PATH_INFO: `/v3/projects/2d14c7415c8c43f3895c79ab8ceed942/users/f8f8cac92f1b4273b8afaacb52184683/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:46.669634 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60665391-cada-457c-835d-003a6a0047b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d14c7415c8c43f3895c79ab8ceed942, user_id=f8f8cac92f1b4273b8afaacb52184683, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:46.672264 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60665391-cada-457c-835d-003a6a0047b9 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:46.683775 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1087/2163] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:46 2022] PUT /identity/v3/projects/2d14c7415c8c43f3895c79ab8ceed942/users/f8f8cac92f1b4273b8afaacb52184683/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:53:46.694265 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca0960-4417-4b39-83fc-80b3d3517b59 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:46.694752 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca0960-4417-4b39-83fc-80b3d3517b59 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:46.694858 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca0960-4417-4b39-83fc-80b3d3517b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:46.722886 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-89ca0960-4417-4b39-83fc-80b3d3517b59 None None] MFA Rules not processed for user `f8f8cac92f1b4273b8afaacb52184683`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:46.724099 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-89ca0960-4417-4b39-83fc-80b3d3517b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:46.793930 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1077/2164] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:46 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:46.806822 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60665391-cada-457c-835d-003a6a0047b9 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:46.808936 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-60665391-cada-457c-835d-003a6a0047b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:46.868142 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60665391-cada-457c-835d-003a6a0047b9 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:46.872499 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ce5ed-17eb-4958-8f9a-2f9d2933ac4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:46.873093 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ce5ed-17eb-4958-8f9a-2f9d2933ac4a service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:46.873403 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ce5ed-17eb-4958-8f9a-2f9d2933ac4a service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:46.873684 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ce5ed-17eb-4958-8f9a-2f9d2933ac4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:46.883419 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ce5ed-17eb-4958-8f9a-2f9d2933ac4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:46.884848 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ce5ed-17eb-4958-8f9a-2f9d2933ac4a service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:46.894866 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1088/2165] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:46 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:46.978528 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca0960-4417-4b39-83fc-80b3d3517b59 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:46.988978 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca0960-4417-4b39-83fc-80b3d3517b59 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:46.993329 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ceb623-eee9-427c-9f0a-3585e47ad88e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:46.994006 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceb623-eee9-427c-9f0a-3585e47ad88e service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:46.994285 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceb623-eee9-427c-9f0a-3585e47ad88e service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:46.994554 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ceb623-eee9-427c-9f0a-3585e47ad88e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:47.055972 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ceb623-eee9-427c-9f0a-3585e47ad88e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:47.057440 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ceb623-eee9-427c-9f0a-3585e47ad88e service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:47.066152 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1078/2166] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:51.806761 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ce5ed-17eb-4958-8f9a-2f9d2933ac4a service cinder] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:51.872545 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ce5ed-17eb-4958-8f9a-2f9d2933ac4a service cinder] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:51.878179 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb4b42-08be-4721-bb94-31cf18543ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:51.879062 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb4b42-08be-4721-bb94-31cf18543ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:51.879339 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb4b42-08be-4721-bb94-31cf18543ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:51.879611 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb4b42-08be-4721-bb94-31cf18543ba6 admin admin] PATH_INFO: `/v3/users/9f4e745def3d4b75ae4e885883182b5d` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:51.880834 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb4b42-08be-4721-bb94-31cf18543ba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f4e745def3d4b75ae4e885883182b5d)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:51.882982 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb4b42-08be-4721-bb94-31cf18543ba6 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:51.932341 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-5adb4b42-08be-4721-bb94-31cf18543ba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f4e745def3d4b75ae4e885883182b5d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:51.933098 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-5adb4b42-08be-4721-bb94-31cf18543ba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f4e745def3d4b75ae4e885883182b5d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:51.941330 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-5adb4b42-08be-4721-bb94-31cf18543ba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f4e745def3d4b75ae4e885883182b5d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:51.948284 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-5adb4b42-08be-4721-bb94-31cf18543ba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f4e745def3d4b75ae4e885883182b5d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:51.960174 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-5adb4b42-08be-4721-bb94-31cf18543ba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f4e745def3d4b75ae4e885883182b5d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:51.965997 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1089/2167] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:51 2022] DELETE /identity/v3/users/9f4e745def3d4b75ae4e885883182b5d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:51.970825 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06f348-e2c4-41c8-9dd2-84b7f07bd022 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:51.971311 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06f348-e2c4-41c8-9dd2-84b7f07bd022 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:51.971415 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06f348-e2c4-41c8-9dd2-84b7f07bd022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:51.988143 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-be06f348-e2c4-41c8-9dd2-84b7f07bd022 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:51.989329 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-be06f348-e2c4-41c8-9dd2-84b7f07bd022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:52.050355 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1079/2168] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:52.060398 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb4b42-08be-4721-bb94-31cf18543ba6 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:52.062122 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-5adb4b42-08be-4721-bb94-31cf18543ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:52.121291 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb4b42-08be-4721-bb94-31cf18543ba6 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:52.125491 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dd8b5-e460-4631-b308-32f26cccb17d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:52.126145 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dd8b5-e460-4631-b308-32f26cccb17d service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:52.126430 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dd8b5-e460-4631-b308-32f26cccb17d service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:52.126698 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55dd8b5-e460-4631-b308-32f26cccb17d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:52.136475 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dd8b5-e460-4631-b308-32f26cccb17d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:52.137835 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55dd8b5-e460-4631-b308-32f26cccb17d service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:52.147673 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1090/2169] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:52.419064 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06f348-e2c4-41c8-9dd2-84b7f07bd022 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:52.420521 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-be06f348-e2c4-41c8-9dd2-84b7f07bd022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:52.434331 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06f348-e2c4-41c8-9dd2-84b7f07bd022 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:52.439959 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015bf549-0f6c-49dd-ab17-4297774292b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:52.441569 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bf549-0f6c-49dd-ab17-4297774292b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:52.442184 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bf549-0f6c-49dd-ab17-4297774292b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:52.442337 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bf549-0f6c-49dd-ab17-4297774292b9 admin admin] PATH_INFO: `/v3/projects/5f4281c58b0d4e11bef9e4fe6f22410a` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:52.450044 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015bf549-0f6c-49dd-ab17-4297774292b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f4281c58b0d4e11bef9e4fe6f22410a)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:52.452076 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015bf549-0f6c-49dd-ab17-4297774292b9 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:52.507740 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-015bf549-0f6c-49dd-ab17-4297774292b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f4281c58b0d4e11bef9e4fe6f22410a', 'request_id': 'req-015bf549-0f6c-49dd-ab17-4297774292b9'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:52.514146 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-015bf549-0f6c-49dd-ab17-4297774292b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f4281c58b0d4e11bef9e4fe6f22410a', 'request_id': 'req-015bf549-0f6c-49dd-ab17-4297774292b9'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:52.524086 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-015bf549-0f6c-49dd-ab17-4297774292b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f4281c58b0d4e11bef9e4fe6f22410a', 'request_id': 'req-015bf549-0f6c-49dd-ab17-4297774292b9'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:52.530654 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dd8b5-e460-4631-b308-32f26cccb17d service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:52.532145 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-d55dd8b5-e460-4631-b308-32f26cccb17d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:52.535801 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-015bf549-0f6c-49dd-ab17-4297774292b9 admin admin] The token cache is being invalidate because project 5f4281c58b0d4e11bef9e4fe6f22410a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:52.536092 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-015bf549-0f6c-49dd-ab17-4297774292b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:52.536825 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-015bf549-0f6c-49dd-ab17-4297774292b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:52.538700 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1080/2170] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:52 2022] DELETE /identity/v3/projects/5f4281c58b0d4e11bef9e4fe6f22410a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:52.542335 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015bf549-0f6c-49dd-ab17-4297774292b9 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:52.544010 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-015bf549-0f6c-49dd-ab17-4297774292b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:52.548092 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55dd8b5-e460-4631-b308-32f26cccb17d service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:52.608349 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc02512-ff3b-459f-ab7a-e3776dd5f95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:52.609303 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc02512-ff3b-459f-ab7a-e3776dd5f95b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:52.609674 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc02512-ff3b-459f-ab7a-e3776dd5f95b admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:52.610011 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc02512-ff3b-459f-ab7a-e3776dd5f95b admin admin] PATH_INFO: `/v3/users/f0e73667b0134ab085b53482f59bdd63` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:52.611250 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc02512-ff3b-459f-ab7a-e3776dd5f95b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0e73667b0134ab085b53482f59bdd63)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:52.613375 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc02512-ff3b-459f-ab7a-e3776dd5f95b admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:52.617089 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015bf549-0f6c-49dd-ab17-4297774292b9 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:52.622777 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c096b-c4cd-41db-9f5e-20505b4ffda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:52.623758 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c096b-c4cd-41db-9f5e-20505b4ffda7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:52.624037 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c096b-c4cd-41db-9f5e-20505b4ffda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:52.624340 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c096b-c4cd-41db-9f5e-20505b4ffda7 admin admin] PATH_INFO: `/v3/users/f8f8cac92f1b4273b8afaacb52184683` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:52.625604 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c096b-c4cd-41db-9f5e-20505b4ffda7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8f8cac92f1b4273b8afaacb52184683)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:52.627769 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c096b-c4cd-41db-9f5e-20505b4ffda7 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:52.662353 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-1bc02512-ff3b-459f-ab7a-e3776dd5f95b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0e73667b0134ab085b53482f59bdd63'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:52.663176 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-1bc02512-ff3b-459f-ab7a-e3776dd5f95b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0e73667b0134ab085b53482f59bdd63'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:52.671985 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-1bc02512-ff3b-459f-ab7a-e3776dd5f95b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0e73667b0134ab085b53482f59bdd63'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:52.677305 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-748c096b-c4cd-41db-9f5e-20505b4ffda7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8f8cac92f1b4273b8afaacb52184683'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:52.678205 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-748c096b-c4cd-41db-9f5e-20505b4ffda7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8f8cac92f1b4273b8afaacb52184683'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:52.679438 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-1bc02512-ff3b-459f-ab7a-e3776dd5f95b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0e73667b0134ab085b53482f59bdd63'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:52.687167 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-748c096b-c4cd-41db-9f5e-20505b4ffda7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8f8cac92f1b4273b8afaacb52184683'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:52.691968 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-1bc02512-ff3b-459f-ab7a-e3776dd5f95b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0e73667b0134ab085b53482f59bdd63'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:52.698211 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1091/2171] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:52 2022] DELETE /identity/v3/users/f0e73667b0134ab085b53482f59bdd63 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:52.700991 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-748c096b-c4cd-41db-9f5e-20505b4ffda7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8f8cac92f1b4273b8afaacb52184683'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:52.706598 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdb4f3-d37d-4dce-9cb3-af8ab11a6182 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:52.706888 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdb4f3-d37d-4dce-9cb3-af8ab11a6182 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:52.707166 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdb4f3-d37d-4dce-9cb3-af8ab11a6182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:52.711645 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-748c096b-c4cd-41db-9f5e-20505b4ffda7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8f8cac92f1b4273b8afaacb52184683'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:52.718275 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1081/2172] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:53:52 2022] DELETE /identity/v3/users/f8f8cac92f1b4273b8afaacb52184683 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:53:52.729980 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-6fbdb4f3-d37d-4dce-9cb3-af8ab11a6182 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:52.731316 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-6fbdb4f3-d37d-4dce-9cb3-af8ab11a6182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:52.807285 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1092/2173] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:52.823395 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c096b-c4cd-41db-9f5e-20505b4ffda7 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:52.825170 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-748c096b-c4cd-41db-9f5e-20505b4ffda7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:52.895631 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c096b-c4cd-41db-9f5e-20505b4ffda7 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:52.899523 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b96e0c-b4dd-4952-a2aa-b7b7f6cce253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:52.900180 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b96e0c-b4dd-4952-a2aa-b7b7f6cce253 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:52.900748 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b96e0c-b4dd-4952-a2aa-b7b7f6cce253 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:52.900748 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b96e0c-b4dd-4952-a2aa-b7b7f6cce253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:52.910518 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b96e0c-b4dd-4952-a2aa-b7b7f6cce253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:52.911960 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b96e0c-b4dd-4952-a2aa-b7b7f6cce253 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:52.925241 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1082/2174] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:53.132267 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdb4f3-d37d-4dce-9cb3-af8ab11a6182 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:53.133917 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-6fbdb4f3-d37d-4dce-9cb3-af8ab11a6182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:53.156776 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdb4f3-d37d-4dce-9cb3-af8ab11a6182 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:53.163067 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ddde5-83b9-4e54-a666-fb6b6f23daef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:53.164005 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ddde5-83b9-4e54-a666-fb6b6f23daef admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:53.164351 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ddde5-83b9-4e54-a666-fb6b6f23daef admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:53.164687 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ddde5-83b9-4e54-a666-fb6b6f23daef admin admin] PATH_INFO: `/v3/projects/2d14c7415c8c43f3895c79ab8ceed942` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:53.167361 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ddde5-83b9-4e54-a666-fb6b6f23daef admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d14c7415c8c43f3895c79ab8ceed942)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:53.169626 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ddde5-83b9-4e54-a666-fb6b6f23daef admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:53.227985 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-781ddde5-83b9-4e54-a666-fb6b6f23daef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d14c7415c8c43f3895c79ab8ceed942', 'request_id': 'req-781ddde5-83b9-4e54-a666-fb6b6f23daef'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:53.235642 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-781ddde5-83b9-4e54-a666-fb6b6f23daef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d14c7415c8c43f3895c79ab8ceed942', 'request_id': 'req-781ddde5-83b9-4e54-a666-fb6b6f23daef'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:53.244470 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-781ddde5-83b9-4e54-a666-fb6b6f23daef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d14c7415c8c43f3895c79ab8ceed942', 'request_id': 'req-781ddde5-83b9-4e54-a666-fb6b6f23daef'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:53.256740 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-781ddde5-83b9-4e54-a666-fb6b6f23daef admin admin] The token cache is being invalidate because project 2d14c7415c8c43f3895c79ab8ceed942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:53.257032 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-781ddde5-83b9-4e54-a666-fb6b6f23daef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:53.257840 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-781ddde5-83b9-4e54-a666-fb6b6f23daef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:53.259390 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1093/2175] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:53 2022] DELETE /identity/v3/projects/2d14c7415c8c43f3895c79ab8ceed942 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:53.265828 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2f4f9-09f6-439b-b00d-e6386d4664d2 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:53.266314 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2f4f9-09f6-439b-b00d-e6386d4664d2 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:53.266430 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2f4f9-09f6-439b-b00d-e6386d4664d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:53.286107 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-a2f2f4f9-09f6-439b-b00d-e6386d4664d2 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:53.287436 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-a2f2f4f9-09f6-439b-b00d-e6386d4664d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:53.298937 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ddde5-83b9-4e54-a666-fb6b6f23daef admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:53.300561 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-781ddde5-83b9-4e54-a666-fb6b6f23daef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:53.349311 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1083/2176] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:53:53.357247 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174f621-08da-4ac8-9583-1d8924ac1816 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:53.357561 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174f621-08da-4ac8-9583-1d8924ac1816 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:53.357834 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174f621-08da-4ac8-9583-1d8924ac1816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:53.365021 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ddde5-83b9-4e54-a666-fb6b6f23daef admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:53.369961 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89dbc94-aec5-4a94-a6cc-db58f059cd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:53.370818 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dbc94-aec5-4a94-a6cc-db58f059cd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:53.371091 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dbc94-aec5-4a94-a6cc-db58f059cd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:53.371357 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89dbc94-aec5-4a94-a6cc-db58f059cd24 admin admin] PATH_INFO: `/v3/projects/52d2159af6bd4f0087f8f428b54244b8` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:53.372530 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89dbc94-aec5-4a94-a6cc-db58f059cd24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52d2159af6bd4f0087f8f428b54244b8)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:53.374503 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89dbc94-aec5-4a94-a6cc-db58f059cd24 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:53.375924 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-0174f621-08da-4ac8-9583-1d8924ac1816 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:53.377114 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-0174f621-08da-4ac8-9583-1d8924ac1816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:53.385030 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1084/2177] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:53:53.389222 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174f621-08da-4ac8-9583-1d8924ac1816 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:53.397942 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174f621-08da-4ac8-9583-1d8924ac1816 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:53.402962 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd6562-795f-48f5-8750-118f3731873a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:53.403561 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd6562-795f-48f5-8750-118f3731873a admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:53.403902 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd6562-795f-48f5-8750-118f3731873a admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:53.404171 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccd6562-795f-48f5-8750-118f3731873a admin admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:53.404943 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd6562-795f-48f5-8750-118f3731873a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:53:53.405327 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd6562-795f-48f5-8750-118f3731873a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:53.407036 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccd6562-795f-48f5-8750-118f3731873a admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:53.418887 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1085/2178] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:53:53.422520 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-f89dbc94-aec5-4a94-a6cc-db58f059cd24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52d2159af6bd4f0087f8f428b54244b8', 'request_id': 'req-f89dbc94-aec5-4a94-a6cc-db58f059cd24'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:53.423202 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd6562-795f-48f5-8750-118f3731873a admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:53.428862 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-f89dbc94-aec5-4a94-a6cc-db58f059cd24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52d2159af6bd4f0087f8f428b54244b8', 'request_id': 'req-f89dbc94-aec5-4a94-a6cc-db58f059cd24'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:53.432723 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccd6562-795f-48f5-8750-118f3731873a admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:53.437457 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-f89dbc94-aec5-4a94-a6cc-db58f059cd24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52d2159af6bd4f0087f8f428b54244b8', 'request_id': 'req-f89dbc94-aec5-4a94-a6cc-db58f059cd24'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:53.447376 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-f89dbc94-aec5-4a94-a6cc-db58f059cd24 admin admin] The token cache is being invalidate because project 52d2159af6bd4f0087f8f428b54244b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:53:53.447700 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-f89dbc94-aec5-4a94-a6cc-db58f059cd24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:53.448328 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-f89dbc94-aec5-4a94-a6cc-db58f059cd24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:53:53.450259 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1094/2179] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:53:53 2022] DELETE /identity/v3/projects/52d2159af6bd4f0087f8f428b54244b8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:53:53.455376 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98da3c2-ba68-4347-91cf-3611c6368e06 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:53.455671 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98da3c2-ba68-4347-91cf-3611c6368e06 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:53.455971 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98da3c2-ba68-4347-91cf-3611c6368e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:53.476167 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-d98da3c2-ba68-4347-91cf-3611c6368e06 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:53.477836 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-d98da3c2-ba68-4347-91cf-3611c6368e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:53.486541 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db0792-4bee-419a-abbe-0695c26f7b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:53.487260 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db0792-4bee-419a-abbe-0695c26f7b1c admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:53.487650 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db0792-4bee-419a-abbe-0695c26f7b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:53.487932 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db0792-4bee-419a-abbe-0695c26f7b1c admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:53.488640 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db0792-4bee-419a-abbe-0695c26f7b1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:53.490556 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db0792-4bee-419a-abbe-0695c26f7b1c admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:53.522079 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1086/2180] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:53:53 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:53:53.526252 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db0792-4bee-419a-abbe-0695c26f7b1c admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:53.527885 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-e4db0792-4bee-419a-abbe-0695c26f7b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:53.536955 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1095/2181] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:53:53.545415 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63442d98-f5a7-49c4-bfd8-514b2d587838 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:53.545710 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63442d98-f5a7-49c4-bfd8-514b2d587838 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:53.545989 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63442d98-f5a7-49c4-bfd8-514b2d587838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:53.563370 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-63442d98-f5a7-49c4-bfd8-514b2d587838 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:53.564572 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-63442d98-f5a7-49c4-bfd8-514b2d587838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:53.589110 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db0792-4bee-419a-abbe-0695c26f7b1c admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:53.594623 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5120f0-1d4c-4d29-8ba6-13a62c367559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:53.595290 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5120f0-1d4c-4d29-8ba6-13a62c367559 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:53.595574 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5120f0-1d4c-4d29-8ba6-13a62c367559 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:53.595848 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5120f0-1d4c-4d29-8ba6-13a62c367559 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:53.596585 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5120f0-1d4c-4d29-8ba6-13a62c367559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:53.598479 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5120f0-1d4c-4d29-8ba6-13a62c367559 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:53.619814 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1087/2182] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:53:53 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:53:53.624024 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5120f0-1d4c-4d29-8ba6-13a62c367559 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:53.626845 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1096/2183] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:53:53.631164 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63442d98-f5a7-49c4-bfd8-514b2d587838 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:53.633330 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5120f0-1d4c-4d29-8ba6-13a62c367559 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:53.638302 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b2b7a-dd81-45f1-bfd3-8b7ca5091894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:53.638944 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b2b7a-dd81-45f1-bfd3-8b7ca5091894 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:53.639222 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b2b7a-dd81-45f1-bfd3-8b7ca5091894 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:53.639495 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b2b7a-dd81-45f1-bfd3-8b7ca5091894 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:53.640026 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63442d98-f5a7-49c4-bfd8-514b2d587838 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:53.640208 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b2b7a-dd81-45f1-bfd3-8b7ca5091894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:53.641808 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b2b7a-dd81-45f1-bfd3-8b7ca5091894 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:53.645207 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cc2b0-7240-47ac-9584-67b3dd0d838a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:53.645875 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cc2b0-7240-47ac-9584-67b3dd0d838a admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:53.646155 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cc2b0-7240-47ac-9584-67b3dd0d838a admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:53.646453 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66cc2b0-7240-47ac-9584-67b3dd0d838a admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:53.647141 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66cc2b0-7240-47ac-9584-67b3dd0d838a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:53:53.647464 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66cc2b0-7240-47ac-9584-67b3dd0d838a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:53.649054 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66cc2b0-7240-47ac-9584-67b3dd0d838a admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:53.652098 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1088/2184] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:53:53.656049 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b2b7a-dd81-45f1-bfd3-8b7ca5091894 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:53.661000 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1097/2185] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:53:53.665103 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cc2b0-7240-47ac-9584-67b3dd0d838a admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:53.665717 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b2b7a-dd81-45f1-bfd3-8b7ca5091894 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:53.670414 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679ea15-c709-4a72-878e-8f5cf1fe13b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:53.671006 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679ea15-c709-4a72-878e-8f5cf1fe13b3 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:53.671280 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679ea15-c709-4a72-878e-8f5cf1fe13b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:53.671549 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679ea15-c709-4a72-878e-8f5cf1fe13b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:53.672261 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679ea15-c709-4a72-878e-8f5cf1fe13b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:53.673848 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679ea15-c709-4a72-878e-8f5cf1fe13b3 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:53.674552 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66cc2b0-7240-47ac-9584-67b3dd0d838a admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:53.679856 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3a231-44e9-4bf1-9307-fb331e8dbb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:53.680495 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3a231-44e9-4bf1-9307-fb331e8dbb56 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:53.680779 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3a231-44e9-4bf1-9307-fb331e8dbb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:53.681054 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3a231-44e9-4bf1-9307-fb331e8dbb56 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:53.681779 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3a231-44e9-4bf1-9307-fb331e8dbb56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:53.683654 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3a231-44e9-4bf1-9307-fb331e8dbb56 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:53.683755 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1089/2186] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:53:53.687928 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679ea15-c709-4a72-878e-8f5cf1fe13b3 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:53.697321 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679ea15-c709-4a72-878e-8f5cf1fe13b3 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:53.702640 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e19bf9-a5c8-423b-80f8-e5bd36873576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:53.703537 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e19bf9-a5c8-423b-80f8-e5bd36873576 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:53.703838 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e19bf9-a5c8-423b-80f8-e5bd36873576 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:53.704112 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e19bf9-a5c8-423b-80f8-e5bd36873576 admin admin] PATH_INFO: `/v3/projects/81fd0fd8a1cc499f8479307f01f32b24/users/e6055ea4298a492b8e49c11e70c8356f/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:53.711858 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1098/2187] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:53:53 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:53:53.716299 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3a231-44e9-4bf1-9307-fb331e8dbb56 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:53.721368 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e19bf9-a5c8-423b-80f8-e5bd36873576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81fd0fd8a1cc499f8479307f01f32b24, user_id=e6055ea4298a492b8e49c11e70c8356f, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:53.724141 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e19bf9-a5c8-423b-80f8-e5bd36873576 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:53.739656 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1090/2188] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:53 2022] PUT /identity/v3/projects/81fd0fd8a1cc499f8479307f01f32b24/users/e6055ea4298a492b8e49c11e70c8356f/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:53:53.744738 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f615b1-8ac0-425c-a53c-c514f937c346 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:53.745031 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f615b1-8ac0-425c-a53c-c514f937c346 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:53.745326 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f615b1-8ac0-425c-a53c-c514f937c346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:53.761917 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-72f615b1-8ac0-425c-a53c-c514f937c346 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:53.763086 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-72f615b1-8ac0-425c-a53c-c514f937c346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:53.776092 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3a231-44e9-4bf1-9307-fb331e8dbb56 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:53.829107 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1091/2189] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:53:53.834851 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741e3be-0677-4065-9b24-67432d65be31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:53.835529 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741e3be-0677-4065-9b24-67432d65be31 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:53.835806 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741e3be-0677-4065-9b24-67432d65be31 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:53.836077 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1741e3be-0677-4065-9b24-67432d65be31 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:53.836568 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f615b1-8ac0-425c-a53c-c514f937c346 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:53.836764 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741e3be-0677-4065-9b24-67432d65be31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:53.838049 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-72f615b1-8ac0-425c-a53c-c514f937c346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:53.838711 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1741e3be-0677-4065-9b24-67432d65be31 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:53.864084 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1099/2190] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:53:53 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:53:53.865384 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741e3be-0677-4065-9b24-67432d65be31 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:53.875090 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1741e3be-0677-4065-9b24-67432d65be31 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:53.879769 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b25ab2-0995-47f5-93f7-09f3400eb345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:53.880434 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b25ab2-0995-47f5-93f7-09f3400eb345 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:53.880712 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b25ab2-0995-47f5-93f7-09f3400eb345 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:53.880984 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b25ab2-0995-47f5-93f7-09f3400eb345 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:53.881734 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b25ab2-0995-47f5-93f7-09f3400eb345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:53.883348 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b25ab2-0995-47f5-93f7-09f3400eb345 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:53.892981 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1100/2191] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:53:53.894726 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f615b1-8ac0-425c-a53c-c514f937c346 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:53.896968 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b25ab2-0995-47f5-93f7-09f3400eb345 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:53.898899 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e0856-e08e-4b66-9605-0b71bd9e2e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:53.899551 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e0856-e08e-4b66-9605-0b71bd9e2e38 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:53.899829 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e0856-e08e-4b66-9605-0b71bd9e2e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:53.900095 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e0856-e08e-4b66-9605-0b71bd9e2e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:53.906316 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b25ab2-0995-47f5-93f7-09f3400eb345 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:53.909705 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e0856-e08e-4b66-9605-0b71bd9e2e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:53.910900 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8760808-fad5-4561-ac12-6f7514956d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:53.911119 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e0856-e08e-4b66-9605-0b71bd9e2e38 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:53.911512 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8760808-fad5-4561-ac12-6f7514956d53 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:53.911788 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8760808-fad5-4561-ac12-6f7514956d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:53.912055 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8760808-fad5-4561-ac12-6f7514956d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:53.912749 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8760808-fad5-4561-ac12-6f7514956d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:53.914392 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8760808-fad5-4561-ac12-6f7514956d53 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:53.920685 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1092/2192] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:53.924200 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1101/2193] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:53:53.928561 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e0856-e08e-4b66-9605-0b71bd9e2e38 service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:53.937784 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e0856-e08e-4b66-9605-0b71bd9e2e38 service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:53.942845 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91ccf5-abfe-40c3-a66c-29082ad8255a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:53.943750 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91ccf5-abfe-40c3-a66c-29082ad8255a admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:53.944051 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91ccf5-abfe-40c3-a66c-29082ad8255a admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:53.944387 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91ccf5-abfe-40c3-a66c-29082ad8255a admin admin] PATH_INFO: `/v3/projects/ec245e0430fa4153a547d63719aa4c44/users/10bcf5583fad4a2ba06d7fa6c3dd517d/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:53.963314 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91ccf5-abfe-40c3-a66c-29082ad8255a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec245e0430fa4153a547d63719aa4c44, user_id=10bcf5583fad4a2ba06d7fa6c3dd517d, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:53.966123 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91ccf5-abfe-40c3-a66c-29082ad8255a admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:53.982208 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1093/2194] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:53 2022] PUT /identity/v3/projects/ec245e0430fa4153a547d63719aa4c44/users/10bcf5583fad4a2ba06d7fa6c3dd517d/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:53:53.987475 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbccd6d7-adb5-4467-94cc-f07c325a5e33 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:53.987962 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbccd6d7-adb5-4467-94cc-f07c325a5e33 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:53.988365 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbccd6d7-adb5-4467-94cc-f07c325a5e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:54.007684 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-dbccd6d7-adb5-4467-94cc-f07c325a5e33 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:54.009282 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-dbccd6d7-adb5-4467-94cc-f07c325a5e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:54.080671 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1102/2195] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:54.091209 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91ccf5-abfe-40c3-a66c-29082ad8255a admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:54.093300 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-bd91ccf5-abfe-40c3-a66c-29082ad8255a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:54.157752 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91ccf5-abfe-40c3-a66c-29082ad8255a admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:54.162378 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de7b3f-bb07-450e-a3d1-577f8208743c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:54.163211 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de7b3f-bb07-450e-a3d1-577f8208743c service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:54.163605 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de7b3f-bb07-450e-a3d1-577f8208743c service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:54.163969 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de7b3f-bb07-450e-a3d1-577f8208743c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:54.176462 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de7b3f-bb07-450e-a3d1-577f8208743c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:54.177922 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de7b3f-bb07-450e-a3d1-577f8208743c service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:54.192801 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1094/2196] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:55.081802 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c545a-5bda-47da-8231-65d7245d645e None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:55.082377 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c545a-5bda-47da-8231-65d7245d645e None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:55.082377 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c545a-5bda-47da-8231-65d7245d645e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:55.111685 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-148c545a-5bda-47da-8231-65d7245d645e None None] MFA Rules not processed for user `10bcf5583fad4a2ba06d7fa6c3dd517d`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:55.113528 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-148c545a-5bda-47da-8231-65d7245d645e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:55.179257 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1103/2197] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:55.192072 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de7b3f-bb07-450e-a3d1-577f8208743c service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:55.193605 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-54de7b3f-bb07-450e-a3d1-577f8208743c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:55.256804 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de7b3f-bb07-450e-a3d1-577f8208743c service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:55.260543 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f267d-d663-4eb9-9240-cddcaf748973 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:55.261188 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f267d-d663-4eb9-9240-cddcaf748973 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:55.261568 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f267d-d663-4eb9-9240-cddcaf748973 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:55.261845 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f267d-d663-4eb9-9240-cddcaf748973 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:55.272734 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f267d-d663-4eb9-9240-cddcaf748973 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:55.274199 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f267d-d663-4eb9-9240-cddcaf748973 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:55.283394 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1095/2198] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:53:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:53:56.704652 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffb8c6-35de-421b-90aa-4ecbc51ab334 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:56.705164 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffb8c6-35de-421b-90aa-4ecbc51ab334 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:56.705256 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ffb8c6-35de-421b-90aa-4ecbc51ab334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:56.731371 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-66ffb8c6-35de-421b-90aa-4ecbc51ab334 None None] MFA Rules not processed for user `10bcf5583fad4a2ba06d7fa6c3dd517d`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:56.732997 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-66ffb8c6-35de-421b-90aa-4ecbc51ab334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:56.749218 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1104/2199] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:59.479643 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41e697-425e-4552-be98-95d0509efccf None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:59.480212 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41e697-425e-4552-be98-95d0509efccf None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:59.480212 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41e697-425e-4552-be98-95d0509efccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:59.507746 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-3f41e697-425e-4552-be98-95d0509efccf None None] MFA Rules not processed for user `e6055ea4298a492b8e49c11e70c8356f`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:53:59.508941 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-3f41e697-425e-4552-be98-95d0509efccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:53:59.576021 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1096/2200] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:53:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:53:59.581312 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffb8c6-35de-421b-90aa-4ecbc51ab334 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:59.592009 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ffb8c6-35de-421b-90aa-4ecbc51ab334 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:59.596586 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d264d-1864-486c-b8b2-f7466a770581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:59.597250 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d264d-1864-486c-b8b2-f7466a770581 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:59.597562 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d264d-1864-486c-b8b2-f7466a770581 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:59.597835 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d264d-1864-486c-b8b2-f7466a770581 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:59.598529 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d264d-1864-486c-b8b2-f7466a770581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:59.600437 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d264d-1864-486c-b8b2-f7466a770581 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:59.628958 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1105/2201] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:53:59 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:53:59.633099 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41e697-425e-4552-be98-95d0509efccf None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:59.643955 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41e697-425e-4552-be98-95d0509efccf None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:59.700767 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6efb9-b4c9-4cd0-ae92-8a49e6ebb840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:59.701443 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6efb9-b4c9-4cd0-ae92-8a49e6ebb840 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:59.701661 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6efb9-b4c9-4cd0-ae92-8a49e6ebb840 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:59.701933 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6efb9-b4c9-4cd0-ae92-8a49e6ebb840 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:59.702644 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6efb9-b4c9-4cd0-ae92-8a49e6ebb840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:59.704930 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6efb9-b4c9-4cd0-ae92-8a49e6ebb840 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:59.736986 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1097/2202] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:53:59 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:53:59.737123 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d264d-1864-486c-b8b2-f7466a770581 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:59.761009 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d264d-1864-486c-b8b2-f7466a770581 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:59.767228 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f56b0-b58f-4985-b9fa-e5e33f09585e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:59.768607 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f56b0-b58f-4985-b9fa-e5e33f09585e admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:59.768955 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f56b0-b58f-4985-b9fa-e5e33f09585e admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:59.769303 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476f56b0-b58f-4985-b9fa-e5e33f09585e admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:59.771055 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f56b0-b58f-4985-b9fa-e5e33f09585e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:59.772770 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476f56b0-b58f-4985-b9fa-e5e33f09585e admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:59.787673 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1106/2203] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:53:59.792004 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6efb9-b4c9-4cd0-ae92-8a49e6ebb840 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:59.805183 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6efb9-b4c9-4cd0-ae92-8a49e6ebb840 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:59.814805 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1120877-7785-4fe5-b015-77bb063fd712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:59.819531 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1120877-7785-4fe5-b015-77bb063fd712 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:59.819808 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1120877-7785-4fe5-b015-77bb063fd712 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:59.820095 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1120877-7785-4fe5-b015-77bb063fd712 admin admin] PATH_INFO: `/v3/projects/ca627d4d3c3b4951a997a56a11eb118e/users/d2ee2a69b50c4d8aa455b498dffcbbee/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:59.838608 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1120877-7785-4fe5-b015-77bb063fd712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca627d4d3c3b4951a997a56a11eb118e, user_id=d2ee2a69b50c4d8aa455b498dffcbbee, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:59.841643 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1120877-7785-4fe5-b015-77bb063fd712 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:59.857562 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1098/2204] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:59 2022] PUT /identity/v3/projects/ca627d4d3c3b4951a997a56a11eb118e/users/d2ee2a69b50c4d8aa455b498dffcbbee/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:53:59.861394 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f56b0-b58f-4985-b9fa-e5e33f09585e admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:53:59.871964 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476f56b0-b58f-4985-b9fa-e5e33f09585e admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:53:59.961221 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bb95cf-50c8-4c5f-9b1b-298de64f41a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:53:59.963357 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb95cf-50c8-4c5f-9b1b-298de64f41a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:53:59.963824 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb95cf-50c8-4c5f-9b1b-298de64f41a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:53:59.964295 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb95cf-50c8-4c5f-9b1b-298de64f41a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:53:59.965501 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb95cf-50c8-4c5f-9b1b-298de64f41a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:53:59.968244 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bb95cf-50c8-4c5f-9b1b-298de64f41a4 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:53:59.985017 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1107/2205] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:53:59.986283 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1120877-7785-4fe5-b015-77bb063fd712 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:54:00.000795 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1120877-7785-4fe5-b015-77bb063fd712 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:54:00.006449 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f049dd-47bd-46b2-88b6-50532a599c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:54:00.007590 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f049dd-47bd-46b2-88b6-50532a599c79 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:00.016589 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f049dd-47bd-46b2-88b6-50532a599c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:00.016589 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f049dd-47bd-46b2-88b6-50532a599c79 admin admin] PATH_INFO: `/v3/projects/ca627d4d3c3b4951a997a56a11eb118e/users/d2ee2a69b50c4d8aa455b498dffcbbee/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:00.026684 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f049dd-47bd-46b2-88b6-50532a599c79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca627d4d3c3b4951a997a56a11eb118e, user_id=d2ee2a69b50c4d8aa455b498dffcbbee, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:54:00.030985 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f049dd-47bd-46b2-88b6-50532a599c79 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:54:00.047548 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1099/2206] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:53:59 2022] PUT /identity/v3/projects/ca627d4d3c3b4951a997a56a11eb118e/users/d2ee2a69b50c4d8aa455b498dffcbbee/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:54:06.951852 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12db53d-ee2f-4197-b9c8-b9ff8bc81a67 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:06.952485 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12db53d-ee2f-4197-b9c8-b9ff8bc81a67 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:06.952485 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12db53d-ee2f-4197-b9c8-b9ff8bc81a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:06.986621 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-f12db53d-ee2f-4197-b9c8-b9ff8bc81a67 None None] MFA Rules not processed for user `d2ee2a69b50c4d8aa455b498dffcbbee`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:54:06.988069 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-f12db53d-ee2f-4197-b9c8-b9ff8bc81a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:07.070579 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1108/2207] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:54:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:54:07.084213 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f049dd-47bd-46b2-88b6-50532a599c79 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:54:07.086338 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-48f049dd-47bd-46b2-88b6-50532a599c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:07.163114 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f049dd-47bd-46b2-88b6-50532a599c79 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:54:07.166871 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf4b0c-c34f-4338-a322-057163e0fa07 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b8e066deb49e6b48804cbbe5cd6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:54:07.168060 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf4b0c-c34f-4338-a322-057163e0fa07 service glance] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:07.168351 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf4b0c-c34f-4338-a322-057163e0fa07 service glance] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:07.168616 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf4b0c-c34f-4338-a322-057163e0fa07 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:07.264934 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf4b0c-c34f-4338-a322-057163e0fa07 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:54:07.266313 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf4b0c-c34f-4338-a322-057163e0fa07 service glance] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:54:07.277140 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1100/2208] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:54:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:54:07.461428 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e81327-8018-43fd-be2a-a6fc9139d4d8 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:07.464216 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e81327-8018-43fd-be2a-a6fc9139d4d8 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:07.468172 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e81327-8018-43fd-be2a-a6fc9139d4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:07.493760 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-e7e81327-8018-43fd-be2a-a6fc9139d4d8 None None] MFA Rules not processed for user `817bcd2c5f6e4bceb049eeb122d4e432`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:54:07.495173 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-e7e81327-8018-43fd-be2a-a6fc9139d4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:07.581571 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1109/2209] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Mar 8 13:54:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:54:07.634436 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf4b0c-c34f-4338-a322-057163e0fa07 service glance] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:54:07.635892 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-dcaf4b0c-c34f-4338-a322-057163e0fa07 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:07.705732 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf4b0c-c34f-4338-a322-057163e0fa07 service glance] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:54:07.711205 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ac6c1-d6c6-49d3-bbb8-9ea09ad155c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0f442666d0459aa9a34fc2f91228e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:54:07.711856 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ac6c1-d6c6-49d3-bbb8-9ea09ad155c6 service swift] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:07.712265 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ac6c1-d6c6-49d3-bbb8-9ea09ad155c6 service swift] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:07.712560 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ac6c1-d6c6-49d3-bbb8-9ea09ad155c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:07.721505 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ac6c1-d6c6-49d3-bbb8-9ea09ad155c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:54:07.723230 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ac6c1-d6c6-49d3-bbb8-9ea09ad155c6 service swift] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:54:07.731563 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1101/2210] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Mar 8 13:54:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 08 13:54:18.099719 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80febeb-5ebd-43c9-89ab-ade4b748d378 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:18.100239 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80febeb-5ebd-43c9-89ab-ade4b748d378 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:18.100319 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80febeb-5ebd-43c9-89ab-ade4b748d378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:18.118192 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-c80febeb-5ebd-43c9-89ab-ade4b748d378 None None] MFA Rules not processed for user `e6055ea4298a492b8e49c11e70c8356f`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:54:18.119298 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-c80febeb-5ebd-43c9-89ab-ade4b748d378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:18.126093 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1110/2211] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:54:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:54:20.171227 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74cb33-b092-471c-8afe-c1326b723689 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:20.171792 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74cb33-b092-471c-8afe-c1326b723689 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:20.171792 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce74cb33-b092-471c-8afe-c1326b723689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:20.201700 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-ce74cb33-b092-471c-8afe-c1326b723689 None None] MFA Rules not processed for user `817bcd2c5f6e4bceb049eeb122d4e432`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:54:20.202909 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-ce74cb33-b092-471c-8afe-c1326b723689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:20.216647 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1102/2212] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Mar 8 13:54:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:54:20.238507 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80febeb-5ebd-43c9-89ab-ade4b748d378 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:54:20.250970 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80febeb-5ebd-43c9-89ab-ade4b748d378 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:54:20.275658 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e874510-b3aa-4ccf-a683-98cb327162f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0f442666d0459aa9a34fc2f91228e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:54:20.276422 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e874510-b3aa-4ccf-a683-98cb327162f9 service swift] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:20.276768 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e874510-b3aa-4ccf-a683-98cb327162f9 service swift] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:20.277102 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e874510-b3aa-4ccf-a683-98cb327162f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:20.286535 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e874510-b3aa-4ccf-a683-98cb327162f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:54:20.288268 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e874510-b3aa-4ccf-a683-98cb327162f9 service swift] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:54:20.296585 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1111/2213] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Mar 8 13:54:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 13:54:26.392951 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74cb33-b092-471c-8afe-c1326b723689 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:54:26.395750 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-ce74cb33-b092-471c-8afe-c1326b723689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:26.519420 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce74cb33-b092-471c-8afe-c1326b723689 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:54:26.524020 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291f57a-5d6e-4671-84f7-6117a4d39661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:54:26.524889 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291f57a-5d6e-4671-84f7-6117a4d39661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:26.525162 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291f57a-5d6e-4671-84f7-6117a4d39661 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:26.525454 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3291f57a-5d6e-4671-84f7-6117a4d39661 admin admin] PATH_INFO: `/v3/users/3b7de5a9bfef45dc825310817793d96e` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:26.526625 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291f57a-5d6e-4671-84f7-6117a4d39661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b7de5a9bfef45dc825310817793d96e)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:54:26.528526 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3291f57a-5d6e-4671-84f7-6117a4d39661 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:54:26.585421 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-3291f57a-5d6e-4671-84f7-6117a4d39661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b7de5a9bfef45dc825310817793d96e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:54:26.586534 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-3291f57a-5d6e-4671-84f7-6117a4d39661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b7de5a9bfef45dc825310817793d96e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:54:26.596203 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-3291f57a-5d6e-4671-84f7-6117a4d39661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b7de5a9bfef45dc825310817793d96e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:54:26.615144 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-3291f57a-5d6e-4671-84f7-6117a4d39661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b7de5a9bfef45dc825310817793d96e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:54:26.627335 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-3291f57a-5d6e-4671-84f7-6117a4d39661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b7de5a9bfef45dc825310817793d96e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:54:26.633678 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1103/2214] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:54:26 2022] DELETE /identity/v3/users/3b7de5a9bfef45dc825310817793d96e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:54:26.638042 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83243c82-fbcb-4293-8a9d-086ff95676d6 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:26.638572 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83243c82-fbcb-4293-8a9d-086ff95676d6 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:26.638572 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83243c82-fbcb-4293-8a9d-086ff95676d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:26.667502 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-83243c82-fbcb-4293-8a9d-086ff95676d6 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:54:26.669274 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-83243c82-fbcb-4293-8a9d-086ff95676d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:26.728893 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1112/2215] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:54:26.738353 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291f57a-5d6e-4671-84f7-6117a4d39661 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:54:26.740018 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-3291f57a-5d6e-4671-84f7-6117a4d39661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:26.842563 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3291f57a-5d6e-4671-84f7-6117a4d39661 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:54:26.846327 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473be76-6b7a-484d-b903-996b017e0e52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:54:26.847076 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473be76-6b7a-484d-b903-996b017e0e52 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:26.847423 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473be76-6b7a-484d-b903-996b017e0e52 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:26.847849 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473be76-6b7a-484d-b903-996b017e0e52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:26.859339 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473be76-6b7a-484d-b903-996b017e0e52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:54:26.860906 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473be76-6b7a-484d-b903-996b017e0e52 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:54:26.872625 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1104/2216] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:54:27.202953 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83243c82-fbcb-4293-8a9d-086ff95676d6 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:54:27.207510 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-83243c82-fbcb-4293-8a9d-086ff95676d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:27.230382 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83243c82-fbcb-4293-8a9d-086ff95676d6 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:54:27.242282 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f9432-37a4-44b1-a171-d0307e624179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:54:27.245466 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f9432-37a4-44b1-a171-d0307e624179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:27.245759 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f9432-37a4-44b1-a171-d0307e624179 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:27.247766 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f9432-37a4-44b1-a171-d0307e624179 admin admin] PATH_INFO: `/v3/projects/ba742270457445738a58b72256eb1708` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:27.250236 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f9432-37a4-44b1-a171-d0307e624179 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba742270457445738a58b72256eb1708)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:54:27.252216 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f9432-37a4-44b1-a171-d0307e624179 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:54:27.329011 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-210f9432-37a4-44b1-a171-d0307e624179 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba742270457445738a58b72256eb1708', 'request_id': 'req-210f9432-37a4-44b1-a171-d0307e624179'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:54:27.336138 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-210f9432-37a4-44b1-a171-d0307e624179 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba742270457445738a58b72256eb1708', 'request_id': 'req-210f9432-37a4-44b1-a171-d0307e624179'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:54:27.348941 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-210f9432-37a4-44b1-a171-d0307e624179 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba742270457445738a58b72256eb1708', 'request_id': 'req-210f9432-37a4-44b1-a171-d0307e624179'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:54:27.362733 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-210f9432-37a4-44b1-a171-d0307e624179 admin admin] The token cache is being invalidate because project ba742270457445738a58b72256eb1708 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:54:27.363297 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-210f9432-37a4-44b1-a171-d0307e624179 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:54:27.364452 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-210f9432-37a4-44b1-a171-d0307e624179 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:54:27.368039 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1113/2217] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:54:27 2022] DELETE /identity/v3/projects/ba742270457445738a58b72256eb1708 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:54:27.372737 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795e30b-296c-49bb-8984-87195b878e7c None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:27.373035 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795e30b-296c-49bb-8984-87195b878e7c None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:27.373311 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795e30b-296c-49bb-8984-87195b878e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:27.432271 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-5795e30b-296c-49bb-8984-87195b878e7c None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:54:27.433706 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-5795e30b-296c-49bb-8984-87195b878e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:27.599184 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1105/2218] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:54:27.607708 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddd0e8-1ef3-4fbe-9a81-84986e1ff39e None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:27.608002 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddd0e8-1ef3-4fbe-9a81-84986e1ff39e None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:27.608285 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddd0e8-1ef3-4fbe-9a81-84986e1ff39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:27.628705 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-42ddd0e8-1ef3-4fbe-9a81-84986e1ff39e None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:54:27.630024 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-42ddd0e8-1ef3-4fbe-9a81-84986e1ff39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:27.638921 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1114/2219] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:54:27.642686 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795e30b-296c-49bb-8984-87195b878e7c None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:54:27.655600 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795e30b-296c-49bb-8984-87195b878e7c None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:54:27.674089 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bea39-15f4-4e4a-abd3-e2ef114c443c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:54:27.675116 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bea39-15f4-4e4a-abd3-e2ef114c443c admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:27.675401 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bea39-15f4-4e4a-abd3-e2ef114c443c admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:27.675678 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bea39-15f4-4e4a-abd3-e2ef114c443c admin admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:27.676524 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bea39-15f4-4e4a-abd3-e2ef114c443c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:54:27.676868 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bea39-15f4-4e4a-abd3-e2ef114c443c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:54:27.678495 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bea39-15f4-4e4a-abd3-e2ef114c443c admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:54:27.690517 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1106/2220] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:54:27.694859 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddd0e8-1ef3-4fbe-9a81-84986e1ff39e None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:54:27.705505 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddd0e8-1ef3-4fbe-9a81-84986e1ff39e None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:54:27.710567 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b536d5f-567c-45a2-a5c8-7a3b06133af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:54:27.711460 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b536d5f-567c-45a2-a5c8-7a3b06133af4 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:27.712007 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b536d5f-567c-45a2-a5c8-7a3b06133af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:27.712356 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b536d5f-567c-45a2-a5c8-7a3b06133af4 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:27.713164 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b536d5f-567c-45a2-a5c8-7a3b06133af4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:54:27.716237 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b536d5f-567c-45a2-a5c8-7a3b06133af4 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:54:27.746860 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1115/2221] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:54:27 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:54:27.751030 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bea39-15f4-4e4a-abd3-e2ef114c443c admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:54:27.761887 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bea39-15f4-4e4a-abd3-e2ef114c443c admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:54:27.820775 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc654be-21ff-4729-aa09-673b84e33083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:54:27.821482 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc654be-21ff-4729-aa09-673b84e33083 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:27.821766 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc654be-21ff-4729-aa09-673b84e33083 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:27.822042 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc654be-21ff-4729-aa09-673b84e33083 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:27.822747 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc654be-21ff-4729-aa09-673b84e33083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:54:27.824864 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc654be-21ff-4729-aa09-673b84e33083 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:54:27.847669 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1107/2222] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:54:27 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:54:27.853611 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b536d5f-567c-45a2-a5c8-7a3b06133af4 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:54:27.864536 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b536d5f-567c-45a2-a5c8-7a3b06133af4 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:54:27.869916 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29059a80-7ebb-44e3-8e70-2c74caa95397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:54:27.870679 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29059a80-7ebb-44e3-8e70-2c74caa95397 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:27.871051 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29059a80-7ebb-44e3-8e70-2c74caa95397 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:27.871335 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29059a80-7ebb-44e3-8e70-2c74caa95397 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:27.872104 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29059a80-7ebb-44e3-8e70-2c74caa95397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:54:27.874221 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29059a80-7ebb-44e3-8e70-2c74caa95397 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:54:27.886217 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1116/2223] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:54:27.890034 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc654be-21ff-4729-aa09-673b84e33083 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:54:27.901618 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc654be-21ff-4729-aa09-673b84e33083 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:54:27.908805 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc3cdd-c88c-4f3b-a9d6-1f6d120853d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:54:27.909965 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc3cdd-c88c-4f3b-a9d6-1f6d120853d9 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:27.910473 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc3cdd-c88c-4f3b-a9d6-1f6d120853d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:27.911033 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc3cdd-c88c-4f3b-a9d6-1f6d120853d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:27.911995 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc3cdd-c88c-4f3b-a9d6-1f6d120853d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:54:27.914075 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc3cdd-c88c-4f3b-a9d6-1f6d120853d9 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:54:27.925203 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1108/2224] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:54:27.930462 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29059a80-7ebb-44e3-8e70-2c74caa95397 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:54:27.941522 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29059a80-7ebb-44e3-8e70-2c74caa95397 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:54:27.946001 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68348e69-5a12-406a-af0c-d3ad5a11f94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:54:27.946893 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68348e69-5a12-406a-af0c-d3ad5a11f94d admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:27.947174 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68348e69-5a12-406a-af0c-d3ad5a11f94d admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:27.947444 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68348e69-5a12-406a-af0c-d3ad5a11f94d admin admin] PATH_INFO: `/v3/projects/3eed35a5501d493d8e7801d8d496a890/users/236ebc95205f45beb1f7f7538cf267bc/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:27.962620 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68348e69-5a12-406a-af0c-d3ad5a11f94d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eed35a5501d493d8e7801d8d496a890, user_id=236ebc95205f45beb1f7f7538cf267bc, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:54:27.965270 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68348e69-5a12-406a-af0c-d3ad5a11f94d admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:54:27.981055 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1117/2225] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:54:27 2022] PUT /identity/v3/projects/3eed35a5501d493d8e7801d8d496a890/users/236ebc95205f45beb1f7f7538cf267bc/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:54:27.991690 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a81c8-699c-4d45-9f3a-40b140c2383a None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:27.991975 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a81c8-699c-4d45-9f3a-40b140c2383a None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:27.992295 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a81c8-699c-4d45-9f3a-40b140c2383a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:28.019462 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-383a81c8-699c-4d45-9f3a-40b140c2383a None None] MFA Rules not processed for user `236ebc95205f45beb1f7f7538cf267bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:54:28.020778 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-383a81c8-699c-4d45-9f3a-40b140c2383a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:28.087452 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1109/2226] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:54:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:54:28.098896 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68348e69-5a12-406a-af0c-d3ad5a11f94d admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:54:28.100744 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-68348e69-5a12-406a-af0c-d3ad5a11f94d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:28.157063 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68348e69-5a12-406a-af0c-d3ad5a11f94d admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:54:28.160935 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c03a2-853e-448c-9e7f-adcde0989201 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:54:28.161618 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c03a2-853e-448c-9e7f-adcde0989201 service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:28.161899 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c03a2-853e-448c-9e7f-adcde0989201 service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:28.162168 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c03a2-853e-448c-9e7f-adcde0989201 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:28.170977 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c03a2-853e-448c-9e7f-adcde0989201 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:54:28.172472 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c03a2-853e-448c-9e7f-adcde0989201 service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:54:28.182728 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1118/2227] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:54:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:54:29.608142 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45283dda-2ead-4a1a-9570-3a0532f526e5 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:29.608729 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45283dda-2ead-4a1a-9570-3a0532f526e5 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:29.608729 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45283dda-2ead-4a1a-9570-3a0532f526e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:29.627836 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-45283dda-2ead-4a1a-9570-3a0532f526e5 None None] MFA Rules not processed for user `236ebc95205f45beb1f7f7538cf267bc`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:54:29.629061 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-45283dda-2ead-4a1a-9570-3a0532f526e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:29.641710 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1110/2228] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:54:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:54:37.310985 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dcb1c-f205-429c-9162-8ef8c3a7a7c3 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:37.311504 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dcb1c-f205-429c-9162-8ef8c3a7a7c3 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:37.311504 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dcb1c-f205-429c-9162-8ef8c3a7a7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:37.340168 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-6a4dcb1c-f205-429c-9162-8ef8c3a7a7c3 None None] MFA Rules not processed for user `817bcd2c5f6e4bceb049eeb122d4e432`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:54:37.341394 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-6a4dcb1c-f205-429c-9162-8ef8c3a7a7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:37.401305 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1119/2229] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Mar 8 13:54:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:54:37.413844 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45283dda-2ead-4a1a-9570-3a0532f526e5 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:54:37.416381 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-45283dda-2ead-4a1a-9570-3a0532f526e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:37.493449 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45283dda-2ead-4a1a-9570-3a0532f526e5 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:54:37.499711 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14865dbc-3b52-427c-af6d-7a14b2993268 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0f442666d0459aa9a34fc2f91228e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:54:37.500446 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14865dbc-3b52-427c-af6d-7a14b2993268 service swift] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:37.500729 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14865dbc-3b52-427c-af6d-7a14b2993268 service swift] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:37.500997 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14865dbc-3b52-427c-af6d-7a14b2993268 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:37.516486 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14865dbc-3b52-427c-af6d-7a14b2993268 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:54:37.518376 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14865dbc-3b52-427c-af6d-7a14b2993268 service swift] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:54:37.530604 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1111/2230] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Mar 8 13:54:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 13:54:57.995237 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dcb1c-f205-429c-9162-8ef8c3a7a7c3 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:54:57.996781 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-6a4dcb1c-f205-429c-9162-8ef8c3a7a7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:58.054756 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dcb1c-f205-429c-9162-8ef8c3a7a7c3 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:54:58.058756 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26795c-f0dd-4c9a-9e93-30773f64eab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:54:58.059404 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26795c-f0dd-4c9a-9e93-30773f64eab1 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:58.059841 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26795c-f0dd-4c9a-9e93-30773f64eab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:58.060272 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26795c-f0dd-4c9a-9e93-30773f64eab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:58.062234 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-fc26795c-f0dd-4c9a-9e93-30773f64eab1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:58.131581 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26795c-f0dd-4c9a-9e93-30773f64eab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:54:58.133087 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26795c-f0dd-4c9a-9e93-30773f64eab1 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:54:58.142771 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1120/2231] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:54:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:54:58.570872 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73113e96-2000-4c59-b8de-bbbea29bbfe3 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:58.571427 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73113e96-2000-4c59-b8de-bbbea29bbfe3 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:58.571524 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73113e96-2000-4c59-b8de-bbbea29bbfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:58.603186 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-73113e96-2000-4c59-b8de-bbbea29bbfe3 None None] MFA Rules not processed for user `817bcd2c5f6e4bceb049eeb122d4e432`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:54:58.604745 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-73113e96-2000-4c59-b8de-bbbea29bbfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:58.624355 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1112/2232] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Mar 8 13:54:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:54:58.639299 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26795c-f0dd-4c9a-9e93-30773f64eab1 service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:54:58.653762 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26795c-f0dd-4c9a-9e93-30773f64eab1 service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:54:58.663472 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfc398-7dd2-4668-943a-f2bc2c2d7976 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0f442666d0459aa9a34fc2f91228e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:54:58.664550 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfc398-7dd2-4668-943a-f2bc2c2d7976 service swift] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:58.665130 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfc398-7dd2-4668-943a-f2bc2c2d7976 service swift] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:58.665582 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dfc398-7dd2-4668-943a-f2bc2c2d7976 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:58.684917 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dfc398-7dd2-4668-943a-f2bc2c2d7976 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:54:58.686783 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dfc398-7dd2-4668-943a-f2bc2c2d7976 service swift] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:54:58.695525 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1121/2233] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Mar 8 13:54:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 13:54:59.396374 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4103d2-f2fe-4cfc-823c-9bc2c4e77176 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:59.396663 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4103d2-f2fe-4cfc-823c-9bc2c4e77176 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:59.396940 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4103d2-f2fe-4cfc-823c-9bc2c4e77176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:59.415152 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-df4103d2-f2fe-4cfc-823c-9bc2c4e77176 None None] MFA Rules not processed for user `817bcd2c5f6e4bceb049eeb122d4e432`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:54:59.416348 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-df4103d2-f2fe-4cfc-823c-9bc2c4e77176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:59.423467 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1113/2234] 10.222.0.18 () {58 vars in 967 bytes} [Tue Mar 8 13:54:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:54:59.436573 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfc398-7dd2-4668-943a-f2bc2c2d7976 service swift] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:54:59.448186 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dfc398-7dd2-4668-943a-f2bc2c2d7976 service swift] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:54:59.453849 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebad95b-83ab-4dea-8313-317a30e04f94 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0f442666d0459aa9a34fc2f91228e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:54:59.454504 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebad95b-83ab-4dea-8313-317a30e04f94 service swift] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:59.454784 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebad95b-83ab-4dea-8313-317a30e04f94 service swift] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:59.455055 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebad95b-83ab-4dea-8313-317a30e04f94 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:59.463960 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebad95b-83ab-4dea-8313-317a30e04f94 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:54:59.465614 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebad95b-83ab-4dea-8313-317a30e04f94 service swift] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:54:59.474324 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1122/2235] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Mar 8 13:54:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 13:54:59.552505 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59381-5c39-4ee4-a657-62cc742f17af None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:59.552751 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59381-5c39-4ee4-a657-62cc742f17af None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:59.553053 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59381-5c39-4ee4-a657-62cc742f17af None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:59.555229 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1114/2236] 10.222.0.18 () {54 vars in 921 bytes} [Tue Mar 8 13:54:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:54:59.564648 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a8d3e-5757-4230-81a3-7f10ca70a5dd None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:59.565376 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a8d3e-5757-4230-81a3-7f10ca70a5dd None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:59.565683 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4a8d3e-5757-4230-81a3-7f10ca70a5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:59.641208 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-bf4a8d3e-5757-4230-81a3-7f10ca70a5dd None None] MFA Rules not processed for user `21ec894123044d4382995791c74c587b`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:54:59.642588 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-bf4a8d3e-5757-4230-81a3-7f10ca70a5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:59.750465 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbadbf0-c993-4473-9b62-61254400dcac None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:59.751114 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbadbf0-c993-4473-9b62-61254400dcac None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:59.751114 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbadbf0-c993-4473-9b62-61254400dcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:59.773538 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-fdbadbf0-c993-4473-9b62-61254400dcac None None] MFA Rules not processed for user `817bcd2c5f6e4bceb049eeb122d4e432`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:54:59.774811 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-fdbadbf0-c993-4473-9b62-61254400dcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:59.777954 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1123/2237] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Mar 8 13:54:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:54:59.783917 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1115/2238] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Mar 8 13:54:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:54:59.790894 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a8d3e-5757-4230-81a3-7f10ca70a5dd None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:54:59.793016 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-bf4a8d3e-5757-4230-81a3-7f10ca70a5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:54:59.797560 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbadbf0-c993-4473-9b62-61254400dcac None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:54:59.809698 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbadbf0-c993-4473-9b62-61254400dcac None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:54:59.816725 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620751a-867a-42e8-8208-1ed2274666b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0f442666d0459aa9a34fc2f91228e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:54:59.818178 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620751a-867a-42e8-8208-1ed2274666b4 service swift] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:59.818645 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620751a-867a-42e8-8208-1ed2274666b4 service swift] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:59.819063 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620751a-867a-42e8-8208-1ed2274666b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:59.831767 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b620751a-867a-42e8-8208-1ed2274666b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:54:59.833865 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b620751a-867a-42e8-8208-1ed2274666b4 service swift] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:54:59.843893 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1116/2239] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Mar 8 13:54:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 13:54:59.872586 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4a8d3e-5757-4230-81a3-7f10ca70a5dd None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:54:59.877635 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e83c88-ae39-4919-9127-bf93c84e8292 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b8e066deb49e6b48804cbbe5cd6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:54:59.878258 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e83c88-ae39-4919-9127-bf93c84e8292 service glance] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:59.878625 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e83c88-ae39-4919-9127-bf93c84e8292 service glance] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:59.879141 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e83c88-ae39-4919-9127-bf93c84e8292 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:59.891510 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e83c88-ae39-4919-9127-bf93c84e8292 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:54:59.893287 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e83c88-ae39-4919-9127-bf93c84e8292 service glance] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:54:59.906674 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1124/2240] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:54:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:54:59.983819 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652ff6f-66f5-4622-a652-9543ec88cf40 None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:59.984104 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652ff6f-66f5-4622-a652-9543ec88cf40 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:59.984554 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652ff6f-66f5-4622-a652-9543ec88cf40 None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:54:59.987926 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1117/2241] 10.222.0.18 () {54 vars in 921 bytes} [Tue Mar 8 13:54:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:54:59.995081 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04643bb-a2da-48d1-a447-4aaac6e03548 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:54:59.996326 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04643bb-a2da-48d1-a447-4aaac6e03548 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:54:59.996792 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04643bb-a2da-48d1-a447-4aaac6e03548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:00.019928 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-e04643bb-a2da-48d1-a447-4aaac6e03548 None None] MFA Rules not processed for user `4c610d719b3049f98b95cc8e9bd56834`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:55:00.023911 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-e04643bb-a2da-48d1-a447-4aaac6e03548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:00.032833 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1125/2242] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Mar 8 13:54:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:55:00.046633 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652ff6f-66f5-4622-a652-9543ec88cf40 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:00.063724 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652ff6f-66f5-4622-a652-9543ec88cf40 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:00.067803 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40abe40e-3302-4d72-98f9-2d77b7d804fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:00.068566 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abe40e-3302-4d72-98f9-2d77b7d804fa service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:00.068847 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abe40e-3302-4d72-98f9-2d77b7d804fa service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:00.069114 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40abe40e-3302-4d72-98f9-2d77b7d804fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:00.080095 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40abe40e-3302-4d72-98f9-2d77b7d804fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:00.082369 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40abe40e-3302-4d72-98f9-2d77b7d804fa service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:00.093814 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1118/2243] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:55:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:55:00.198750 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea092e7-dc10-4879-87ff-9a4289cedb5e None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:00.199180 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea092e7-dc10-4879-87ff-9a4289cedb5e None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:00.199563 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea092e7-dc10-4879-87ff-9a4289cedb5e None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:00.201617 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1126/2244] 10.222.0.18 () {54 vars in 921 bytes} [Tue Mar 8 13:55:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:55:00.207627 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e253ab-77cf-4d42-aedf-76b5a378398d None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:00.207912 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e253ab-77cf-4d42-aedf-76b5a378398d None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:00.208180 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e253ab-77cf-4d42-aedf-76b5a378398d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:00.227518 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-27e253ab-77cf-4d42-aedf-76b5a378398d None None] MFA Rules not processed for user `21ec894123044d4382995791c74c587b`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:55:00.228891 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-27e253ab-77cf-4d42-aedf-76b5a378398d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:00.239963 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1119/2245] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Mar 8 13:55:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:55:00.251451 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea092e7-dc10-4879-87ff-9a4289cedb5e None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:00.263415 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea092e7-dc10-4879-87ff-9a4289cedb5e None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:00.267486 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62b2e6-75a1-48a5-9e11-ab46881e4ca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:00.267641 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030d515-9825-4687-a096-145db04c784d None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:00.267974 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030d515-9825-4687-a096-145db04c784d None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:00.268141 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62b2e6-75a1-48a5-9e11-ab46881e4ca2 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:00.268425 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62b2e6-75a1-48a5-9e11-ab46881e4ca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:00.268530 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030d515-9825-4687-a096-145db04c784d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:00.268697 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62b2e6-75a1-48a5-9e11-ab46881e4ca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:00.279633 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62b2e6-75a1-48a5-9e11-ab46881e4ca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:00.281286 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c62b2e6-75a1-48a5-9e11-ab46881e4ca2 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:00.289006 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-6030d515-9825-4687-a096-145db04c784d None None] MFA Rules not processed for user `817bcd2c5f6e4bceb049eeb122d4e432`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:55:00.290615 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-6030d515-9825-4687-a096-145db04c784d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:00.299164 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1120/2246] 10.222.0.18 () {58 vars in 967 bytes} [Tue Mar 8 13:55:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:55:00.303085 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1127/2247] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:55:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:55:00.313537 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030d515-9825-4687-a096-145db04c784d None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:00.327138 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030d515-9825-4687-a096-145db04c784d None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:00.332961 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e7bdc-a78a-4bd9-a567-e04507045f61 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0f442666d0459aa9a34fc2f91228e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:00.334683 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e7bdc-a78a-4bd9-a567-e04507045f61 service swift] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:00.335253 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e7bdc-a78a-4bd9-a567-e04507045f61 service swift] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:00.335720 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e7bdc-a78a-4bd9-a567-e04507045f61 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:00.360359 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e7bdc-a78a-4bd9-a567-e04507045f61 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:00.362251 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e7bdc-a78a-4bd9-a567-e04507045f61 service swift] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:00.396295 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1121/2248] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Mar 8 13:55:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 13:55:02.926907 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62b2e6-75a1-48a5-9e11-ab46881e4ca2 service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:03.014708 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62b2e6-75a1-48a5-9e11-ab46881e4ca2 service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:03.019776 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e8d25-5701-48a6-95b8-2ae2f6dcf115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:03.020850 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e8d25-5701-48a6-95b8-2ae2f6dcf115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:03.021280 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e8d25-5701-48a6-95b8-2ae2f6dcf115 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:03.021809 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e8d25-5701-48a6-95b8-2ae2f6dcf115 admin admin] PATH_INFO: `/v3/users/236ebc95205f45beb1f7f7538cf267bc` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:03.023786 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e8d25-5701-48a6-95b8-2ae2f6dcf115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=236ebc95205f45beb1f7f7538cf267bc)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:03.026027 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e8d25-5701-48a6-95b8-2ae2f6dcf115 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:03.125530 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-6b1e8d25-5701-48a6-95b8-2ae2f6dcf115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '236ebc95205f45beb1f7f7538cf267bc'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:03.127057 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-6b1e8d25-5701-48a6-95b8-2ae2f6dcf115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '236ebc95205f45beb1f7f7538cf267bc'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:03.139541 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-6b1e8d25-5701-48a6-95b8-2ae2f6dcf115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '236ebc95205f45beb1f7f7538cf267bc'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:03.147082 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-6b1e8d25-5701-48a6-95b8-2ae2f6dcf115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '236ebc95205f45beb1f7f7538cf267bc'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:03.162212 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-6b1e8d25-5701-48a6-95b8-2ae2f6dcf115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '236ebc95205f45beb1f7f7538cf267bc'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:03.168913 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1128/2249] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:55:02 2022] DELETE /identity/v3/users/236ebc95205f45beb1f7f7538cf267bc => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:55:03.173613 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462ed42-a6d0-4434-b524-f48fd201887b None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:03.174125 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462ed42-a6d0-4434-b524-f48fd201887b None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:03.174218 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462ed42-a6d0-4434-b524-f48fd201887b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:03.194076 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-6462ed42-a6d0-4434-b524-f48fd201887b None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:55:03.195900 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-6462ed42-a6d0-4434-b524-f48fd201887b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:03.262216 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1122/2250] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:55:03.271955 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e8d25-5701-48a6-95b8-2ae2f6dcf115 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:03.273668 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-6b1e8d25-5701-48a6-95b8-2ae2f6dcf115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:03.328676 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e8d25-5701-48a6-95b8-2ae2f6dcf115 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:03.332330 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da716fbc-ffc4-4408-96c6-c37b3f4106cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:03.332981 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da716fbc-ffc4-4408-96c6-c37b3f4106cc service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:03.333262 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da716fbc-ffc4-4408-96c6-c37b3f4106cc service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:03.333571 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da716fbc-ffc4-4408-96c6-c37b3f4106cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:03.342768 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da716fbc-ffc4-4408-96c6-c37b3f4106cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:03.344204 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da716fbc-ffc4-4408-96c6-c37b3f4106cc service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:03.353984 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1129/2251] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:55:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:55:03.527098 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462ed42-a6d0-4434-b524-f48fd201887b None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:03.529140 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-6462ed42-a6d0-4434-b524-f48fd201887b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:03.542114 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462ed42-a6d0-4434-b524-f48fd201887b None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:03.560612 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ec410-82a3-435f-a367-b5cdf817591e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:03.562281 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ec410-82a3-435f-a367-b5cdf817591e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:03.564868 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ec410-82a3-435f-a367-b5cdf817591e admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:03.565155 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ec410-82a3-435f-a367-b5cdf817591e admin admin] PATH_INFO: `/v3/projects/3eed35a5501d493d8e7801d8d496a890` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:03.566596 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ec410-82a3-435f-a367-b5cdf817591e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eed35a5501d493d8e7801d8d496a890)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:03.568540 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ec410-82a3-435f-a367-b5cdf817591e admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:03.623170 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-eb5ec410-82a3-435f-a367-b5cdf817591e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eed35a5501d493d8e7801d8d496a890', 'request_id': 'req-eb5ec410-82a3-435f-a367-b5cdf817591e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:03.631163 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-eb5ec410-82a3-435f-a367-b5cdf817591e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eed35a5501d493d8e7801d8d496a890', 'request_id': 'req-eb5ec410-82a3-435f-a367-b5cdf817591e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:03.640188 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-eb5ec410-82a3-435f-a367-b5cdf817591e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eed35a5501d493d8e7801d8d496a890', 'request_id': 'req-eb5ec410-82a3-435f-a367-b5cdf817591e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:03.653835 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-eb5ec410-82a3-435f-a367-b5cdf817591e admin admin] The token cache is being invalidate because project 3eed35a5501d493d8e7801d8d496a890 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:55:03.654207 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-eb5ec410-82a3-435f-a367-b5cdf817591e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:03.655039 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-eb5ec410-82a3-435f-a367-b5cdf817591e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:03.656667 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1123/2252] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:55:03 2022] DELETE /identity/v3/projects/3eed35a5501d493d8e7801d8d496a890 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:55:05.042920 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da716fbc-ffc4-4408-96c6-c37b3f4106cc service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:05.044327 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-da716fbc-ffc4-4408-96c6-c37b3f4106cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:05.138009 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da716fbc-ffc4-4408-96c6-c37b3f4106cc service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:05.198193 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d99f52-8bbb-48f0-9481-8780fdd216a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2e8458589b45fa8c91b0d95840e45e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:05.198760 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d99f52-8bbb-48f0-9481-8780fdd216a1 service placement] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:05.199033 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d99f52-8bbb-48f0-9481-8780fdd216a1 service placement] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:05.199304 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d99f52-8bbb-48f0-9481-8780fdd216a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:05.201179 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-f9d99f52-8bbb-48f0-9481-8780fdd216a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:05.212947 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d99f52-8bbb-48f0-9481-8780fdd216a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:05.214556 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d99f52-8bbb-48f0-9481-8780fdd216a1 service placement] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:05.224291 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1130/2253] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:55:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:55:05.811888 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2328247-c902-4a08-a983-60fb6f3ce6a6 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:05.812477 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2328247-c902-4a08-a983-60fb6f3ce6a6 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:05.812477 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2328247-c902-4a08-a983-60fb6f3ce6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:05.830585 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-f2328247-c902-4a08-a983-60fb6f3ce6a6 None None] MFA Rules not processed for user `4f705be9921a4daabe961e170fe7efd2`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:55:05.831786 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f2328247-c902-4a08-a983-60fb6f3ce6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:05.885291 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1124/2254] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:55:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:55:06.899416 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d907ae-2073-41fe-a847-fffda2b066d1 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:06.900018 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d907ae-2073-41fe-a847-fffda2b066d1 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:06.900018 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d907ae-2073-41fe-a847-fffda2b066d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:06.918326 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-57d907ae-2073-41fe-a847-fffda2b066d1 None None] MFA Rules not processed for user `817bcd2c5f6e4bceb049eeb122d4e432`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:55:06.919536 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-57d907ae-2073-41fe-a847-fffda2b066d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:06.978557 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1131/2255] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Mar 8 13:55:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:55:07.002375 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2328247-c902-4a08-a983-60fb6f3ce6a6 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:07.004068 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f2328247-c902-4a08-a983-60fb6f3ce6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:07.080034 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2328247-c902-4a08-a983-60fb6f3ce6a6 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:07.085563 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe7315-afe5-4d51-8026-066f88d6ee40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0f442666d0459aa9a34fc2f91228e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:07.086213 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe7315-afe5-4d51-8026-066f88d6ee40 service swift] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:07.086492 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe7315-afe5-4d51-8026-066f88d6ee40 service swift] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:07.086794 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe7315-afe5-4d51-8026-066f88d6ee40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:07.095640 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe7315-afe5-4d51-8026-066f88d6ee40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:07.097390 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe7315-afe5-4d51-8026-066f88d6ee40 service swift] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:07.106821 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1125/2256] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Mar 8 13:55:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 13:55:28.924254 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab09a73-d6ac-41fd-a6b6-49cd2036fc22 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:28.924863 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab09a73-d6ac-41fd-a6b6-49cd2036fc22 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:28.924863 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab09a73-d6ac-41fd-a6b6-49cd2036fc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:28.942973 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-9ab09a73-d6ac-41fd-a6b6-49cd2036fc22 None None] MFA Rules not processed for user `10bcf5583fad4a2ba06d7fa6c3dd517d`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:55:28.944496 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-9ab09a73-d6ac-41fd-a6b6-49cd2036fc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:29.029979 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1132/2257] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:55:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:55:32.993027 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607ebe7-0162-4efd-b42f-34ed9e5c5d3e None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:32.994011 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607ebe7-0162-4efd-b42f-34ed9e5c5d3e None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:32.994465 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607ebe7-0162-4efd-b42f-34ed9e5c5d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:33.049408 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-2607ebe7-0162-4efd-b42f-34ed9e5c5d3e None None] MFA Rules not processed for user `817bcd2c5f6e4bceb049eeb122d4e432`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:55:33.050641 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-2607ebe7-0162-4efd-b42f-34ed9e5c5d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:33.076723 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1126/2258] 10.222.0.18 () {58 vars in 967 bytes} [Tue Mar 8 13:55:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:55:33.084755 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab09a73-d6ac-41fd-a6b6-49cd2036fc22 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:33.114042 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab09a73-d6ac-41fd-a6b6-49cd2036fc22 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:33.119989 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36e6e7-accb-4662-9038-17e88ebe0020 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0f442666d0459aa9a34fc2f91228e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:33.120645 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36e6e7-accb-4662-9038-17e88ebe0020 service swift] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:33.121087 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36e6e7-accb-4662-9038-17e88ebe0020 service swift] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:33.121386 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd36e6e7-accb-4662-9038-17e88ebe0020 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:33.131931 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36e6e7-accb-4662-9038-17e88ebe0020 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:33.133798 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd36e6e7-accb-4662-9038-17e88ebe0020 service swift] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:33.143887 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1133/2259] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Mar 8 13:55:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 08 13:55:38.986102 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607ebe7-0162-4efd-b42f-34ed9e5c5d3e None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:38.988380 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-2607ebe7-0162-4efd-b42f-34ed9e5c5d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:39.055467 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607ebe7-0162-4efd-b42f-34ed9e5c5d3e None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:39.060205 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fcc384-1673-4e02-a40d-1fe750731a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:39.061396 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcc384-1673-4e02-a40d-1fe750731a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:39.062513 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcc384-1673-4e02-a40d-1fe750731a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:39.062785 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fcc384-1673-4e02-a40d-1fe750731a1a admin admin] PATH_INFO: `/v3/users/8d63599c0ea547408d2d9d1d886431db` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:39.064070 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fcc384-1673-4e02-a40d-1fe750731a1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d63599c0ea547408d2d9d1d886431db)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:39.065997 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fcc384-1673-4e02-a40d-1fe750731a1a admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:39.123602 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-57fcc384-1673-4e02-a40d-1fe750731a1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d63599c0ea547408d2d9d1d886431db'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:39.124470 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-57fcc384-1673-4e02-a40d-1fe750731a1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d63599c0ea547408d2d9d1d886431db'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:39.136056 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-57fcc384-1673-4e02-a40d-1fe750731a1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d63599c0ea547408d2d9d1d886431db'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:39.151324 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-57fcc384-1673-4e02-a40d-1fe750731a1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d63599c0ea547408d2d9d1d886431db'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:39.159243 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-57fcc384-1673-4e02-a40d-1fe750731a1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d63599c0ea547408d2d9d1d886431db'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:39.167009 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1127/2260] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:55:38 2022] DELETE /identity/v3/users/8d63599c0ea547408d2d9d1d886431db => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:55:39.386888 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36e6e7-accb-4662-9038-17e88ebe0020 service swift] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:39.405214 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd36e6e7-accb-4662-9038-17e88ebe0020 service swift] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:39.476365 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae269a05-cde2-43c0-ae62-67eaa2848105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:39.477731 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae269a05-cde2-43c0-ae62-67eaa2848105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:39.478364 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae269a05-cde2-43c0-ae62-67eaa2848105 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:39.478789 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae269a05-cde2-43c0-ae62-67eaa2848105 admin admin] PATH_INFO: `/v3/projects/3a28c3e8d2dc4d46905bd41157532fd9` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:39.480064 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae269a05-cde2-43c0-ae62-67eaa2848105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a28c3e8d2dc4d46905bd41157532fd9)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:39.482468 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae269a05-cde2-43c0-ae62-67eaa2848105 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:39.529432 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ae269a05-cde2-43c0-ae62-67eaa2848105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a28c3e8d2dc4d46905bd41157532fd9', 'request_id': 'req-ae269a05-cde2-43c0-ae62-67eaa2848105'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:39.535298 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ae269a05-cde2-43c0-ae62-67eaa2848105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a28c3e8d2dc4d46905bd41157532fd9', 'request_id': 'req-ae269a05-cde2-43c0-ae62-67eaa2848105'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:39.543908 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ae269a05-cde2-43c0-ae62-67eaa2848105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a28c3e8d2dc4d46905bd41157532fd9', 'request_id': 'req-ae269a05-cde2-43c0-ae62-67eaa2848105'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:39.553772 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ae269a05-cde2-43c0-ae62-67eaa2848105 admin admin] The token cache is being invalidate because project 3a28c3e8d2dc4d46905bd41157532fd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:55:39.554053 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ae269a05-cde2-43c0-ae62-67eaa2848105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:39.554709 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ae269a05-cde2-43c0-ae62-67eaa2848105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:39.556298 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1134/2261] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:55:39 2022] DELETE /identity/v3/projects/3a28c3e8d2dc4d46905bd41157532fd9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:55:39.561627 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f3f2c-6486-46f5-842e-b77f1229d364 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:39.561912 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f3f2c-6486-46f5-842e-b77f1229d364 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:39.562180 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f3f2c-6486-46f5-842e-b77f1229d364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:39.590240 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-da6f3f2c-6486-46f5-842e-b77f1229d364 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:55:39.591473 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-da6f3f2c-6486-46f5-842e-b77f1229d364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:39.648668 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1128/2262] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:55:39.657140 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114199f-08a1-4809-8ecc-6fd574d6f5b8 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:39.657463 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114199f-08a1-4809-8ecc-6fd574d6f5b8 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:39.657737 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114199f-08a1-4809-8ecc-6fd574d6f5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:39.677568 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-a114199f-08a1-4809-8ecc-6fd574d6f5b8 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:55:39.678723 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-a114199f-08a1-4809-8ecc-6fd574d6f5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:39.687777 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1135/2263] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:55:39.692299 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f3f2c-6486-46f5-842e-b77f1229d364 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:39.702399 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f3f2c-6486-46f5-842e-b77f1229d364 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:39.708901 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fcf051-1a4f-4f4f-af14-bfd48cf1496e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:39.709588 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcf051-1a4f-4f4f-af14-bfd48cf1496e admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:39.709867 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcf051-1a4f-4f4f-af14-bfd48cf1496e admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:39.710136 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fcf051-1a4f-4f4f-af14-bfd48cf1496e admin admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:39.711128 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fcf051-1a4f-4f4f-af14-bfd48cf1496e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:55:39.711436 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fcf051-1a4f-4f4f-af14-bfd48cf1496e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:39.713018 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fcf051-1a4f-4f4f-af14-bfd48cf1496e admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:39.725300 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1129/2264] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:55:39.731345 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114199f-08a1-4809-8ecc-6fd574d6f5b8 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:39.741137 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114199f-08a1-4809-8ecc-6fd574d6f5b8 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:39.745893 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5d60d-322a-48e2-a2b5-0a828bc44341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:39.746565 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5d60d-322a-48e2-a2b5-0a828bc44341 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:39.746822 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5d60d-322a-48e2-a2b5-0a828bc44341 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:39.747261 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5d60d-322a-48e2-a2b5-0a828bc44341 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:39.747998 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5d60d-322a-48e2-a2b5-0a828bc44341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:39.749940 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5d60d-322a-48e2-a2b5-0a828bc44341 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:39.776525 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1136/2265] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:55:39 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:55:39.781065 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fcf051-1a4f-4f4f-af14-bfd48cf1496e admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:39.791293 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fcf051-1a4f-4f4f-af14-bfd48cf1496e admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:39.846029 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a243cc-be22-4ab5-abd4-47c9a23d4598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:39.846696 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a243cc-be22-4ab5-abd4-47c9a23d4598 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:39.846973 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a243cc-be22-4ab5-abd4-47c9a23d4598 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:39.847242 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a243cc-be22-4ab5-abd4-47c9a23d4598 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:39.847920 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a243cc-be22-4ab5-abd4-47c9a23d4598 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:39.849849 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a243cc-be22-4ab5-abd4-47c9a23d4598 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:39.874283 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1130/2266] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:55:39 2022] POST /identity/v3/users => generated 303 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:55:39.878096 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5d60d-322a-48e2-a2b5-0a828bc44341 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:39.888688 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5d60d-322a-48e2-a2b5-0a828bc44341 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:39.893695 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b8eeb-e516-4e53-a316-bbb047a5c463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:39.894347 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b8eeb-e516-4e53-a316-bbb047a5c463 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:39.894622 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b8eeb-e516-4e53-a316-bbb047a5c463 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:39.894894 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83b8eeb-e516-4e53-a316-bbb047a5c463 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:39.895615 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b8eeb-e516-4e53-a316-bbb047a5c463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:39.897231 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83b8eeb-e516-4e53-a316-bbb047a5c463 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:39.907757 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1137/2267] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:55:39.911861 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a243cc-be22-4ab5-abd4-47c9a23d4598 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:39.921947 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a243cc-be22-4ab5-abd4-47c9a23d4598 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:39.927570 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d35ec-5a6a-4b1c-b6c3-c8ffe2a48f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:39.928221 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d35ec-5a6a-4b1c-b6c3-c8ffe2a48f46 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:39.928529 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d35ec-5a6a-4b1c-b6c3-c8ffe2a48f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:39.928798 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d35ec-5a6a-4b1c-b6c3-c8ffe2a48f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:39.929556 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d35ec-5a6a-4b1c-b6c3-c8ffe2a48f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:39.931140 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d35ec-5a6a-4b1c-b6c3-c8ffe2a48f46 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:39.941079 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1131/2268] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:55:39.945192 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b8eeb-e516-4e53-a316-bbb047a5c463 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:39.955722 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83b8eeb-e516-4e53-a316-bbb047a5c463 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:39.962857 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8352c-589b-42ac-9949-008cb796d1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:39.964144 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8352c-589b-42ac-9949-008cb796d1f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:39.964470 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8352c-589b-42ac-9949-008cb796d1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:39.964802 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8352c-589b-42ac-9949-008cb796d1f3 admin admin] PATH_INFO: `/v3/projects/5c94b6f73120403a90fd4f221d17f2e7/users/05cbaf28f2a743cfae171609bd895ccd/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:39.981422 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8352c-589b-42ac-9949-008cb796d1f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c94b6f73120403a90fd4f221d17f2e7, user_id=05cbaf28f2a743cfae171609bd895ccd, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:39.984149 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8352c-589b-42ac-9949-008cb796d1f3 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:40.000618 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1138/2269] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:55:39 2022] PUT /identity/v3/projects/5c94b6f73120403a90fd4f221d17f2e7/users/05cbaf28f2a743cfae171609bd895ccd/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:55:40.005934 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9db6c5-94fe-44b4-9dfa-7b30c167388e None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:40.006393 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9db6c5-94fe-44b4-9dfa-7b30c167388e None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:40.006532 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9db6c5-94fe-44b4-9dfa-7b30c167388e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:40.026316 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-6b9db6c5-94fe-44b4-9dfa-7b30c167388e None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:55:40.027540 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-6b9db6c5-94fe-44b4-9dfa-7b30c167388e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:40.087835 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1132/2270] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:55:40.097782 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8352c-589b-42ac-9949-008cb796d1f3 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:40.099828 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-fdc8352c-589b-42ac-9949-008cb796d1f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:40.163701 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8352c-589b-42ac-9949-008cb796d1f3 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:40.169728 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166c1d4-bfe3-4527-a2f0-2105e756973a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:40.170374 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166c1d4-bfe3-4527-a2f0-2105e756973a service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:40.170651 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166c1d4-bfe3-4527-a2f0-2105e756973a service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:40.170917 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166c1d4-bfe3-4527-a2f0-2105e756973a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:40.180819 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166c1d4-bfe3-4527-a2f0-2105e756973a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:40.182292 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166c1d4-bfe3-4527-a2f0-2105e756973a service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:40.192035 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1139/2271] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:55:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:55:40.873001 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e804b-0cc2-4449-a6a1-5e6d1ece5a72 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:40.873602 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e804b-0cc2-4449-a6a1-5e6d1ece5a72 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:40.873878 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e804b-0cc2-4449-a6a1-5e6d1ece5a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:40.901869 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-432e804b-0cc2-4449-a6a1-5e6d1ece5a72 None None] MFA Rules not processed for user `05cbaf28f2a743cfae171609bd895ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:55:40.902977 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-432e804b-0cc2-4449-a6a1-5e6d1ece5a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:40.967569 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1133/2272] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:55:40 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:55:40.972186 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166c1d4-bfe3-4527-a2f0-2105e756973a service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:40.982530 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166c1d4-bfe3-4527-a2f0-2105e756973a service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:40.987301 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d27bf-b63b-4e52-ad29-6d61f17d1330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:40.988031 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d27bf-b63b-4e52-ad29-6d61f17d1330 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:40.988377 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d27bf-b63b-4e52-ad29-6d61f17d1330 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:40.988716 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d27bf-b63b-4e52-ad29-6d61f17d1330 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:40.989554 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d27bf-b63b-4e52-ad29-6d61f17d1330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:40.991603 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5d27bf-b63b-4e52-ad29-6d61f17d1330 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:41.022363 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1140/2273] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:55:40 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:55:41.023516 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e804b-0cc2-4449-a6a1-5e6d1ece5a72 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:41.035196 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e804b-0cc2-4449-a6a1-5e6d1ece5a72 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:41.092965 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed7f07-07fe-4c98-adc5-51ac90984fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:41.093694 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed7f07-07fe-4c98-adc5-51ac90984fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:41.093970 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed7f07-07fe-4c98-adc5-51ac90984fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:41.094239 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed7f07-07fe-4c98-adc5-51ac90984fe5 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:41.094928 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed7f07-07fe-4c98-adc5-51ac90984fe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:41.096849 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed7f07-07fe-4c98-adc5-51ac90984fe5 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:41.120110 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1134/2274] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:55:41 2022] POST /identity/v3/users => generated 309 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:55:41.121319 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d27bf-b63b-4e52-ad29-6d61f17d1330 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:41.131650 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d27bf-b63b-4e52-ad29-6d61f17d1330 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:41.136444 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7d00d-0ff6-4ceb-ae92-4c3e6b7ac399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:41.137113 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7d00d-0ff6-4ceb-ae92-4c3e6b7ac399 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:41.137465 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7d00d-0ff6-4ceb-ae92-4c3e6b7ac399 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:41.137743 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7d00d-0ff6-4ceb-ae92-4c3e6b7ac399 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:41.138507 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7d00d-0ff6-4ceb-ae92-4c3e6b7ac399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:41.140147 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7d00d-0ff6-4ceb-ae92-4c3e6b7ac399 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:41.155580 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1141/2275] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:55:41.156672 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed7f07-07fe-4c98-adc5-51ac90984fe5 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:41.167648 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed7f07-07fe-4c98-adc5-51ac90984fe5 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:41.173518 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b49e1f-e7b0-49aa-867f-4eb8322ce37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:41.174665 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b49e1f-e7b0-49aa-867f-4eb8322ce37a admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:41.174916 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b49e1f-e7b0-49aa-867f-4eb8322ce37a admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:41.175231 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b49e1f-e7b0-49aa-867f-4eb8322ce37a admin admin] PATH_INFO: `/v3/projects/0b99f9df16d84e46b5cd56e6ce27a56c/users/4cbb717c72fb4a0c8dba29d49e824be5/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:41.190927 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b49e1f-e7b0-49aa-867f-4eb8322ce37a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b99f9df16d84e46b5cd56e6ce27a56c, user_id=4cbb717c72fb4a0c8dba29d49e824be5, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:41.193834 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b49e1f-e7b0-49aa-867f-4eb8322ce37a admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:41.208455 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1135/2276] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:55:41 2022] PUT /identity/v3/projects/0b99f9df16d84e46b5cd56e6ce27a56c/users/4cbb717c72fb4a0c8dba29d49e824be5/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:55:41.212415 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7d00d-0ff6-4ceb-ae92-4c3e6b7ac399 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:41.222464 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7d00d-0ff6-4ceb-ae92-4c3e6b7ac399 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:41.282080 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9dc2c5-622e-4f9b-9d68-390c455859a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:41.282825 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dc2c5-622e-4f9b-9d68-390c455859a4 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:41.283123 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dc2c5-622e-4f9b-9d68-390c455859a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:41.283391 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dc2c5-622e-4f9b-9d68-390c455859a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:41.284128 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9dc2c5-622e-4f9b-9d68-390c455859a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:41.285773 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9dc2c5-622e-4f9b-9d68-390c455859a4 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:41.300156 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1142/2277] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:55:41.301692 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b49e1f-e7b0-49aa-867f-4eb8322ce37a admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:41.313075 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b49e1f-e7b0-49aa-867f-4eb8322ce37a admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:41.317952 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ca206-2e63-4c91-8cdc-4fb2fba4cd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:41.318936 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ca206-2e63-4c91-8cdc-4fb2fba4cd23 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:41.319211 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ca206-2e63-4c91-8cdc-4fb2fba4cd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:41.319559 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ca206-2e63-4c91-8cdc-4fb2fba4cd23 admin admin] PATH_INFO: `/v3/projects/0b99f9df16d84e46b5cd56e6ce27a56c/users/4cbb717c72fb4a0c8dba29d49e824be5/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:41.321611 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ca206-2e63-4c91-8cdc-4fb2fba4cd23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b99f9df16d84e46b5cd56e6ce27a56c, user_id=4cbb717c72fb4a0c8dba29d49e824be5, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:41.324969 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ca206-2e63-4c91-8cdc-4fb2fba4cd23 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:41.336522 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1136/2278] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:55:41 2022] PUT /identity/v3/projects/0b99f9df16d84e46b5cd56e6ce27a56c/users/4cbb717c72fb4a0c8dba29d49e824be5/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:55:42.288322 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9c2c5-ccaf-43fe-bd4a-4ba47254d580 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:42.288855 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9c2c5-ccaf-43fe-bd4a-4ba47254d580 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:42.288855 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9c2c5-ccaf-43fe-bd4a-4ba47254d580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:42.317024 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-a8b9c2c5-ccaf-43fe-bd4a-4ba47254d580 None None] MFA Rules not processed for user `4cbb717c72fb4a0c8dba29d49e824be5`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:55:42.318571 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-a8b9c2c5-ccaf-43fe-bd4a-4ba47254d580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:42.407727 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1143/2279] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:55:42 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:55:43.747206 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ca206-2e63-4c91-8cdc-4fb2fba4cd23 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:43.810125 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ca206-2e63-4c91-8cdc-4fb2fba4cd23 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:43.815338 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586c259-68b6-43ba-8f24-8f25afbb6396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:43.816295 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586c259-68b6-43ba-8f24-8f25afbb6396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:43.816576 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586c259-68b6-43ba-8f24-8f25afbb6396 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:43.816956 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586c259-68b6-43ba-8f24-8f25afbb6396 admin admin] PATH_INFO: `/v3/users/05cbaf28f2a743cfae171609bd895ccd` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:43.818375 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d586c259-68b6-43ba-8f24-8f25afbb6396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05cbaf28f2a743cfae171609bd895ccd)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:43.820575 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d586c259-68b6-43ba-8f24-8f25afbb6396 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:43.869505 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-d586c259-68b6-43ba-8f24-8f25afbb6396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05cbaf28f2a743cfae171609bd895ccd'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:43.870174 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-d586c259-68b6-43ba-8f24-8f25afbb6396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05cbaf28f2a743cfae171609bd895ccd'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:43.878867 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-d586c259-68b6-43ba-8f24-8f25afbb6396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05cbaf28f2a743cfae171609bd895ccd'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:43.891471 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-d586c259-68b6-43ba-8f24-8f25afbb6396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05cbaf28f2a743cfae171609bd895ccd'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:43.898717 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-d586c259-68b6-43ba-8f24-8f25afbb6396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05cbaf28f2a743cfae171609bd895ccd'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:43.904769 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1137/2280] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:55:43 2022] DELETE /identity/v3/users/05cbaf28f2a743cfae171609bd895ccd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:55:44.082310 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9c2c5-ccaf-43fe-bd4a-4ba47254d580 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:44.094512 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9c2c5-ccaf-43fe-bd4a-4ba47254d580 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:44.151328 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cf9db-547e-452f-98ee-4d911537c2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:44.152528 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cf9db-547e-452f-98ee-4d911537c2d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:44.152801 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cf9db-547e-452f-98ee-4d911537c2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:44.153068 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cf9db-547e-452f-98ee-4d911537c2d1 admin admin] PATH_INFO: `/v3/projects/5c94b6f73120403a90fd4f221d17f2e7` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:44.154459 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863cf9db-547e-452f-98ee-4d911537c2d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c94b6f73120403a90fd4f221d17f2e7)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:44.156375 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863cf9db-547e-452f-98ee-4d911537c2d1 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:44.202495 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-863cf9db-547e-452f-98ee-4d911537c2d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c94b6f73120403a90fd4f221d17f2e7', 'request_id': 'req-863cf9db-547e-452f-98ee-4d911537c2d1'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:44.209133 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-863cf9db-547e-452f-98ee-4d911537c2d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c94b6f73120403a90fd4f221d17f2e7', 'request_id': 'req-863cf9db-547e-452f-98ee-4d911537c2d1'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:44.220932 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-863cf9db-547e-452f-98ee-4d911537c2d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c94b6f73120403a90fd4f221d17f2e7', 'request_id': 'req-863cf9db-547e-452f-98ee-4d911537c2d1'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:44.231064 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-863cf9db-547e-452f-98ee-4d911537c2d1 admin admin] The token cache is being invalidate because project 5c94b6f73120403a90fd4f221d17f2e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:55:44.231344 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-863cf9db-547e-452f-98ee-4d911537c2d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:44.231986 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-863cf9db-547e-452f-98ee-4d911537c2d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:44.233570 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1144/2281] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:55:44 2022] DELETE /identity/v3/projects/5c94b6f73120403a90fd4f221d17f2e7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:55:44.237561 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586c259-68b6-43ba-8f24-8f25afbb6396 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:44.238995 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-d586c259-68b6-43ba-8f24-8f25afbb6396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:44.251885 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586c259-68b6-43ba-8f24-8f25afbb6396 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:44.320643 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a1b199-6fbb-4277-ad72-e37d4dbaad30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:44.321543 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1b199-6fbb-4277-ad72-e37d4dbaad30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:44.321826 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1b199-6fbb-4277-ad72-e37d4dbaad30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:44.322086 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a1b199-6fbb-4277-ad72-e37d4dbaad30 admin admin] PATH_INFO: `/v3/users/4cbb717c72fb4a0c8dba29d49e824be5` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:44.323407 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1b199-6fbb-4277-ad72-e37d4dbaad30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cbb717c72fb4a0c8dba29d49e824be5)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:44.325365 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a1b199-6fbb-4277-ad72-e37d4dbaad30 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:44.372940 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-61a1b199-6fbb-4277-ad72-e37d4dbaad30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cbb717c72fb4a0c8dba29d49e824be5'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:44.373634 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-61a1b199-6fbb-4277-ad72-e37d4dbaad30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cbb717c72fb4a0c8dba29d49e824be5'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:44.382881 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-61a1b199-6fbb-4277-ad72-e37d4dbaad30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cbb717c72fb4a0c8dba29d49e824be5'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:44.395089 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-61a1b199-6fbb-4277-ad72-e37d4dbaad30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cbb717c72fb4a0c8dba29d49e824be5'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:44.402159 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-61a1b199-6fbb-4277-ad72-e37d4dbaad30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cbb717c72fb4a0c8dba29d49e824be5'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:44.408908 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1138/2282] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:55:44 2022] DELETE /identity/v3/users/4cbb717c72fb4a0c8dba29d49e824be5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:55:44.629044 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cf9db-547e-452f-98ee-4d911537c2d1 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:44.630536 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-863cf9db-547e-452f-98ee-4d911537c2d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:44.644097 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cf9db-547e-452f-98ee-4d911537c2d1 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:44.703516 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23dda8-6754-48ce-9fad-878fed397596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:44.704708 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23dda8-6754-48ce-9fad-878fed397596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:44.704983 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23dda8-6754-48ce-9fad-878fed397596 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:44.705247 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23dda8-6754-48ce-9fad-878fed397596 admin admin] PATH_INFO: `/v3/projects/0b99f9df16d84e46b5cd56e6ce27a56c` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:44.706444 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23dda8-6754-48ce-9fad-878fed397596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b99f9df16d84e46b5cd56e6ce27a56c)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:44.708301 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23dda8-6754-48ce-9fad-878fed397596 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:44.759043 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-aa23dda8-6754-48ce-9fad-878fed397596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b99f9df16d84e46b5cd56e6ce27a56c', 'request_id': 'req-aa23dda8-6754-48ce-9fad-878fed397596'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:44.765609 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-aa23dda8-6754-48ce-9fad-878fed397596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b99f9df16d84e46b5cd56e6ce27a56c', 'request_id': 'req-aa23dda8-6754-48ce-9fad-878fed397596'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:44.775315 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-aa23dda8-6754-48ce-9fad-878fed397596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b99f9df16d84e46b5cd56e6ce27a56c', 'request_id': 'req-aa23dda8-6754-48ce-9fad-878fed397596'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:44.785155 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-aa23dda8-6754-48ce-9fad-878fed397596 admin admin] The token cache is being invalidate because project 0b99f9df16d84e46b5cd56e6ce27a56c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:55:44.785468 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-aa23dda8-6754-48ce-9fad-878fed397596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:44.786068 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-aa23dda8-6754-48ce-9fad-878fed397596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:44.787589 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1145/2283] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:55:44 2022] DELETE /identity/v3/projects/0b99f9df16d84e46b5cd56e6ce27a56c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:55:44.792665 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4115d5b-d729-48ad-aa72-9a220487597a None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:44.793153 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4115d5b-d729-48ad-aa72-9a220487597a None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:44.793271 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4115d5b-d729-48ad-aa72-9a220487597a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:44.812456 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-f4115d5b-d729-48ad-aa72-9a220487597a None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:55:44.813705 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f4115d5b-d729-48ad-aa72-9a220487597a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:44.876689 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1139/2284] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:55:44.885908 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03400630-93e2-41c8-8db9-4cd5380f3999 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:44.886190 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03400630-93e2-41c8-8db9-4cd5380f3999 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:44.886460 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03400630-93e2-41c8-8db9-4cd5380f3999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:44.906218 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-03400630-93e2-41c8-8db9-4cd5380f3999 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:55:44.907402 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-03400630-93e2-41c8-8db9-4cd5380f3999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:44.916916 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1146/2285] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:55:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:55:44.922136 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4115d5b-d729-48ad-aa72-9a220487597a None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:44.936502 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4115d5b-d729-48ad-aa72-9a220487597a None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:44.943012 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee331b1-b52b-488b-926d-49601726d876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:44.943663 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee331b1-b52b-488b-926d-49601726d876 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:44.943936 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee331b1-b52b-488b-926d-49601726d876 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:44.944197 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee331b1-b52b-488b-926d-49601726d876 admin admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:44.944923 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee331b1-b52b-488b-926d-49601726d876 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:55:44.945220 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee331b1-b52b-488b-926d-49601726d876 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:44.946824 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee331b1-b52b-488b-926d-49601726d876 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:44.960069 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1140/2286] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:55:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:55:44.964677 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03400630-93e2-41c8-8db9-4cd5380f3999 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:44.974112 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03400630-93e2-41c8-8db9-4cd5380f3999 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:44.979996 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc4954-29c1-4f2b-80ba-3f6fcf9eb23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:44.980755 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc4954-29c1-4f2b-80ba-3f6fcf9eb23d admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:44.981034 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc4954-29c1-4f2b-80ba-3f6fcf9eb23d admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:44.981295 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc4954-29c1-4f2b-80ba-3f6fcf9eb23d admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:44.982030 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc4954-29c1-4f2b-80ba-3f6fcf9eb23d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:44.983920 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc4954-29c1-4f2b-80ba-3f6fcf9eb23d admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:45.014701 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1147/2287] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:55:44 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:55:45.020898 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee331b1-b52b-488b-926d-49601726d876 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:45.034083 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee331b1-b52b-488b-926d-49601726d876 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:45.091951 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc7269-26d7-4f50-ac43-44680993ab95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:45.092595 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc7269-26d7-4f50-ac43-44680993ab95 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:45.092876 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc7269-26d7-4f50-ac43-44680993ab95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:45.093140 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc7269-26d7-4f50-ac43-44680993ab95 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:45.093876 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc7269-26d7-4f50-ac43-44680993ab95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:45.095780 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc7269-26d7-4f50-ac43-44680993ab95 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:45.119388 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1141/2288] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:55:45 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:55:45.123767 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc4954-29c1-4f2b-80ba-3f6fcf9eb23d admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:45.134423 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc4954-29c1-4f2b-80ba-3f6fcf9eb23d admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:45.139852 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463321e-bfaa-4ed7-ad99-e59949acf3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:45.140541 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463321e-bfaa-4ed7-ad99-e59949acf3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:45.140822 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463321e-bfaa-4ed7-ad99-e59949acf3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:45.141094 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463321e-bfaa-4ed7-ad99-e59949acf3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:45.141870 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463321e-bfaa-4ed7-ad99-e59949acf3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:45.143475 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c463321e-bfaa-4ed7-ad99-e59949acf3c0 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:45.154033 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1148/2289] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:55:45.157987 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc7269-26d7-4f50-ac43-44680993ab95 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:45.168949 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc7269-26d7-4f50-ac43-44680993ab95 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:45.174947 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39dc46-e7ea-4cb3-8f82-70884f266a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:45.175596 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39dc46-e7ea-4cb3-8f82-70884f266a4c admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:45.175844 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39dc46-e7ea-4cb3-8f82-70884f266a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:45.176143 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39dc46-e7ea-4cb3-8f82-70884f266a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:45.176864 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39dc46-e7ea-4cb3-8f82-70884f266a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:45.178491 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39dc46-e7ea-4cb3-8f82-70884f266a4c admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:45.189064 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1142/2290] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:55:45.193448 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463321e-bfaa-4ed7-ad99-e59949acf3c0 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:45.205204 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463321e-bfaa-4ed7-ad99-e59949acf3c0 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:45.211396 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a736f-9dab-427c-b561-9b222e6b3bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:45.212299 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a736f-9dab-427c-b561-9b222e6b3bdb admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:45.212577 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a736f-9dab-427c-b561-9b222e6b3bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:45.212841 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a736f-9dab-427c-b561-9b222e6b3bdb admin admin] PATH_INFO: `/v3/projects/1cf64a6edc154ad6a9b1f2d2ca158490/users/17b3ac1c4a1f4a5ca3825873e4829eaa/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:45.229239 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a736f-9dab-427c-b561-9b222e6b3bdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cf64a6edc154ad6a9b1f2d2ca158490, user_id=17b3ac1c4a1f4a5ca3825873e4829eaa, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:45.231962 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a736f-9dab-427c-b561-9b222e6b3bdb admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:45.247160 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1149/2291] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:55:45 2022] PUT /identity/v3/projects/1cf64a6edc154ad6a9b1f2d2ca158490/users/17b3ac1c4a1f4a5ca3825873e4829eaa/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:55:45.257550 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802287e0-4338-493b-b276-c48e1b9fff7b None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:45.257833 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802287e0-4338-493b-b276-c48e1b9fff7b None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:45.258105 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802287e0-4338-493b-b276-c48e1b9fff7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:45.286226 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-802287e0-4338-493b-b276-c48e1b9fff7b None None] MFA Rules not processed for user `17b3ac1c4a1f4a5ca3825873e4829eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:55:45.287454 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-802287e0-4338-493b-b276-c48e1b9fff7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:45.349311 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1143/2292] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:55:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:55:45.353925 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a736f-9dab-427c-b561-9b222e6b3bdb admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:45.414575 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a736f-9dab-427c-b561-9b222e6b3bdb admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:45.418674 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa232bc-0a5e-4490-a337-d9a9a846a0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:45.419431 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa232bc-0a5e-4490-a337-d9a9a846a0c7 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:45.419705 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa232bc-0a5e-4490-a337-d9a9a846a0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:45.419973 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa232bc-0a5e-4490-a337-d9a9a846a0c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:45.420665 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa232bc-0a5e-4490-a337-d9a9a846a0c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:45.422629 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa232bc-0a5e-4490-a337-d9a9a846a0c7 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:45.448791 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1150/2293] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:55:45 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:55:45.453144 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802287e0-4338-493b-b276-c48e1b9fff7b None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:45.464307 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802287e0-4338-493b-b276-c48e1b9fff7b None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:45.531225 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362f51f-aba2-4d74-a549-1a8769e98c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:45.531895 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362f51f-aba2-4d74-a549-1a8769e98c86 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:45.532165 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362f51f-aba2-4d74-a549-1a8769e98c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:45.532429 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362f51f-aba2-4d74-a549-1a8769e98c86 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:45.533111 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362f51f-aba2-4d74-a549-1a8769e98c86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:45.535150 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362f51f-aba2-4d74-a549-1a8769e98c86 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:45.556932 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1144/2294] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:55:45 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:55:45.561555 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa232bc-0a5e-4490-a337-d9a9a846a0c7 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:45.580025 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa232bc-0a5e-4490-a337-d9a9a846a0c7 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:45.588878 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577e632-5b40-4bd0-98e7-c7054faba7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:45.590105 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577e632-5b40-4bd0-98e7-c7054faba7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:45.590546 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577e632-5b40-4bd0-98e7-c7054faba7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:45.591063 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577e632-5b40-4bd0-98e7-c7054faba7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:45.592282 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577e632-5b40-4bd0-98e7-c7054faba7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:45.594858 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577e632-5b40-4bd0-98e7-c7054faba7e6 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:45.610441 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1151/2295] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:55:45.615158 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362f51f-aba2-4d74-a549-1a8769e98c86 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:45.627859 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362f51f-aba2-4d74-a549-1a8769e98c86 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:45.635364 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466369d7-f8d8-4b8d-98e5-82b6a76c93c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:45.636765 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466369d7-f8d8-4b8d-98e5-82b6a76c93c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:45.637224 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466369d7-f8d8-4b8d-98e5-82b6a76c93c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:45.637719 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466369d7-f8d8-4b8d-98e5-82b6a76c93c0 admin admin] PATH_INFO: `/v3/projects/309d8c6707b341e7b7f6fa86070e9ffe/users/30ddb592569f4584a6286462fe6db425/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:45.659805 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466369d7-f8d8-4b8d-98e5-82b6a76c93c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=309d8c6707b341e7b7f6fa86070e9ffe, user_id=30ddb592569f4584a6286462fe6db425, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:45.662414 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466369d7-f8d8-4b8d-98e5-82b6a76c93c0 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:45.683991 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1145/2296] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:55:45 2022] PUT /identity/v3/projects/309d8c6707b341e7b7f6fa86070e9ffe/users/30ddb592569f4584a6286462fe6db425/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:55:45.688361 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577e632-5b40-4bd0-98e7-c7054faba7e6 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:45.698286 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577e632-5b40-4bd0-98e7-c7054faba7e6 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:45.758595 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129000f8-da5c-42ed-a9cb-65ed44e41bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:45.759262 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129000f8-da5c-42ed-a9cb-65ed44e41bbf admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:45.759542 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129000f8-da5c-42ed-a9cb-65ed44e41bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:45.759807 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129000f8-da5c-42ed-a9cb-65ed44e41bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:45.760545 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129000f8-da5c-42ed-a9cb-65ed44e41bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:45.762159 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129000f8-da5c-42ed-a9cb-65ed44e41bbf admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:45.772056 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1152/2297] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:55:45.776705 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466369d7-f8d8-4b8d-98e5-82b6a76c93c0 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:45.787925 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466369d7-f8d8-4b8d-98e5-82b6a76c93c0 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:45.793533 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2132265-baf7-47c6-abf1-8b026d835ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:45.794454 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2132265-baf7-47c6-abf1-8b026d835ead admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:45.794763 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2132265-baf7-47c6-abf1-8b026d835ead admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:45.795027 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2132265-baf7-47c6-abf1-8b026d835ead admin admin] PATH_INFO: `/v3/projects/309d8c6707b341e7b7f6fa86070e9ffe/users/30ddb592569f4584a6286462fe6db425/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:45.797160 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2132265-baf7-47c6-abf1-8b026d835ead admin admin] RBAC: Authorizing `identity:create_grant(project_id=309d8c6707b341e7b7f6fa86070e9ffe, user_id=30ddb592569f4584a6286462fe6db425, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:45.799832 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2132265-baf7-47c6-abf1-8b026d835ead admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:45.810633 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1146/2298] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:55:45 2022] PUT /identity/v3/projects/309d8c6707b341e7b7f6fa86070e9ffe/users/30ddb592569f4584a6286462fe6db425/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:55:45.821945 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3e2b4-3c6c-4811-a748-bdd79db07c90 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:45.822344 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3e2b4-3c6c-4811-a748-bdd79db07c90 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:45.822608 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd3e2b4-3c6c-4811-a748-bdd79db07c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:45.849847 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-2cd3e2b4-3c6c-4811-a748-bdd79db07c90 None None] MFA Rules not processed for user `30ddb592569f4584a6286462fe6db425`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:55:45.851042 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-2cd3e2b4-3c6c-4811-a748-bdd79db07c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:45.927663 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1153/2299] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:55:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:55:45.939399 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2132265-baf7-47c6-abf1-8b026d835ead admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:45.941614 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-b2132265-baf7-47c6-abf1-8b026d835ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:46.020223 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2132265-baf7-47c6-abf1-8b026d835ead admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:46.024317 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ed6df-f503-4b92-9608-a4ad2bccf2ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:46.024948 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ed6df-f503-4b92-9608-a4ad2bccf2ba service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:46.025222 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ed6df-f503-4b92-9608-a4ad2bccf2ba service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:46.025522 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ed6df-f503-4b92-9608-a4ad2bccf2ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:46.034926 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ed6df-f503-4b92-9608-a4ad2bccf2ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:46.036331 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ed6df-f503-4b92-9608-a4ad2bccf2ba service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:46.045784 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1147/2300] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:55:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:55:46.113277 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3e2b4-3c6c-4811-a748-bdd79db07c90 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:46.186005 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd3e2b4-3c6c-4811-a748-bdd79db07c90 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:46.190897 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a7133-ac0a-44a1-bf05-e759bd6620da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:46.191766 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a7133-ac0a-44a1-bf05-e759bd6620da admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:46.192040 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a7133-ac0a-44a1-bf05-e759bd6620da admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:46.192332 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a7133-ac0a-44a1-bf05-e759bd6620da admin admin] PATH_INFO: `/v3/users/17b3ac1c4a1f4a5ca3825873e4829eaa` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:46.193661 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a7133-ac0a-44a1-bf05-e759bd6620da admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b3ac1c4a1f4a5ca3825873e4829eaa)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:46.195595 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a7133-ac0a-44a1-bf05-e759bd6620da admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:46.247107 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-325a7133-ac0a-44a1-bf05-e759bd6620da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b3ac1c4a1f4a5ca3825873e4829eaa'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:46.247892 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-325a7133-ac0a-44a1-bf05-e759bd6620da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b3ac1c4a1f4a5ca3825873e4829eaa'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:46.258146 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-325a7133-ac0a-44a1-bf05-e759bd6620da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b3ac1c4a1f4a5ca3825873e4829eaa'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:46.266548 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-325a7133-ac0a-44a1-bf05-e759bd6620da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b3ac1c4a1f4a5ca3825873e4829eaa'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:46.279442 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-325a7133-ac0a-44a1-bf05-e759bd6620da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b3ac1c4a1f4a5ca3825873e4829eaa'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:46.286079 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1154/2301] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:55:46 2022] DELETE /identity/v3/users/17b3ac1c4a1f4a5ca3825873e4829eaa => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:55:46.291644 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100a13d-7e6e-4e10-b3c8-b3ed5e32218f None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:46.291997 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100a13d-7e6e-4e10-b3c8-b3ed5e32218f None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:46.292351 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0100a13d-7e6e-4e10-b3c8-b3ed5e32218f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:46.315850 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-0100a13d-7e6e-4e10-b3c8-b3ed5e32218f None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:55:46.317037 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-0100a13d-7e6e-4e10-b3c8-b3ed5e32218f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:46.389739 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1148/2302] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:55:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:55:46.399576 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a7133-ac0a-44a1-bf05-e759bd6620da admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:46.401263 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-325a7133-ac0a-44a1-bf05-e759bd6620da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:46.460544 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a7133-ac0a-44a1-bf05-e759bd6620da admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:46.464372 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec485ff-3eb8-4d44-933d-4be2b4ebd445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:46.465024 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec485ff-3eb8-4d44-933d-4be2b4ebd445 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:46.465306 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec485ff-3eb8-4d44-933d-4be2b4ebd445 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:46.465609 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec485ff-3eb8-4d44-933d-4be2b4ebd445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:46.476644 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec485ff-3eb8-4d44-933d-4be2b4ebd445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:46.478108 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec485ff-3eb8-4d44-933d-4be2b4ebd445 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:46.488009 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1155/2303] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:55:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:55:46.759148 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100a13d-7e6e-4e10-b3c8-b3ed5e32218f None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:46.760776 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-0100a13d-7e6e-4e10-b3c8-b3ed5e32218f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:46.773047 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0100a13d-7e6e-4e10-b3c8-b3ed5e32218f None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:46.778212 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe022111-42de-4a20-aa4e-2a59cdfaa3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:46.779047 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe022111-42de-4a20-aa4e-2a59cdfaa3c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:46.779321 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe022111-42de-4a20-aa4e-2a59cdfaa3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:46.779585 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe022111-42de-4a20-aa4e-2a59cdfaa3c2 admin admin] PATH_INFO: `/v3/projects/1cf64a6edc154ad6a9b1f2d2ca158490` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:46.780852 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe022111-42de-4a20-aa4e-2a59cdfaa3c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cf64a6edc154ad6a9b1f2d2ca158490)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:46.783632 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe022111-42de-4a20-aa4e-2a59cdfaa3c2 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:46.831746 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-fe022111-42de-4a20-aa4e-2a59cdfaa3c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cf64a6edc154ad6a9b1f2d2ca158490', 'request_id': 'req-fe022111-42de-4a20-aa4e-2a59cdfaa3c2'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:46.837765 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-fe022111-42de-4a20-aa4e-2a59cdfaa3c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cf64a6edc154ad6a9b1f2d2ca158490', 'request_id': 'req-fe022111-42de-4a20-aa4e-2a59cdfaa3c2'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:46.847616 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-fe022111-42de-4a20-aa4e-2a59cdfaa3c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cf64a6edc154ad6a9b1f2d2ca158490', 'request_id': 'req-fe022111-42de-4a20-aa4e-2a59cdfaa3c2'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:46.858448 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-fe022111-42de-4a20-aa4e-2a59cdfaa3c2 admin admin] The token cache is being invalidate because project 1cf64a6edc154ad6a9b1f2d2ca158490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:55:46.858739 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-fe022111-42de-4a20-aa4e-2a59cdfaa3c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:46.859453 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-fe022111-42de-4a20-aa4e-2a59cdfaa3c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:46.861088 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1149/2304] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:55:46 2022] DELETE /identity/v3/projects/1cf64a6edc154ad6a9b1f2d2ca158490 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:55:46.865243 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec485ff-3eb8-4d44-933d-4be2b4ebd445 service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:46.875091 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec485ff-3eb8-4d44-933d-4be2b4ebd445 service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:46.932013 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec660d4-5b15-4c88-a502-c574afafaa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:46.932873 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec660d4-5b15-4c88-a502-c574afafaa90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:46.933173 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec660d4-5b15-4c88-a502-c574afafaa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:46.933420 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec660d4-5b15-4c88-a502-c574afafaa90 admin admin] PATH_INFO: `/v3/users/30ddb592569f4584a6286462fe6db425` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:46.934659 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec660d4-5b15-4c88-a502-c574afafaa90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30ddb592569f4584a6286462fe6db425)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:46.936559 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec660d4-5b15-4c88-a502-c574afafaa90 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:46.990896 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-2ec660d4-5b15-4c88-a502-c574afafaa90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30ddb592569f4584a6286462fe6db425'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:46.991634 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-2ec660d4-5b15-4c88-a502-c574afafaa90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30ddb592569f4584a6286462fe6db425'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:47.000072 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-2ec660d4-5b15-4c88-a502-c574afafaa90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30ddb592569f4584a6286462fe6db425'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:47.007025 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-2ec660d4-5b15-4c88-a502-c574afafaa90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30ddb592569f4584a6286462fe6db425'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:47.018365 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-2ec660d4-5b15-4c88-a502-c574afafaa90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30ddb592569f4584a6286462fe6db425'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:47.024798 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1156/2305] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:55:46 2022] DELETE /identity/v3/users/30ddb592569f4584a6286462fe6db425 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:55:47.315533 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe022111-42de-4a20-aa4e-2a59cdfaa3c2 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:47.317492 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-fe022111-42de-4a20-aa4e-2a59cdfaa3c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:47.331704 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe022111-42de-4a20-aa4e-2a59cdfaa3c2 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:47.394816 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747dd54-4d8b-4421-a0de-dbf67656153d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:47.395680 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747dd54-4d8b-4421-a0de-dbf67656153d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:47.395956 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747dd54-4d8b-4421-a0de-dbf67656153d admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:47.396225 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747dd54-4d8b-4421-a0de-dbf67656153d admin admin] PATH_INFO: `/v3/projects/309d8c6707b341e7b7f6fa86070e9ffe` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:47.397428 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747dd54-4d8b-4421-a0de-dbf67656153d admin admin] RBAC: Authorizing `identity:delete_project(project_id=309d8c6707b341e7b7f6fa86070e9ffe)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:47.399357 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8747dd54-4d8b-4421-a0de-dbf67656153d admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:47.447108 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-8747dd54-4d8b-4421-a0de-dbf67656153d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '309d8c6707b341e7b7f6fa86070e9ffe', 'request_id': 'req-8747dd54-4d8b-4421-a0de-dbf67656153d'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:47.453261 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-8747dd54-4d8b-4421-a0de-dbf67656153d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '309d8c6707b341e7b7f6fa86070e9ffe', 'request_id': 'req-8747dd54-4d8b-4421-a0de-dbf67656153d'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:47.463952 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-8747dd54-4d8b-4421-a0de-dbf67656153d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '309d8c6707b341e7b7f6fa86070e9ffe', 'request_id': 'req-8747dd54-4d8b-4421-a0de-dbf67656153d'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:47.474443 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-8747dd54-4d8b-4421-a0de-dbf67656153d admin admin] The token cache is being invalidate because project 309d8c6707b341e7b7f6fa86070e9ffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:55:47.474799 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-8747dd54-4d8b-4421-a0de-dbf67656153d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:47.475487 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-8747dd54-4d8b-4421-a0de-dbf67656153d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:55:47.477053 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1150/2306] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:55:47 2022] DELETE /identity/v3/projects/309d8c6707b341e7b7f6fa86070e9ffe => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:55:47.482357 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dcd32-60b0-4710-8e7f-1887de2445e3 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:47.482920 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dcd32-60b0-4710-8e7f-1887de2445e3 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:47.483020 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dcd32-60b0-4710-8e7f-1887de2445e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:47.502283 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-733dcd32-60b0-4710-8e7f-1887de2445e3 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:55:47.503458 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-733dcd32-60b0-4710-8e7f-1887de2445e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:47.564893 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1157/2307] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:55:47.573080 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bb5e0-f672-49df-b3a7-6e32d66bf481 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:47.573375 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bb5e0-f672-49df-b3a7-6e32d66bf481 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:47.573653 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90bb5e0-f672-49df-b3a7-6e32d66bf481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:47.593856 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-c90bb5e0-f672-49df-b3a7-6e32d66bf481 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:55:47.595039 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-c90bb5e0-f672-49df-b3a7-6e32d66bf481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:47.603732 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1151/2308] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:55:47.608353 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dcd32-60b0-4710-8e7f-1887de2445e3 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:47.617997 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dcd32-60b0-4710-8e7f-1887de2445e3 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:47.622719 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3da488-780c-4630-a0bd-ae5b6a9843f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:47.624054 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3da488-780c-4630-a0bd-ae5b6a9843f7 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:47.624333 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3da488-780c-4630-a0bd-ae5b6a9843f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:47.624598 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3da488-780c-4630-a0bd-ae5b6a9843f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:47.625298 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3da488-780c-4630-a0bd-ae5b6a9843f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:55:47.625653 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3da488-780c-4630-a0bd-ae5b6a9843f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:47.627260 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3da488-780c-4630-a0bd-ae5b6a9843f7 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:47.639608 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1158/2309] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:55:47.644193 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90bb5e0-f672-49df-b3a7-6e32d66bf481 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:47.654084 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90bb5e0-f672-49df-b3a7-6e32d66bf481 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:47.660087 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35eecfc-488a-4e03-89f7-5a5bc72fb059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:47.661459 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35eecfc-488a-4e03-89f7-5a5bc72fb059 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:47.661459 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35eecfc-488a-4e03-89f7-5a5bc72fb059 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:47.661459 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35eecfc-488a-4e03-89f7-5a5bc72fb059 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:47.661996 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35eecfc-488a-4e03-89f7-5a5bc72fb059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:47.663932 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35eecfc-488a-4e03-89f7-5a5bc72fb059 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:47.699183 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1152/2310] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:55:47 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:55:47.699306 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3da488-780c-4630-a0bd-ae5b6a9843f7 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:47.707933 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3da488-780c-4630-a0bd-ae5b6a9843f7 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:47.770427 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477b9cf-b18f-4ba5-a7c9-cc3f476fdf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:47.771261 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477b9cf-b18f-4ba5-a7c9-cc3f476fdf95 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:47.771603 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477b9cf-b18f-4ba5-a7c9-cc3f476fdf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:47.771972 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477b9cf-b18f-4ba5-a7c9-cc3f476fdf95 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:47.772730 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477b9cf-b18f-4ba5-a7c9-cc3f476fdf95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:47.774814 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477b9cf-b18f-4ba5-a7c9-cc3f476fdf95 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:47.796218 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1159/2311] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:55:47 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:55:47.800561 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35eecfc-488a-4e03-89f7-5a5bc72fb059 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:47.812389 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35eecfc-488a-4e03-89f7-5a5bc72fb059 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:47.818422 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7e584-d3d4-46f9-a9ca-366d386c834d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:47.819004 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7e584-d3d4-46f9-a9ca-366d386c834d admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:47.819327 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7e584-d3d4-46f9-a9ca-366d386c834d admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:47.819625 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7e584-d3d4-46f9-a9ca-366d386c834d admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:47.820691 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7e584-d3d4-46f9-a9ca-366d386c834d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:47.822791 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7e584-d3d4-46f9-a9ca-366d386c834d admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:47.835954 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1153/2312] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:55:47.840041 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477b9cf-b18f-4ba5-a7c9-cc3f476fdf95 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:47.850150 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477b9cf-b18f-4ba5-a7c9-cc3f476fdf95 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:47.855188 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b86d4e-9be6-4fda-a124-f0493fd4f4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:47.855847 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b86d4e-9be6-4fda-a124-f0493fd4f4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:47.856123 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b86d4e-9be6-4fda-a124-f0493fd4f4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:47.856395 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b86d4e-9be6-4fda-a124-f0493fd4f4c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:47.857188 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b86d4e-9be6-4fda-a124-f0493fd4f4c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:47.858983 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b86d4e-9be6-4fda-a124-f0493fd4f4c2 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:47.871059 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1160/2313] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:55:47.875847 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7e584-d3d4-46f9-a9ca-366d386c834d admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:47.885854 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7e584-d3d4-46f9-a9ca-366d386c834d admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:47.890444 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa2550-992a-4898-9999-3fe101ba3653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:47.891320 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa2550-992a-4898-9999-3fe101ba3653 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:47.891610 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa2550-992a-4898-9999-3fe101ba3653 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:47.891882 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa2550-992a-4898-9999-3fe101ba3653 admin admin] PATH_INFO: `/v3/projects/60eea5023e4c43a1bf38918690a6bc02/users/558bbd16903d41b0932e3a366df064d8/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:47.907286 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa2550-992a-4898-9999-3fe101ba3653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60eea5023e4c43a1bf38918690a6bc02, user_id=558bbd16903d41b0932e3a366df064d8, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:47.909949 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa2550-992a-4898-9999-3fe101ba3653 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:47.924038 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1154/2314] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:55:47 2022] PUT /identity/v3/projects/60eea5023e4c43a1bf38918690a6bc02/users/558bbd16903d41b0932e3a366df064d8/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:55:47.934396 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfefff-4845-4651-8763-f3b99aca8c1e None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:47.934686 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfefff-4845-4651-8763-f3b99aca8c1e None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:47.934959 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfefff-4845-4651-8763-f3b99aca8c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:47.960977 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-11bfefff-4845-4651-8763-f3b99aca8c1e None None] MFA Rules not processed for user `558bbd16903d41b0932e3a366df064d8`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:55:47.962188 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-11bfefff-4845-4651-8763-f3b99aca8c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:48.030222 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1161/2315] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:55:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:55:48.034743 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa2550-992a-4898-9999-3fe101ba3653 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:48.106633 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa2550-992a-4898-9999-3fe101ba3653 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:48.112489 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e832c40-4b30-468e-89c7-d7118c672e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:48.113147 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e832c40-4b30-468e-89c7-d7118c672e04 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:48.113452 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e832c40-4b30-468e-89c7-d7118c672e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:48.113722 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e832c40-4b30-468e-89c7-d7118c672e04 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:48.114420 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e832c40-4b30-468e-89c7-d7118c672e04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:48.116308 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e832c40-4b30-468e-89c7-d7118c672e04 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:48.145267 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1155/2316] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:55:48 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:55:48.151922 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfefff-4845-4651-8763-f3b99aca8c1e None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:48.169375 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfefff-4845-4651-8763-f3b99aca8c1e None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:48.230694 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2723b-bf2e-4f35-a113-77515b019d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:48.231358 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2723b-bf2e-4f35-a113-77515b019d85 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:48.231635 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2723b-bf2e-4f35-a113-77515b019d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:48.231904 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2723b-bf2e-4f35-a113-77515b019d85 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:48.232740 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2723b-bf2e-4f35-a113-77515b019d85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:48.234699 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2723b-bf2e-4f35-a113-77515b019d85 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:48.256165 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1162/2317] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:55:48 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:55:48.260686 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e832c40-4b30-468e-89c7-d7118c672e04 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:48.271867 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e832c40-4b30-468e-89c7-d7118c672e04 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:48.278338 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582b337-4033-4304-bd3a-a5372278a6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:48.279046 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582b337-4033-4304-bd3a-a5372278a6ab admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:48.279326 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582b337-4033-4304-bd3a-a5372278a6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:48.279596 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582b337-4033-4304-bd3a-a5372278a6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:48.280334 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582b337-4033-4304-bd3a-a5372278a6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:48.281949 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582b337-4033-4304-bd3a-a5372278a6ab admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:48.292774 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1156/2318] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:55:48.297135 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2723b-bf2e-4f35-a113-77515b019d85 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:48.307715 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2723b-bf2e-4f35-a113-77515b019d85 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:48.313693 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a6311-2d52-444f-9f3d-76292536cedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:48.314604 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a6311-2d52-444f-9f3d-76292536cedf admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:48.314899 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a6311-2d52-444f-9f3d-76292536cedf admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:48.315168 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a6311-2d52-444f-9f3d-76292536cedf admin admin] PATH_INFO: `/v3/projects/b34204f8b43d4a14863085a847e06a4a/users/0f7378c55afa40bc8dd70f425fc3cffd/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:48.331000 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a6311-2d52-444f-9f3d-76292536cedf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b34204f8b43d4a14863085a847e06a4a, user_id=0f7378c55afa40bc8dd70f425fc3cffd, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:48.333737 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a6311-2d52-444f-9f3d-76292536cedf admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:48.349892 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1163/2319] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:55:48 2022] PUT /identity/v3/projects/b34204f8b43d4a14863085a847e06a4a/users/0f7378c55afa40bc8dd70f425fc3cffd/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:55:48.353873 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582b337-4033-4304-bd3a-a5372278a6ab admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:48.364555 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582b337-4033-4304-bd3a-a5372278a6ab admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:48.422404 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf3840-b38c-46a0-b678-c10d61ee5165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:48.423060 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf3840-b38c-46a0-b678-c10d61ee5165 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:48.423346 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf3840-b38c-46a0-b678-c10d61ee5165 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:48.423622 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf3840-b38c-46a0-b678-c10d61ee5165 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:48.424460 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf3840-b38c-46a0-b678-c10d61ee5165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:48.426160 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf3840-b38c-46a0-b678-c10d61ee5165 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:48.436396 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1157/2320] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:55:48.441152 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a6311-2d52-444f-9f3d-76292536cedf admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:48.454254 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a6311-2d52-444f-9f3d-76292536cedf admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:48.459518 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50503e-a605-4a71-af41-76c97ad06b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:48.460393 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50503e-a605-4a71-af41-76c97ad06b3b admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:48.460695 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50503e-a605-4a71-af41-76c97ad06b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:48.460952 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc50503e-a605-4a71-af41-76c97ad06b3b admin admin] PATH_INFO: `/v3/projects/b34204f8b43d4a14863085a847e06a4a/users/0f7378c55afa40bc8dd70f425fc3cffd/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:48.463015 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50503e-a605-4a71-af41-76c97ad06b3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b34204f8b43d4a14863085a847e06a4a, user_id=0f7378c55afa40bc8dd70f425fc3cffd, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:48.465724 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc50503e-a605-4a71-af41-76c97ad06b3b admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:48.476560 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1164/2321] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:55:48 2022] PUT /identity/v3/projects/b34204f8b43d4a14863085a847e06a4a/users/0f7378c55afa40bc8dd70f425fc3cffd/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:55:48.488268 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87e5a4-0e72-4720-855c-0ba4e1214c89 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:48.488553 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87e5a4-0e72-4720-855c-0ba4e1214c89 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:48.488820 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87e5a4-0e72-4720-855c-0ba4e1214c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:48.516565 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-6d87e5a4-0e72-4720-855c-0ba4e1214c89 None None] MFA Rules not processed for user `0f7378c55afa40bc8dd70f425fc3cffd`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:55:48.517793 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-6d87e5a4-0e72-4720-855c-0ba4e1214c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:48.589842 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1158/2322] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:55:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:55:48.601064 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50503e-a605-4a71-af41-76c97ad06b3b admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:48.603211 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-bc50503e-a605-4a71-af41-76c97ad06b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:48.666006 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc50503e-a605-4a71-af41-76c97ad06b3b admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:48.670455 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b900b4-77e1-4904-adbf-3d570fddf099 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:48.671101 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b900b4-77e1-4904-adbf-3d570fddf099 service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:48.671384 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b900b4-77e1-4904-adbf-3d570fddf099 service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:48.671660 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b900b4-77e1-4904-adbf-3d570fddf099 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:48.729760 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b900b4-77e1-4904-adbf-3d570fddf099 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:48.731200 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b900b4-77e1-4904-adbf-3d570fddf099 service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:48.740592 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1165/2323] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:55:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:55:58.198866 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87e5a4-0e72-4720-855c-0ba4e1214c89 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:55:58.200450 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-6d87e5a4-0e72-4720-855c-0ba4e1214c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:55:58.213771 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87e5a4-0e72-4720-855c-0ba4e1214c89 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:55:58.217685 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef73fe-a4da-4cc1-bed1-fcdc41ff9c44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:55:58.218322 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef73fe-a4da-4cc1-bed1-fcdc41ff9c44 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:55:58.218594 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef73fe-a4da-4cc1-bed1-fcdc41ff9c44 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:55:58.218857 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef73fe-a4da-4cc1-bed1-fcdc41ff9c44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:55:58.230973 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef73fe-a4da-4cc1-bed1-fcdc41ff9c44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:55:58.233077 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef73fe-a4da-4cc1-bed1-fcdc41ff9c44 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:55:58.247488 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1159/2324] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:55:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:56:03.132930 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b900b4-77e1-4904-adbf-3d570fddf099 service cinder] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:03.192908 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b900b4-77e1-4904-adbf-3d570fddf099 service cinder] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:03.197444 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ed80f-f73c-43b7-ac61-499cf78fb860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:03.198312 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ed80f-f73c-43b7-ac61-499cf78fb860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:03.198583 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ed80f-f73c-43b7-ac61-499cf78fb860 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:03.198848 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ed80f-f73c-43b7-ac61-499cf78fb860 admin admin] PATH_INFO: `/v3/users/558bbd16903d41b0932e3a366df064d8` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:03.200050 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ed80f-f73c-43b7-ac61-499cf78fb860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=558bbd16903d41b0932e3a366df064d8)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:03.201998 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ed80f-f73c-43b7-ac61-499cf78fb860 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:03.248817 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-207ed80f-f73c-43b7-ac61-499cf78fb860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '558bbd16903d41b0932e3a366df064d8'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:03.249488 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-207ed80f-f73c-43b7-ac61-499cf78fb860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '558bbd16903d41b0932e3a366df064d8'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:03.258182 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-207ed80f-f73c-43b7-ac61-499cf78fb860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '558bbd16903d41b0932e3a366df064d8'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:03.265073 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-207ed80f-f73c-43b7-ac61-499cf78fb860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '558bbd16903d41b0932e3a366df064d8'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:03.276977 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-207ed80f-f73c-43b7-ac61-499cf78fb860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '558bbd16903d41b0932e3a366df064d8'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:03.282963 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1166/2325] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:56:03 2022] DELETE /identity/v3/users/558bbd16903d41b0932e3a366df064d8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:03.287532 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e2d92-4913-456c-98ba-7a4e2601f3d5 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:03.288020 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e2d92-4913-456c-98ba-7a4e2601f3d5 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:03.288117 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88e2d92-4913-456c-98ba-7a4e2601f3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:03.305708 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-f88e2d92-4913-456c-98ba-7a4e2601f3d5 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:03.306883 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f88e2d92-4913-456c-98ba-7a4e2601f3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:03.363758 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1160/2326] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:56:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:03.373748 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ed80f-f73c-43b7-ac61-499cf78fb860 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:03.375154 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-207ed80f-f73c-43b7-ac61-499cf78fb860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:03.430535 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ed80f-f73c-43b7-ac61-499cf78fb860 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:03.434206 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56ba63-75f9-4678-b750-86c74eeddbcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:03.434857 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56ba63-75f9-4678-b750-86c74eeddbcb service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:03.435133 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56ba63-75f9-4678-b750-86c74eeddbcb service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:03.435398 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56ba63-75f9-4678-b750-86c74eeddbcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:03.444815 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56ba63-75f9-4678-b750-86c74eeddbcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:03.446245 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56ba63-75f9-4678-b750-86c74eeddbcb service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:03.456693 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1167/2327] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:56:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:56:03.726941 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e2d92-4913-456c-98ba-7a4e2601f3d5 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:03.728631 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f88e2d92-4913-456c-98ba-7a4e2601f3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:03.742164 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88e2d92-4913-456c-98ba-7a4e2601f3d5 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:03.747443 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac7efd-3893-4869-acbc-ca4cab3422c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:03.748323 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac7efd-3893-4869-acbc-ca4cab3422c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:03.748590 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac7efd-3893-4869-acbc-ca4cab3422c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:03.748858 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac7efd-3893-4869-acbc-ca4cab3422c6 admin admin] PATH_INFO: `/v3/projects/60eea5023e4c43a1bf38918690a6bc02` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:03.750589 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac7efd-3893-4869-acbc-ca4cab3422c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60eea5023e4c43a1bf38918690a6bc02)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:03.752834 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac7efd-3893-4869-acbc-ca4cab3422c6 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:03.799623 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-4fac7efd-3893-4869-acbc-ca4cab3422c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60eea5023e4c43a1bf38918690a6bc02', 'request_id': 'req-4fac7efd-3893-4869-acbc-ca4cab3422c6'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:03.805542 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-4fac7efd-3893-4869-acbc-ca4cab3422c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60eea5023e4c43a1bf38918690a6bc02', 'request_id': 'req-4fac7efd-3893-4869-acbc-ca4cab3422c6'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:03.814569 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-4fac7efd-3893-4869-acbc-ca4cab3422c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60eea5023e4c43a1bf38918690a6bc02', 'request_id': 'req-4fac7efd-3893-4869-acbc-ca4cab3422c6'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:03.826703 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-4fac7efd-3893-4869-acbc-ca4cab3422c6 admin admin] The token cache is being invalidate because project 60eea5023e4c43a1bf38918690a6bc02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:56:03.827119 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-4fac7efd-3893-4869-acbc-ca4cab3422c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:03.827873 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-4fac7efd-3893-4869-acbc-ca4cab3422c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:03.829849 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1161/2328] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:56:03 2022] DELETE /identity/v3/projects/60eea5023e4c43a1bf38918690a6bc02 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:03.834071 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56ba63-75f9-4678-b750-86c74eeddbcb service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:03.843857 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56ba63-75f9-4678-b750-86c74eeddbcb service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:03.898266 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc28057b-e4d8-4056-8542-17dd1172c8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:03.899068 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28057b-e4d8-4056-8542-17dd1172c8b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:03.899348 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28057b-e4d8-4056-8542-17dd1172c8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:03.899600 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28057b-e4d8-4056-8542-17dd1172c8b8 admin admin] PATH_INFO: `/v3/users/0f7378c55afa40bc8dd70f425fc3cffd` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:03.900803 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28057b-e4d8-4056-8542-17dd1172c8b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f7378c55afa40bc8dd70f425fc3cffd)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:03.902765 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc28057b-e4d8-4056-8542-17dd1172c8b8 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:03.956459 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-bc28057b-e4d8-4056-8542-17dd1172c8b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f7378c55afa40bc8dd70f425fc3cffd'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:03.957202 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-bc28057b-e4d8-4056-8542-17dd1172c8b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f7378c55afa40bc8dd70f425fc3cffd'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:03.966385 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-bc28057b-e4d8-4056-8542-17dd1172c8b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f7378c55afa40bc8dd70f425fc3cffd'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:03.973134 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-bc28057b-e4d8-4056-8542-17dd1172c8b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f7378c55afa40bc8dd70f425fc3cffd'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:03.984283 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-bc28057b-e4d8-4056-8542-17dd1172c8b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f7378c55afa40bc8dd70f425fc3cffd'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:03.990491 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1168/2329] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:56:03 2022] DELETE /identity/v3/users/0f7378c55afa40bc8dd70f425fc3cffd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:04.254152 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac7efd-3893-4869-acbc-ca4cab3422c6 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:04.255680 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-4fac7efd-3893-4869-acbc-ca4cab3422c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:04.269142 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac7efd-3893-4869-acbc-ca4cab3422c6 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:04.328477 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d260ba-b555-452e-bd44-518f54e67bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:04.329597 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d260ba-b555-452e-bd44-518f54e67bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:04.330053 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d260ba-b555-452e-bd44-518f54e67bba admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:04.330471 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d260ba-b555-452e-bd44-518f54e67bba admin admin] PATH_INFO: `/v3/projects/b34204f8b43d4a14863085a847e06a4a` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:04.331539 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d260ba-b555-452e-bd44-518f54e67bba admin admin] RBAC: Authorizing `identity:delete_project(project_id=b34204f8b43d4a14863085a847e06a4a)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:04.333486 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d260ba-b555-452e-bd44-518f54e67bba admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:04.381412 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-55d260ba-b555-452e-bd44-518f54e67bba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b34204f8b43d4a14863085a847e06a4a', 'request_id': 'req-55d260ba-b555-452e-bd44-518f54e67bba'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:04.387618 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-55d260ba-b555-452e-bd44-518f54e67bba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b34204f8b43d4a14863085a847e06a4a', 'request_id': 'req-55d260ba-b555-452e-bd44-518f54e67bba'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:04.396593 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-55d260ba-b555-452e-bd44-518f54e67bba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b34204f8b43d4a14863085a847e06a4a', 'request_id': 'req-55d260ba-b555-452e-bd44-518f54e67bba'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:04.408175 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-55d260ba-b555-452e-bd44-518f54e67bba admin admin] The token cache is being invalidate because project b34204f8b43d4a14863085a847e06a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:56:04.408423 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-55d260ba-b555-452e-bd44-518f54e67bba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:04.409073 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-55d260ba-b555-452e-bd44-518f54e67bba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:04.415180 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1162/2330] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:56:04 2022] DELETE /identity/v3/projects/b34204f8b43d4a14863085a847e06a4a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:56:04.418002 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a07d52-73b9-467c-b821-7a9d82dd869e None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:04.418479 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a07d52-73b9-467c-b821-7a9d82dd869e None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:04.418561 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a07d52-73b9-467c-b821-7a9d82dd869e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:04.440288 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-e2a07d52-73b9-467c-b821-7a9d82dd869e None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:04.441603 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-e2a07d52-73b9-467c-b821-7a9d82dd869e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:04.509545 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1169/2331] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:04.517131 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0fe4d-f034-4f0f-a39a-64a1d2b9712d None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:04.517705 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0fe4d-f034-4f0f-a39a-64a1d2b9712d None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:04.518168 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c0fe4d-f034-4f0f-a39a-64a1d2b9712d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:04.537889 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-41c0fe4d-f034-4f0f-a39a-64a1d2b9712d None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:04.539093 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-41c0fe4d-f034-4f0f-a39a-64a1d2b9712d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:04.547242 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1163/2332] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:56:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:56:04.551335 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a07d52-73b9-467c-b821-7a9d82dd869e None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:04.561380 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a07d52-73b9-467c-b821-7a9d82dd869e None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:04.566290 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996a1f1-8d15-4e9e-a824-6fe0c538c298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:04.567381 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996a1f1-8d15-4e9e-a824-6fe0c538c298 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:04.567381 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996a1f1-8d15-4e9e-a824-6fe0c538c298 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:04.567772 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1996a1f1-8d15-4e9e-a824-6fe0c538c298 admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:04.568631 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996a1f1-8d15-4e9e-a824-6fe0c538c298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:56:04.569001 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996a1f1-8d15-4e9e-a824-6fe0c538c298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:04.570720 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1996a1f1-8d15-4e9e-a824-6fe0c538c298 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:04.584762 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1170/2333] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:56:04.589300 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0fe4d-f034-4f0f-a39a-64a1d2b9712d None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:04.598700 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c0fe4d-f034-4f0f-a39a-64a1d2b9712d None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:04.604813 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e3197-e2ea-4549-81f2-68d0beee950e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:04.606172 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e3197-e2ea-4549-81f2-68d0beee950e admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:04.607905 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e3197-e2ea-4549-81f2-68d0beee950e admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:04.608251 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e3197-e2ea-4549-81f2-68d0beee950e admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:04.609034 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e3197-e2ea-4549-81f2-68d0beee950e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:04.613429 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e3197-e2ea-4549-81f2-68d0beee950e admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:04.647071 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1164/2334] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:56:04 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:56:04.651453 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996a1f1-8d15-4e9e-a824-6fe0c538c298 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:04.666191 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1996a1f1-8d15-4e9e-a824-6fe0c538c298 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:04.757801 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1383e-b7db-4ee9-a892-534a583ee225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:04.758638 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1383e-b7db-4ee9-a892-534a583ee225 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:04.759010 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1383e-b7db-4ee9-a892-534a583ee225 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:04.759352 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1383e-b7db-4ee9-a892-534a583ee225 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:04.760152 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1383e-b7db-4ee9-a892-534a583ee225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:04.762191 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1383e-b7db-4ee9-a892-534a583ee225 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:04.792881 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1171/2335] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:56:04 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:56:04.794062 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e3197-e2ea-4549-81f2-68d0beee950e admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:04.808643 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e3197-e2ea-4549-81f2-68d0beee950e admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:04.814585 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c55fd-6138-4096-a182-87b30deeb3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:04.815578 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c55fd-6138-4096-a182-87b30deeb3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:04.815924 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c55fd-6138-4096-a182-87b30deeb3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:04.816237 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c55fd-6138-4096-a182-87b30deeb3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:04.817128 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c55fd-6138-4096-a182-87b30deeb3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:04.819020 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c55fd-6138-4096-a182-87b30deeb3d3 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:04.839723 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1165/2336] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:56:04.843973 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1383e-b7db-4ee9-a892-534a583ee225 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:04.854901 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1383e-b7db-4ee9-a892-534a583ee225 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:04.859799 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8cd70-8cdc-4b47-bbbf-a6b8bf78d947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:04.860546 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8cd70-8cdc-4b47-bbbf-a6b8bf78d947 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:04.860897 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8cd70-8cdc-4b47-bbbf-a6b8bf78d947 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:04.861236 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8cd70-8cdc-4b47-bbbf-a6b8bf78d947 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:04.862061 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8cd70-8cdc-4b47-bbbf-a6b8bf78d947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:04.863828 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8cd70-8cdc-4b47-bbbf-a6b8bf78d947 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:04.876995 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1172/2337] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:56:04.881597 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c55fd-6138-4096-a182-87b30deeb3d3 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:04.891965 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c55fd-6138-4096-a182-87b30deeb3d3 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:04.896685 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccaa5a-57b5-41d7-9472-7f190ceead9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:04.897631 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccaa5a-57b5-41d7-9472-7f190ceead9b admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:04.897907 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccaa5a-57b5-41d7-9472-7f190ceead9b admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:04.898166 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccaa5a-57b5-41d7-9472-7f190ceead9b admin admin] PATH_INFO: `/v3/projects/7913ff381df04ac98d04050cc479ebc8/users/a03a14362a06461b98a5d4065544bc57/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:04.917930 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccaa5a-57b5-41d7-9472-7f190ceead9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7913ff381df04ac98d04050cc479ebc8, user_id=a03a14362a06461b98a5d4065544bc57, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:04.920664 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ccaa5a-57b5-41d7-9472-7f190ceead9b admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:04.935626 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1166/2338] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:56:04 2022] PUT /identity/v3/projects/7913ff381df04ac98d04050cc479ebc8/users/a03a14362a06461b98a5d4065544bc57/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:56:04.948068 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21ce3d-b990-46ac-afac-e0e992fa5330 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:04.948315 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21ce3d-b990-46ac-afac-e0e992fa5330 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:04.948729 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21ce3d-b990-46ac-afac-e0e992fa5330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:04.976793 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-cf21ce3d-b990-46ac-afac-e0e992fa5330 None None] MFA Rules not processed for user `a03a14362a06461b98a5d4065544bc57`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:04.977828 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-cf21ce3d-b990-46ac-afac-e0e992fa5330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:05.040184 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1173/2339] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:56:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:05.052469 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccaa5a-57b5-41d7-9472-7f190ceead9b admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:05.054526 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-a8ccaa5a-57b5-41d7-9472-7f190ceead9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:05.112082 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccaa5a-57b5-41d7-9472-7f190ceead9b admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:05.116673 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f336e2-f0db-4855-a653-633547efda00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:05.117328 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f336e2-f0db-4855-a653-633547efda00 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:05.117639 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f336e2-f0db-4855-a653-633547efda00 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:05.117914 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f336e2-f0db-4855-a653-633547efda00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:05.126880 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f336e2-f0db-4855-a653-633547efda00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:05.128666 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f336e2-f0db-4855-a653-633547efda00 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:05.140241 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1167/2340] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:56:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:56:10.404738 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21ce3d-b990-46ac-afac-e0e992fa5330 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:10.482585 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21ce3d-b990-46ac-afac-e0e992fa5330 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:10.487068 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8f819-6341-4b20-87bc-e3229d8a1f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:10.487952 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8f819-6341-4b20-87bc-e3229d8a1f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:10.488262 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8f819-6341-4b20-87bc-e3229d8a1f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:10.488564 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8f819-6341-4b20-87bc-e3229d8a1f78 admin admin] PATH_INFO: `/v3/users/a03a14362a06461b98a5d4065544bc57` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:10.489918 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8f819-6341-4b20-87bc-e3229d8a1f78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a03a14362a06461b98a5d4065544bc57)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:10.492064 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8f819-6341-4b20-87bc-e3229d8a1f78 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:10.542765 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-2ba8f819-6341-4b20-87bc-e3229d8a1f78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a03a14362a06461b98a5d4065544bc57'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:10.543410 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-2ba8f819-6341-4b20-87bc-e3229d8a1f78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a03a14362a06461b98a5d4065544bc57'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:10.551151 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-2ba8f819-6341-4b20-87bc-e3229d8a1f78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a03a14362a06461b98a5d4065544bc57'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:10.557983 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-2ba8f819-6341-4b20-87bc-e3229d8a1f78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a03a14362a06461b98a5d4065544bc57'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:10.570606 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-2ba8f819-6341-4b20-87bc-e3229d8a1f78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a03a14362a06461b98a5d4065544bc57'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:10.576601 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1174/2341] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:56:10 2022] DELETE /identity/v3/users/a03a14362a06461b98a5d4065544bc57 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:10.581530 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b829773-8026-4776-a255-6ca8c430c3b0 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:10.582113 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b829773-8026-4776-a255-6ca8c430c3b0 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:10.582211 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b829773-8026-4776-a255-6ca8c430c3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:10.598554 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-0b829773-8026-4776-a255-6ca8c430c3b0 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:10.599956 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-0b829773-8026-4776-a255-6ca8c430c3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:10.661698 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1168/2342] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:10.673401 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8f819-6341-4b20-87bc-e3229d8a1f78 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:10.674820 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-2ba8f819-6341-4b20-87bc-e3229d8a1f78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:10.735385 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8f819-6341-4b20-87bc-e3229d8a1f78 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:10.739860 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb54ed2-0125-4aa9-a107-8a3271ea8895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:10.740537 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb54ed2-0125-4aa9-a107-8a3271ea8895 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:10.740813 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb54ed2-0125-4aa9-a107-8a3271ea8895 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:10.741084 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb54ed2-0125-4aa9-a107-8a3271ea8895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:10.751843 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb54ed2-0125-4aa9-a107-8a3271ea8895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:10.753300 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb54ed2-0125-4aa9-a107-8a3271ea8895 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:10.764344 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1175/2343] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:56:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:56:11.041320 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b829773-8026-4776-a255-6ca8c430c3b0 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:11.042796 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-0b829773-8026-4776-a255-6ca8c430c3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:11.055130 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b829773-8026-4776-a255-6ca8c430c3b0 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:11.061054 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b5902-b547-480b-b898-7f1fd27c2523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:11.061965 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b5902-b547-480b-b898-7f1fd27c2523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:11.062239 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b5902-b547-480b-b898-7f1fd27c2523 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:11.062508 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b5902-b547-480b-b898-7f1fd27c2523 admin admin] PATH_INFO: `/v3/projects/7913ff381df04ac98d04050cc479ebc8` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:11.063825 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b5902-b547-480b-b898-7f1fd27c2523 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7913ff381df04ac98d04050cc479ebc8)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:11.065841 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b5902-b547-480b-b898-7f1fd27c2523 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:11.117885 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-ad6b5902-b547-480b-b898-7f1fd27c2523 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7913ff381df04ac98d04050cc479ebc8', 'request_id': 'req-ad6b5902-b547-480b-b898-7f1fd27c2523'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:11.124381 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-ad6b5902-b547-480b-b898-7f1fd27c2523 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7913ff381df04ac98d04050cc479ebc8', 'request_id': 'req-ad6b5902-b547-480b-b898-7f1fd27c2523'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:11.134176 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-ad6b5902-b547-480b-b898-7f1fd27c2523 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7913ff381df04ac98d04050cc479ebc8', 'request_id': 'req-ad6b5902-b547-480b-b898-7f1fd27c2523'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:11.144548 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-ad6b5902-b547-480b-b898-7f1fd27c2523 admin admin] The token cache is being invalidate because project 7913ff381df04ac98d04050cc479ebc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:56:11.144832 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-ad6b5902-b547-480b-b898-7f1fd27c2523 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:11.145526 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-ad6b5902-b547-480b-b898-7f1fd27c2523 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:11.147070 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1169/2344] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:56:11 2022] DELETE /identity/v3/projects/7913ff381df04ac98d04050cc479ebc8 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:11.158533 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740db4e5-a436-4166-aee5-9ca762062c9d None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:11.158818 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740db4e5-a436-4166-aee5-9ca762062c9d None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:11.159113 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740db4e5-a436-4166-aee5-9ca762062c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:11.177041 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-740db4e5-a436-4166-aee5-9ca762062c9d None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:11.178296 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-740db4e5-a436-4166-aee5-9ca762062c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:11.238715 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1176/2345] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:11.248256 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03178794-e97e-432c-99f9-8b7e13a65237 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:11.248575 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03178794-e97e-432c-99f9-8b7e13a65237 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:11.248842 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03178794-e97e-432c-99f9-8b7e13a65237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:11.268665 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-03178794-e97e-432c-99f9-8b7e13a65237 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:11.269890 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-03178794-e97e-432c-99f9-8b7e13a65237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:11.278250 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1170/2346] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:11.282657 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740db4e5-a436-4166-aee5-9ca762062c9d None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:11.292681 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740db4e5-a436-4166-aee5-9ca762062c9d None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:11.298472 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f882762-bf7b-4134-b514-66a9643a85d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:11.299135 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f882762-bf7b-4134-b514-66a9643a85d2 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:11.299414 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f882762-bf7b-4134-b514-66a9643a85d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:11.299688 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f882762-bf7b-4134-b514-66a9643a85d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:11.300419 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f882762-bf7b-4134-b514-66a9643a85d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:56:11.300725 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f882762-bf7b-4134-b514-66a9643a85d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:11.302385 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f882762-bf7b-4134-b514-66a9643a85d2 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:11.314346 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1177/2347] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:56:11.318681 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03178794-e97e-432c-99f9-8b7e13a65237 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:11.328507 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03178794-e97e-432c-99f9-8b7e13a65237 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:11.333900 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e499643-8978-4fe9-a3cb-6c6bb2da8cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:11.334566 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e499643-8978-4fe9-a3cb-6c6bb2da8cac admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:11.334846 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e499643-8978-4fe9-a3cb-6c6bb2da8cac admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:11.335090 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e499643-8978-4fe9-a3cb-6c6bb2da8cac admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:11.335812 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e499643-8978-4fe9-a3cb-6c6bb2da8cac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:11.337703 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e499643-8978-4fe9-a3cb-6c6bb2da8cac admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:11.364195 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1171/2348] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:56:11 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:56:11.368679 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f882762-bf7b-4134-b514-66a9643a85d2 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:11.379618 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f882762-bf7b-4134-b514-66a9643a85d2 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:11.438880 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f534a-7bb5-4be1-931d-1e543d233f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:11.439553 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f534a-7bb5-4be1-931d-1e543d233f29 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:11.439819 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f534a-7bb5-4be1-931d-1e543d233f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:11.440086 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f534a-7bb5-4be1-931d-1e543d233f29 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:11.440759 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f534a-7bb5-4be1-931d-1e543d233f29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:11.442717 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f534a-7bb5-4be1-931d-1e543d233f29 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:11.463026 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1178/2349] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:56:11 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:56:11.467329 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e499643-8978-4fe9-a3cb-6c6bb2da8cac admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:11.477898 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e499643-8978-4fe9-a3cb-6c6bb2da8cac admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:11.483285 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b07c11-c68f-403b-b366-115de10eb0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:11.483945 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b07c11-c68f-403b-b366-115de10eb0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:11.484221 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b07c11-c68f-403b-b366-115de10eb0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:11.484501 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b07c11-c68f-403b-b366-115de10eb0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:11.485240 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b07c11-c68f-403b-b366-115de10eb0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:11.486876 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b07c11-c68f-403b-b366-115de10eb0a2 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:11.497591 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1172/2350] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:56:11.501708 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f534a-7bb5-4be1-931d-1e543d233f29 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:11.511791 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f534a-7bb5-4be1-931d-1e543d233f29 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:11.516761 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81a8163-07b2-4498-9046-9014f5cf001d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:11.517441 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a8163-07b2-4498-9046-9014f5cf001d admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:11.517714 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a8163-07b2-4498-9046-9014f5cf001d admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:11.517983 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a8163-07b2-4498-9046-9014f5cf001d admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:11.518701 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a8163-07b2-4498-9046-9014f5cf001d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:11.520283 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81a8163-07b2-4498-9046-9014f5cf001d admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:11.529904 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1179/2351] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:56:11.533983 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b07c11-c68f-403b-b366-115de10eb0a2 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:11.543919 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b07c11-c68f-403b-b366-115de10eb0a2 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:11.548740 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7dcac-2c24-450d-98c9-40d475257a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:11.549697 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7dcac-2c24-450d-98c9-40d475257a76 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:11.550004 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7dcac-2c24-450d-98c9-40d475257a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:11.550276 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7dcac-2c24-450d-98c9-40d475257a76 admin admin] PATH_INFO: `/v3/projects/571f2fd937e2400c9988ba4d10ac042d/users/b28ec72089c84f0485a45c2b83946927/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:11.564847 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7dcac-2c24-450d-98c9-40d475257a76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=571f2fd937e2400c9988ba4d10ac042d, user_id=b28ec72089c84f0485a45c2b83946927, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:11.567495 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7dcac-2c24-450d-98c9-40d475257a76 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:11.583249 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1173/2352] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:56:11 2022] PUT /identity/v3/projects/571f2fd937e2400c9988ba4d10ac042d/users/b28ec72089c84f0485a45c2b83946927/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:11.593882 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee7182-dab7-4877-90d2-d9a30d847171 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:11.594165 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee7182-dab7-4877-90d2-d9a30d847171 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:11.594467 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee7182-dab7-4877-90d2-d9a30d847171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:11.622830 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-34ee7182-dab7-4877-90d2-d9a30d847171 None None] MFA Rules not processed for user `b28ec72089c84f0485a45c2b83946927`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:11.623992 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-34ee7182-dab7-4877-90d2-d9a30d847171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:11.698828 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1180/2353] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:56:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:11.709645 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7dcac-2c24-450d-98c9-40d475257a76 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:11.711639 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-31d7dcac-2c24-450d-98c9-40d475257a76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:11.772653 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7dcac-2c24-450d-98c9-40d475257a76 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:11.776426 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a2f7a-5504-40d0-8782-84abffc03407 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:11.777072 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a2f7a-5504-40d0-8782-84abffc03407 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:11.777376 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a2f7a-5504-40d0-8782-84abffc03407 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:11.777661 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a2f7a-5504-40d0-8782-84abffc03407 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:11.786282 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a2f7a-5504-40d0-8782-84abffc03407 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:11.787739 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a2f7a-5504-40d0-8782-84abffc03407 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:11.797425 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1174/2354] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:56:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:56:32.136436 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee7182-dab7-4877-90d2-d9a30d847171 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:32.212182 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee7182-dab7-4877-90d2-d9a30d847171 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:32.216631 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16d690-a5a3-4479-9dd1-bedf2bcc0e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:32.217682 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16d690-a5a3-4479-9dd1-bedf2bcc0e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:32.218205 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16d690-a5a3-4479-9dd1-bedf2bcc0e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:32.218488 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f16d690-a5a3-4479-9dd1-bedf2bcc0e29 admin admin] PATH_INFO: `/v3/users/b28ec72089c84f0485a45c2b83946927` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:32.219871 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16d690-a5a3-4479-9dd1-bedf2bcc0e29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b28ec72089c84f0485a45c2b83946927)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:32.221840 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f16d690-a5a3-4479-9dd1-bedf2bcc0e29 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:32.291739 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8f16d690-a5a3-4479-9dd1-bedf2bcc0e29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b28ec72089c84f0485a45c2b83946927'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:32.292992 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8f16d690-a5a3-4479-9dd1-bedf2bcc0e29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b28ec72089c84f0485a45c2b83946927'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:32.303196 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8f16d690-a5a3-4479-9dd1-bedf2bcc0e29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b28ec72089c84f0485a45c2b83946927'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:32.319688 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8f16d690-a5a3-4479-9dd1-bedf2bcc0e29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b28ec72089c84f0485a45c2b83946927'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:32.334001 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8f16d690-a5a3-4479-9dd1-bedf2bcc0e29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b28ec72089c84f0485a45c2b83946927'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:32.341073 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1181/2355] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:56:32 2022] DELETE /identity/v3/users/b28ec72089c84f0485a45c2b83946927 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:32.347040 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf53a33-c9c3-492a-9d10-cb3994333778 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:32.347543 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf53a33-c9c3-492a-9d10-cb3994333778 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:32.347633 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf53a33-c9c3-492a-9d10-cb3994333778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:32.367712 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-1cf53a33-c9c3-492a-9d10-cb3994333778 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:32.369085 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-1cf53a33-c9c3-492a-9d10-cb3994333778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:32.434093 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1175/2356] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:32.443685 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16d690-a5a3-4479-9dd1-bedf2bcc0e29 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:32.445128 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-8f16d690-a5a3-4479-9dd1-bedf2bcc0e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:32.510500 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f16d690-a5a3-4479-9dd1-bedf2bcc0e29 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:32.514343 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aabaea-043b-4b9a-8b84-1efa4c27e58e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:32.514992 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aabaea-043b-4b9a-8b84-1efa4c27e58e service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:32.515269 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aabaea-043b-4b9a-8b84-1efa4c27e58e service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:32.515536 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aabaea-043b-4b9a-8b84-1efa4c27e58e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:32.524839 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aabaea-043b-4b9a-8b84-1efa4c27e58e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:32.526391 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aabaea-043b-4b9a-8b84-1efa4c27e58e service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:32.536309 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1182/2357] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:56:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:56:32.924297 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf53a33-c9c3-492a-9d10-cb3994333778 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:32.926079 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-1cf53a33-c9c3-492a-9d10-cb3994333778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:32.939376 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf53a33-c9c3-492a-9d10-cb3994333778 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:32.944730 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02587cad-3835-4d2c-9131-c9bf5929fb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:32.946002 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02587cad-3835-4d2c-9131-c9bf5929fb92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:32.946434 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02587cad-3835-4d2c-9131-c9bf5929fb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:32.946868 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02587cad-3835-4d2c-9131-c9bf5929fb92 admin admin] PATH_INFO: `/v3/projects/571f2fd937e2400c9988ba4d10ac042d` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:32.948265 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02587cad-3835-4d2c-9131-c9bf5929fb92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=571f2fd937e2400c9988ba4d10ac042d)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:32.950594 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02587cad-3835-4d2c-9131-c9bf5929fb92 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:33.011523 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-02587cad-3835-4d2c-9131-c9bf5929fb92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '571f2fd937e2400c9988ba4d10ac042d', 'request_id': 'req-02587cad-3835-4d2c-9131-c9bf5929fb92'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:33.053926 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-02587cad-3835-4d2c-9131-c9bf5929fb92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '571f2fd937e2400c9988ba4d10ac042d', 'request_id': 'req-02587cad-3835-4d2c-9131-c9bf5929fb92'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:33.067176 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-02587cad-3835-4d2c-9131-c9bf5929fb92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '571f2fd937e2400c9988ba4d10ac042d', 'request_id': 'req-02587cad-3835-4d2c-9131-c9bf5929fb92'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:33.086032 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-02587cad-3835-4d2c-9131-c9bf5929fb92 admin admin] The token cache is being invalidate because project 571f2fd937e2400c9988ba4d10ac042d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:56:33.086315 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-02587cad-3835-4d2c-9131-c9bf5929fb92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:33.086986 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-02587cad-3835-4d2c-9131-c9bf5929fb92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:33.088730 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1176/2358] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:56:32 2022] DELETE /identity/v3/projects/571f2fd937e2400c9988ba4d10ac042d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:33.094042 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dffc8-7882-4515-848c-968ae5a5cad6 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:33.094632 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dffc8-7882-4515-848c-968ae5a5cad6 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:33.095149 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dffc8-7882-4515-848c-968ae5a5cad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:33.131394 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-bc6dffc8-7882-4515-848c-968ae5a5cad6 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:33.133199 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-bc6dffc8-7882-4515-848c-968ae5a5cad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:33.216161 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1183/2359] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:33.224792 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c11ede-4d8b-4b9b-9926-1e765d4f802c None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:33.225187 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c11ede-4d8b-4b9b-9926-1e765d4f802c None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:33.225593 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c11ede-4d8b-4b9b-9926-1e765d4f802c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:33.273338 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-f0c11ede-4d8b-4b9b-9926-1e765d4f802c None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:33.279278 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f0c11ede-4d8b-4b9b-9926-1e765d4f802c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:33.301388 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1177/2360] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:33.302660 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dffc8-7882-4515-848c-968ae5a5cad6 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:33.323584 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dffc8-7882-4515-848c-968ae5a5cad6 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:33.329526 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe3fbf-fc75-4b88-b8bf-371051bb9e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:33.330894 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe3fbf-fc75-4b88-b8bf-371051bb9e01 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:33.331360 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe3fbf-fc75-4b88-b8bf-371051bb9e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:33.332261 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe3fbf-fc75-4b88-b8bf-371051bb9e01 admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:33.333341 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe3fbf-fc75-4b88-b8bf-371051bb9e01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:56:33.343177 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe3fbf-fc75-4b88-b8bf-371051bb9e01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:33.349668 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe3fbf-fc75-4b88-b8bf-371051bb9e01 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:33.380684 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1184/2361] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:56:33.385578 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c11ede-4d8b-4b9b-9926-1e765d4f802c None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:33.397086 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c11ede-4d8b-4b9b-9926-1e765d4f802c None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:33.402197 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436fa6c-da67-4c95-93db-1d4c7e149451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:33.403363 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436fa6c-da67-4c95-93db-1d4c7e149451 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:33.403798 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436fa6c-da67-4c95-93db-1d4c7e149451 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:33.404329 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436fa6c-da67-4c95-93db-1d4c7e149451 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:33.405205 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436fa6c-da67-4c95-93db-1d4c7e149451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:33.407621 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e436fa6c-da67-4c95-93db-1d4c7e149451 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:33.469666 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1178/2362] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:56:33 2022] POST /identity/v3/projects => generated 399 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:56:33.474033 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe3fbf-fc75-4b88-b8bf-371051bb9e01 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:33.492926 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe3fbf-fc75-4b88-b8bf-371051bb9e01 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:33.624741 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01fc4d-7a60-4ec6-b78f-2d1963aeacc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:33.626582 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01fc4d-7a60-4ec6-b78f-2d1963aeacc2 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:33.626962 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01fc4d-7a60-4ec6-b78f-2d1963aeacc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:33.627859 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01fc4d-7a60-4ec6-b78f-2d1963aeacc2 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:33.628859 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01fc4d-7a60-4ec6-b78f-2d1963aeacc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:33.632953 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c01fc4d-7a60-4ec6-b78f-2d1963aeacc2 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:33.666091 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1185/2363] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:56:33 2022] POST /identity/v3/users => generated 300 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:56:33.670373 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436fa6c-da67-4c95-93db-1d4c7e149451 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:33.688445 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e436fa6c-da67-4c95-93db-1d4c7e149451 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:33.695950 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bfac2-c81d-4349-8fb6-095910764b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:33.698397 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bfac2-c81d-4349-8fb6-095910764b96 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:33.698683 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bfac2-c81d-4349-8fb6-095910764b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:33.698958 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208bfac2-c81d-4349-8fb6-095910764b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:33.699709 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bfac2-c81d-4349-8fb6-095910764b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:33.701522 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208bfac2-c81d-4349-8fb6-095910764b96 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:33.716107 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1179/2364] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:56:33.719576 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01fc4d-7a60-4ec6-b78f-2d1963aeacc2 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:33.730378 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c01fc4d-7a60-4ec6-b78f-2d1963aeacc2 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:33.736917 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1694762-4da7-418d-9984-a437ef4d0a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:33.737730 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1694762-4da7-418d-9984-a437ef4d0a3c admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:33.738073 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1694762-4da7-418d-9984-a437ef4d0a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:33.738528 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1694762-4da7-418d-9984-a437ef4d0a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:33.741020 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1694762-4da7-418d-9984-a437ef4d0a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:33.742814 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1694762-4da7-418d-9984-a437ef4d0a3c admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:33.770660 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1186/2365] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:56:33.775152 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bfac2-c81d-4349-8fb6-095910764b96 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:33.787785 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208bfac2-c81d-4349-8fb6-095910764b96 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:33.795446 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443aec29-3106-47fb-8b95-f760d538f35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:33.796528 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443aec29-3106-47fb-8b95-f760d538f35f admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:33.797038 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443aec29-3106-47fb-8b95-f760d538f35f admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:33.797470 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443aec29-3106-47fb-8b95-f760d538f35f admin admin] PATH_INFO: `/v3/projects/4f0f0543aabf4593b4c62c7766752070/users/b7dff0da229d4549a0636c7784342fb3/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:33.842229 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443aec29-3106-47fb-8b95-f760d538f35f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0f0543aabf4593b4c62c7766752070, user_id=b7dff0da229d4549a0636c7784342fb3, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:33.848288 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443aec29-3106-47fb-8b95-f760d538f35f admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:33.885596 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1180/2366] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:56:33 2022] PUT /identity/v3/projects/4f0f0543aabf4593b4c62c7766752070/users/b7dff0da229d4549a0636c7784342fb3/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:33.895715 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42db92-623b-4fd8-a25e-e6295d8a16d7 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:33.896001 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42db92-623b-4fd8-a25e-e6295d8a16d7 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:33.896284 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42db92-623b-4fd8-a25e-e6295d8a16d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:33.924984 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-bf42db92-623b-4fd8-a25e-e6295d8a16d7 None None] MFA Rules not processed for user `b7dff0da229d4549a0636c7784342fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:33.926583 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-bf42db92-623b-4fd8-a25e-e6295d8a16d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:34.040899 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1187/2367] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:56:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:34.049227 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443aec29-3106-47fb-8b95-f760d538f35f admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:34.051556 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-443aec29-3106-47fb-8b95-f760d538f35f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:34.123095 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443aec29-3106-47fb-8b95-f760d538f35f admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:34.127408 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95437bfc-b213-4577-86cb-37ebbb3cbb05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:34.128067 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95437bfc-b213-4577-86cb-37ebbb3cbb05 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:34.128815 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95437bfc-b213-4577-86cb-37ebbb3cbb05 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:34.128815 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95437bfc-b213-4577-86cb-37ebbb3cbb05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:34.143881 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95437bfc-b213-4577-86cb-37ebbb3cbb05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:34.146261 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95437bfc-b213-4577-86cb-37ebbb3cbb05 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:34.158911 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1181/2368] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:56:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:56:35.271729 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42db92-623b-4fd8-a25e-e6295d8a16d7 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:35.273640 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-bf42db92-623b-4fd8-a25e-e6295d8a16d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:35.345119 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42db92-623b-4fd8-a25e-e6295d8a16d7 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:35.349659 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635105a0-5a32-4f99-a2d0-8155741ceaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:35.350536 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635105a0-5a32-4f99-a2d0-8155741ceaea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:35.350815 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635105a0-5a32-4f99-a2d0-8155741ceaea admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:35.351094 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635105a0-5a32-4f99-a2d0-8155741ceaea admin admin] PATH_INFO: `/v3/users/10bcf5583fad4a2ba06d7fa6c3dd517d` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:35.352283 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635105a0-5a32-4f99-a2d0-8155741ceaea admin admin] RBAC: Authorizing `identity:delete_user(user_id=10bcf5583fad4a2ba06d7fa6c3dd517d)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:35.354304 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635105a0-5a32-4f99-a2d0-8155741ceaea admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:35.399845 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-635105a0-5a32-4f99-a2d0-8155741ceaea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10bcf5583fad4a2ba06d7fa6c3dd517d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:35.400526 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-635105a0-5a32-4f99-a2d0-8155741ceaea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10bcf5583fad4a2ba06d7fa6c3dd517d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:35.408788 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-635105a0-5a32-4f99-a2d0-8155741ceaea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10bcf5583fad4a2ba06d7fa6c3dd517d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:35.415771 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-635105a0-5a32-4f99-a2d0-8155741ceaea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10bcf5583fad4a2ba06d7fa6c3dd517d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:35.428655 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-635105a0-5a32-4f99-a2d0-8155741ceaea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10bcf5583fad4a2ba06d7fa6c3dd517d'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:35.433896 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1188/2369] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:56:35 2022] DELETE /identity/v3/users/10bcf5583fad4a2ba06d7fa6c3dd517d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:35.613809 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95437bfc-b213-4577-86cb-37ebbb3cbb05 service cinder] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:35.625658 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95437bfc-b213-4577-86cb-37ebbb3cbb05 service cinder] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:35.683942 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d4bb1-706c-46e2-9251-f6747be62082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:35.684884 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d4bb1-706c-46e2-9251-f6747be62082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:35.685230 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d4bb1-706c-46e2-9251-f6747be62082 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:35.685588 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d4bb1-706c-46e2-9251-f6747be62082 admin admin] PATH_INFO: `/v3/projects/ec245e0430fa4153a547d63719aa4c44` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:35.686857 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d4bb1-706c-46e2-9251-f6747be62082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec245e0430fa4153a547d63719aa4c44)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:35.689049 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d4bb1-706c-46e2-9251-f6747be62082 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:35.743219 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a81d4bb1-706c-46e2-9251-f6747be62082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec245e0430fa4153a547d63719aa4c44', 'request_id': 'req-a81d4bb1-706c-46e2-9251-f6747be62082'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:35.749588 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a81d4bb1-706c-46e2-9251-f6747be62082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec245e0430fa4153a547d63719aa4c44', 'request_id': 'req-a81d4bb1-706c-46e2-9251-f6747be62082'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:35.759111 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a81d4bb1-706c-46e2-9251-f6747be62082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec245e0430fa4153a547d63719aa4c44', 'request_id': 'req-a81d4bb1-706c-46e2-9251-f6747be62082'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:35.777013 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a81d4bb1-706c-46e2-9251-f6747be62082 admin admin] The token cache is being invalidate because project ec245e0430fa4153a547d63719aa4c44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:56:35.777699 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a81d4bb1-706c-46e2-9251-f6747be62082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:35.778574 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a81d4bb1-706c-46e2-9251-f6747be62082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:35.780596 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1182/2370] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:56:35 2022] DELETE /identity/v3/projects/ec245e0430fa4153a547d63719aa4c44 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:35.786287 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083a394-7716-4768-9b40-c482c86bf443 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:35.786579 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083a394-7716-4768-9b40-c482c86bf443 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:35.786878 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083a394-7716-4768-9b40-c482c86bf443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:35.808787 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-6083a394-7716-4768-9b40-c482c86bf443 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:35.810042 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-6083a394-7716-4768-9b40-c482c86bf443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:35.877088 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7f20d-55d2-4862-8a19-4890c6ca2fcc None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:35.877400 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7f20d-55d2-4862-8a19-4890c6ca2fcc None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:35.877687 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7f20d-55d2-4862-8a19-4890c6ca2fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:35.894371 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1189/2371] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:35.899257 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-fef7f20d-55d2-4862-8a19-4890c6ca2fcc None None] MFA Rules not processed for user `3f7d37d467324d88ae189dc8d89c314a`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:35.900929 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-fef7f20d-55d2-4862-8a19-4890c6ca2fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:35.902484 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd540faa-3ad1-46aa-b2fa-aa18b5246b0f None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:35.902769 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd540faa-3ad1-46aa-b2fa-aa18b5246b0f None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:35.903047 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd540faa-3ad1-46aa-b2fa-aa18b5246b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:35.930554 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-bd540faa-3ad1-46aa-b2fa-aa18b5246b0f None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:35.931827 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-bd540faa-3ad1-46aa-b2fa-aa18b5246b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:35.941340 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1190/2372] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:56:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:56:35.945791 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd540faa-3ad1-46aa-b2fa-aa18b5246b0f None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:35.958595 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd540faa-3ad1-46aa-b2fa-aa18b5246b0f None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:35.976721 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394cf08a-3687-4c86-981b-3134167e0cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:35.977442 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cf08a-3687-4c86-981b-3134167e0cda admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:35.977730 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cf08a-3687-4c86-981b-3134167e0cda admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:35.977997 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cf08a-3687-4c86-981b-3134167e0cda admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:35.978756 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394cf08a-3687-4c86-981b-3134167e0cda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:56:35.979057 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394cf08a-3687-4c86-981b-3134167e0cda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:35.980681 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394cf08a-3687-4c86-981b-3134167e0cda admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:35.987313 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1183/2373] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:56:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:56:35.996010 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1191/2374] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:56:36.000372 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7f20d-55d2-4862-8a19-4890c6ca2fcc None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:36.012437 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7f20d-55d2-4862-8a19-4890c6ca2fcc None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:36.020804 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488560b-b235-4481-8388-4d4b5a54942d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:36.021915 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488560b-b235-4481-8388-4d4b5a54942d admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:36.022384 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488560b-b235-4481-8388-4d4b5a54942d admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:36.022877 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488560b-b235-4481-8388-4d4b5a54942d admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:36.023776 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488560b-b235-4481-8388-4d4b5a54942d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:36.025978 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488560b-b235-4481-8388-4d4b5a54942d admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:36.070212 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1184/2375] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:56:35 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:56:36.074358 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394cf08a-3687-4c86-981b-3134167e0cda admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:36.089925 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394cf08a-3687-4c86-981b-3134167e0cda admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:36.190594 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4edc2-0869-40fe-a8d9-cb21ea395637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:36.191198 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4edc2-0869-40fe-a8d9-cb21ea395637 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:36.191682 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4edc2-0869-40fe-a8d9-cb21ea395637 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:36.191856 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e4edc2-0869-40fe-a8d9-cb21ea395637 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:36.192445 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4edc2-0869-40fe-a8d9-cb21ea395637 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:36.194409 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e4edc2-0869-40fe-a8d9-cb21ea395637 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:36.216803 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1192/2376] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:56:36 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:56:36.220962 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488560b-b235-4481-8388-4d4b5a54942d admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:36.231479 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488560b-b235-4481-8388-4d4b5a54942d admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:36.236494 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206729da-5763-4013-81b3-21035df53d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:36.237233 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206729da-5763-4013-81b3-21035df53d3d admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:36.237599 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206729da-5763-4013-81b3-21035df53d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:36.237981 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206729da-5763-4013-81b3-21035df53d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:36.238906 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206729da-5763-4013-81b3-21035df53d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:36.240561 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206729da-5763-4013-81b3-21035df53d3d admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:36.252125 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1185/2377] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:56:36.255619 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4edc2-0869-40fe-a8d9-cb21ea395637 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:36.265521 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e4edc2-0869-40fe-a8d9-cb21ea395637 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:36.270287 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014f92d-fd5a-43ec-bfbc-aef80daf2eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:36.271140 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014f92d-fd5a-43ec-bfbc-aef80daf2eba admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:36.271261 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014f92d-fd5a-43ec-bfbc-aef80daf2eba admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:36.271484 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014f92d-fd5a-43ec-bfbc-aef80daf2eba admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:36.272270 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014f92d-fd5a-43ec-bfbc-aef80daf2eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:36.273918 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014f92d-fd5a-43ec-bfbc-aef80daf2eba admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:36.284090 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1193/2378] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:56:36.289149 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206729da-5763-4013-81b3-21035df53d3d admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:36.301029 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206729da-5763-4013-81b3-21035df53d3d admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:36.307579 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473218c2-61e0-451d-bf70-bda41528de18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:36.308523 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473218c2-61e0-451d-bf70-bda41528de18 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:36.308801 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473218c2-61e0-451d-bf70-bda41528de18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:36.309066 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473218c2-61e0-451d-bf70-bda41528de18 admin admin] PATH_INFO: `/v3/projects/34f980e7a3e94d7ca2edd7cf4e17633c/users/6861ddcf71654113915e209c1f34999b/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:36.326729 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473218c2-61e0-451d-bf70-bda41528de18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34f980e7a3e94d7ca2edd7cf4e17633c, user_id=6861ddcf71654113915e209c1f34999b, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:36.329933 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473218c2-61e0-451d-bf70-bda41528de18 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:36.346884 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1186/2379] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:56:36 2022] PUT /identity/v3/projects/34f980e7a3e94d7ca2edd7cf4e17633c/users/6861ddcf71654113915e209c1f34999b/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:56:36.352604 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df45e05-0676-4e3f-99dd-1ad75a11bd11 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:36.353370 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df45e05-0676-4e3f-99dd-1ad75a11bd11 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:36.353658 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df45e05-0676-4e3f-99dd-1ad75a11bd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:36.371791 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-9df45e05-0676-4e3f-99dd-1ad75a11bd11 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:36.373972 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-9df45e05-0676-4e3f-99dd-1ad75a11bd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:36.446461 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1194/2380] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:56:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:36.458305 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473218c2-61e0-451d-bf70-bda41528de18 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:36.460110 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-473218c2-61e0-451d-bf70-bda41528de18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:36.520746 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473218c2-61e0-451d-bf70-bda41528de18 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:36.525098 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09a0f5-e20d-499e-a138-88ffdcdac3ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:36.525788 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09a0f5-e20d-499e-a138-88ffdcdac3ee service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:36.526068 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09a0f5-e20d-499e-a138-88ffdcdac3ee service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:36.526347 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d09a0f5-e20d-499e-a138-88ffdcdac3ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:36.536696 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09a0f5-e20d-499e-a138-88ffdcdac3ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:36.538209 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d09a0f5-e20d-499e-a138-88ffdcdac3ee service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:36.548493 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1187/2381] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:56:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:56:40.964352 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64caed0-176b-408b-bbd3-23ec5251569d None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:40.964889 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64caed0-176b-408b-bbd3-23ec5251569d None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:40.965041 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64caed0-176b-408b-bbd3-23ec5251569d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:41.005871 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-d64caed0-176b-408b-bbd3-23ec5251569d None None] MFA Rules not processed for user `6861ddcf71654113915e209c1f34999b`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:41.007805 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-d64caed0-176b-408b-bbd3-23ec5251569d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:41.091703 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09a0f5-e20d-499e-a138-88ffdcdac3ee service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:41.097981 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1195/2382] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:56:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:41.102085 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d09a0f5-e20d-499e-a138-88ffdcdac3ee service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:41.107640 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d1b86-86b0-47af-baef-e5d9904aa870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:41.108612 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d1b86-86b0-47af-baef-e5d9904aa870 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:41.109067 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d1b86-86b0-47af-baef-e5d9904aa870 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:41.109575 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d1b86-86b0-47af-baef-e5d9904aa870 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:41.110495 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d1b86-86b0-47af-baef-e5d9904aa870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:41.112904 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d1b86-86b0-47af-baef-e5d9904aa870 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:41.146585 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1188/2383] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:56:41 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:56:41.147690 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64caed0-176b-408b-bbd3-23ec5251569d None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:41.159742 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64caed0-176b-408b-bbd3-23ec5251569d None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:41.220615 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad3830-9ba0-4bfd-b043-45d3b2756bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:41.221420 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad3830-9ba0-4bfd-b043-45d3b2756bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:41.221769 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad3830-9ba0-4bfd-b043-45d3b2756bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:41.222104 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad3830-9ba0-4bfd-b043-45d3b2756bc2 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:41.222921 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad3830-9ba0-4bfd-b043-45d3b2756bc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:41.224996 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad3830-9ba0-4bfd-b043-45d3b2756bc2 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:41.250490 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1196/2384] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:56:41 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:56:41.254883 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d1b86-86b0-47af-baef-e5d9904aa870 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:41.266435 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d1b86-86b0-47af-baef-e5d9904aa870 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:41.276351 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9d509-54a4-468f-a404-76a88bfc64c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:41.277232 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9d509-54a4-468f-a404-76a88bfc64c3 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:41.279904 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9d509-54a4-468f-a404-76a88bfc64c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:41.279904 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9d509-54a4-468f-a404-76a88bfc64c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:41.279904 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9d509-54a4-468f-a404-76a88bfc64c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:41.280410 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9d509-54a4-468f-a404-76a88bfc64c3 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:41.291699 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1189/2385] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:56:41.295711 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad3830-9ba0-4bfd-b043-45d3b2756bc2 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:41.305631 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad3830-9ba0-4bfd-b043-45d3b2756bc2 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:41.311855 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e427e98-1e26-49fb-97c1-5469a0f62811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:41.312758 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e427e98-1e26-49fb-97c1-5469a0f62811 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:41.313119 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e427e98-1e26-49fb-97c1-5469a0f62811 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:41.313294 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e427e98-1e26-49fb-97c1-5469a0f62811 admin admin] PATH_INFO: `/v3/projects/bb5d65b8049640b68446c765a4db82e4/users/e318ef345c7d46fc9aeb82bdcf519de8/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:41.329594 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e427e98-1e26-49fb-97c1-5469a0f62811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb5d65b8049640b68446c765a4db82e4, user_id=e318ef345c7d46fc9aeb82bdcf519de8, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:41.332570 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e427e98-1e26-49fb-97c1-5469a0f62811 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:41.349134 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1197/2386] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:56:41 2022] PUT /identity/v3/projects/bb5d65b8049640b68446c765a4db82e4/users/e318ef345c7d46fc9aeb82bdcf519de8/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:56:41.353367 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9d509-54a4-468f-a404-76a88bfc64c3 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:41.364575 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9d509-54a4-468f-a404-76a88bfc64c3 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:41.432681 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da440216-289e-425f-afd0-5f712e2c475b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:41.433726 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da440216-289e-425f-afd0-5f712e2c475b admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:41.434121 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da440216-289e-425f-afd0-5f712e2c475b admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:41.434493 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da440216-289e-425f-afd0-5f712e2c475b admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:41.435339 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da440216-289e-425f-afd0-5f712e2c475b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:41.437082 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da440216-289e-425f-afd0-5f712e2c475b admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:41.448792 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1190/2387] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:56:41.453221 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e427e98-1e26-49fb-97c1-5469a0f62811 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:41.474148 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e427e98-1e26-49fb-97c1-5469a0f62811 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:41.480570 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04319020-344e-4428-bdf1-96af309f8166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:41.481835 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04319020-344e-4428-bdf1-96af309f8166 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:41.482190 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04319020-344e-4428-bdf1-96af309f8166 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:41.482538 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04319020-344e-4428-bdf1-96af309f8166 admin admin] PATH_INFO: `/v3/projects/bb5d65b8049640b68446c765a4db82e4/users/e318ef345c7d46fc9aeb82bdcf519de8/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:41.484747 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04319020-344e-4428-bdf1-96af309f8166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb5d65b8049640b68446c765a4db82e4, user_id=e318ef345c7d46fc9aeb82bdcf519de8, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:41.487547 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04319020-344e-4428-bdf1-96af309f8166 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:41.511165 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1198/2388] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:56:41 2022] PUT /identity/v3/projects/bb5d65b8049640b68446c765a4db82e4/users/e318ef345c7d46fc9aeb82bdcf519de8/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:41.672051 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da440216-289e-425f-afd0-5f712e2c475b admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:41.674023 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-da440216-289e-425f-afd0-5f712e2c475b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:41.703461 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da440216-289e-425f-afd0-5f712e2c475b admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:41.838055 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb8e47-dc71-417f-9869-02556232a054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:41.839999 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb8e47-dc71-417f-9869-02556232a054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:41.844571 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb8e47-dc71-417f-9869-02556232a054 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:41.848663 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb8e47-dc71-417f-9869-02556232a054 admin admin] PATH_INFO: `/v3/users/b7dff0da229d4549a0636c7784342fb3` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:41.850631 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb8e47-dc71-417f-9869-02556232a054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7dff0da229d4549a0636c7784342fb3)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:41.852844 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb8e47-dc71-417f-9869-02556232a054 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:41.963562 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-9bcb8e47-dc71-417f-9869-02556232a054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7dff0da229d4549a0636c7784342fb3'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:41.964425 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-9bcb8e47-dc71-417f-9869-02556232a054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7dff0da229d4549a0636c7784342fb3'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:41.984113 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-9bcb8e47-dc71-417f-9869-02556232a054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7dff0da229d4549a0636c7784342fb3'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:42.008064 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-9bcb8e47-dc71-417f-9869-02556232a054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7dff0da229d4549a0636c7784342fb3'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:42.015397 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-9bcb8e47-dc71-417f-9869-02556232a054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7dff0da229d4549a0636c7784342fb3'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:42.027860 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1191/2389] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:56:41 2022] DELETE /identity/v3/users/b7dff0da229d4549a0636c7784342fb3 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:42.031015 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702ee3e-f52d-44a2-af7d-5221662dbc5a None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:42.031812 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702ee3e-f52d-44a2-af7d-5221662dbc5a None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:42.032347 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d702ee3e-f52d-44a2-af7d-5221662dbc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:42.058126 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-d702ee3e-f52d-44a2-af7d-5221662dbc5a None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:42.060565 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-d702ee3e-f52d-44a2-af7d-5221662dbc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:42.183734 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1199/2390] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:42.211235 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb8e47-dc71-417f-9869-02556232a054 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:42.213396 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-9bcb8e47-dc71-417f-9869-02556232a054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:42.308510 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb8e47-dc71-417f-9869-02556232a054 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:42.312673 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cbf35-7d6a-4785-86f9-f4efe426f24a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:42.313327 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cbf35-7d6a-4785-86f9-f4efe426f24a service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:42.313665 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cbf35-7d6a-4785-86f9-f4efe426f24a service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:42.313933 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cbf35-7d6a-4785-86f9-f4efe426f24a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:42.349157 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52cbf35-7d6a-4785-86f9-f4efe426f24a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:42.350922 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52cbf35-7d6a-4785-86f9-f4efe426f24a service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:42.370864 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1192/2391] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:56:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:56:42.945455 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702ee3e-f52d-44a2-af7d-5221662dbc5a None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:42.946939 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-d702ee3e-f52d-44a2-af7d-5221662dbc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:42.968556 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d702ee3e-f52d-44a2-af7d-5221662dbc5a None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:42.985695 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba225af-ed1b-4858-a757-049129349362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:42.986594 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba225af-ed1b-4858-a757-049129349362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:42.986877 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba225af-ed1b-4858-a757-049129349362 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:42.987150 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba225af-ed1b-4858-a757-049129349362 admin admin] PATH_INFO: `/v3/projects/4f0f0543aabf4593b4c62c7766752070` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:42.988703 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba225af-ed1b-4858-a757-049129349362 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f0f0543aabf4593b4c62c7766752070)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:42.991332 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba225af-ed1b-4858-a757-049129349362 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:43.082549 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-4ba225af-ed1b-4858-a757-049129349362 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f0f0543aabf4593b4c62c7766752070', 'request_id': 'req-4ba225af-ed1b-4858-a757-049129349362'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:43.092220 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-4ba225af-ed1b-4858-a757-049129349362 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f0f0543aabf4593b4c62c7766752070', 'request_id': 'req-4ba225af-ed1b-4858-a757-049129349362'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:43.126681 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-4ba225af-ed1b-4858-a757-049129349362 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f0f0543aabf4593b4c62c7766752070', 'request_id': 'req-4ba225af-ed1b-4858-a757-049129349362'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:43.147472 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-4ba225af-ed1b-4858-a757-049129349362 admin admin] The token cache is being invalidate because project 4f0f0543aabf4593b4c62c7766752070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:56:43.149243 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-4ba225af-ed1b-4858-a757-049129349362 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:43.150495 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-4ba225af-ed1b-4858-a757-049129349362 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:56:43.153301 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1200/2392] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:56:42 2022] DELETE /identity/v3/projects/4f0f0543aabf4593b4c62c7766752070 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:56:49.928850 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8429c61-6700-422c-bf0a-3bb7b308016f None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:49.929727 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8429c61-6700-422c-bf0a-3bb7b308016f None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:49.930170 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8429c61-6700-422c-bf0a-3bb7b308016f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:50.031073 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-d8429c61-6700-422c-bf0a-3bb7b308016f None None] MFA Rules not processed for user `e318ef345c7d46fc9aeb82bdcf519de8`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:50.032443 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-d8429c61-6700-422c-bf0a-3bb7b308016f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:50.129326 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1193/2393] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:56:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:50.142483 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba225af-ed1b-4858-a757-049129349362 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:56:50.146239 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-4ba225af-ed1b-4858-a757-049129349362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:50.271947 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba225af-ed1b-4858-a757-049129349362 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:56:50.288157 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40d2ca-e923-47f8-86b6-db55c0bce515 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:56:50.289293 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40d2ca-e923-47f8-86b6-db55c0bce515 service nova] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:50.290552 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40d2ca-e923-47f8-86b6-db55c0bce515 service nova] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:50.290991 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40d2ca-e923-47f8-86b6-db55c0bce515 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:50.293862 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-df40d2ca-e923-47f8-86b6-db55c0bce515 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:50.399767 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40d2ca-e923-47f8-86b6-db55c0bce515 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:56:50.401516 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40d2ca-e923-47f8-86b6-db55c0bce515 service nova] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:56:50.411873 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1201/2394] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:56:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:56:50.467761 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7d2d9-8e5a-43a8-973c-9a2e910f0610 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:50.468045 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7d2d9-8e5a-43a8-973c-9a2e910f0610 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:50.468326 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7d2d9-8e5a-43a8-973c-9a2e910f0610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:50.488644 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-dcd7d2d9-8e5a-43a8-973c-9a2e910f0610 None None] MFA Rules not processed for user `4f705be9921a4daabe961e170fe7efd2`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:50.490174 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-dcd7d2d9-8e5a-43a8-973c-9a2e910f0610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:50.562449 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1194/2395] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:56:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:52.434121 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a70ca-1909-4159-940e-adfd5fc647d6 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:52.434680 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a70ca-1909-4159-940e-adfd5fc647d6 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:52.434680 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a70ca-1909-4159-940e-adfd5fc647d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:52.456382 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-aa3a70ca-1909-4159-940e-adfd5fc647d6 None None] MFA Rules not processed for user `6861ddcf71654113915e209c1f34999b`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:52.457930 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-aa3a70ca-1909-4159-940e-adfd5fc647d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:52.465815 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1202/2396] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:56:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:56:53.782798 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820c195-b42f-423a-9699-3115e4110323 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:56:53.783276 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820c195-b42f-423a-9699-3115e4110323 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:56:53.783508 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820c195-b42f-423a-9699-3115e4110323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:56:53.826402 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-d820c195-b42f-423a-9699-3115e4110323 None None] MFA Rules not processed for user `14bb5a0d28894d4fb2642d00f0832cbf`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:56:53.827676 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-d820c195-b42f-423a-9699-3115e4110323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:56:54.020835 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1195/2397] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:56:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:57:03.224004 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdcc6a-ba71-4e24-b107-66c90a05254b None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:03.224454 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdcc6a-ba71-4e24-b107-66c90a05254b None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:03.224557 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdcc6a-ba71-4e24-b107-66c90a05254b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:03.242655 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-38cdcc6a-ba71-4e24-b107-66c90a05254b None None] MFA Rules not processed for user `817bcd2c5f6e4bceb049eeb122d4e432`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:57:03.243781 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-38cdcc6a-ba71-4e24-b107-66c90a05254b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:03.297790 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1203/2398] 10.222.0.18 () {58 vars in 967 bytes} [Tue Mar 8 13:57:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:57:03.357860 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820c195-b42f-423a-9699-3115e4110323 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:03.359606 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-d820c195-b42f-423a-9699-3115e4110323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:03.451603 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d820c195-b42f-423a-9699-3115e4110323 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:03.457127 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05806df-94c4-4888-9239-8e165aef38aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0f442666d0459aa9a34fc2f91228e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:03.457817 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05806df-94c4-4888-9239-8e165aef38aa service swift] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:03.458099 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05806df-94c4-4888-9239-8e165aef38aa service swift] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:03.458374 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05806df-94c4-4888-9239-8e165aef38aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:03.471664 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05806df-94c4-4888-9239-8e165aef38aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:03.473274 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05806df-94c4-4888-9239-8e165aef38aa service swift] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:03.484078 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1196/2399] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Mar 8 13:57:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 13:57:03.725613 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdcc6a-ba71-4e24-b107-66c90a05254b None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:03.727043 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-38cdcc6a-ba71-4e24-b107-66c90a05254b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:03.802558 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdcc6a-ba71-4e24-b107-66c90a05254b None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:03.806369 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dee22b-2dfe-4991-871f-007136ea0608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:03.807295 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dee22b-2dfe-4991-871f-007136ea0608 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:03.807635 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dee22b-2dfe-4991-871f-007136ea0608 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:03.807909 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dee22b-2dfe-4991-871f-007136ea0608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:03.811512 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-39dee22b-2dfe-4991-871f-007136ea0608 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:03.833249 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dee22b-2dfe-4991-871f-007136ea0608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:03.836044 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dee22b-2dfe-4991-871f-007136ea0608 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:03.856872 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1204/2400] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:57:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:57:06.489011 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05806df-94c4-4888-9239-8e165aef38aa service swift] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:06.491308 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-a05806df-94c4-4888-9239-8e165aef38aa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:06.514799 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05806df-94c4-4888-9239-8e165aef38aa service swift] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:06.520503 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0835a-4a2e-4117-9e3f-b31007329096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:06.521657 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0835a-4a2e-4117-9e3f-b31007329096 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:06.522161 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0835a-4a2e-4117-9e3f-b31007329096 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:06.523104 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0835a-4a2e-4117-9e3f-b31007329096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:06.525709 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-9db0835a-4a2e-4117-9e3f-b31007329096 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:06.541856 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db0835a-4a2e-4117-9e3f-b31007329096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:06.544658 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db0835a-4a2e-4117-9e3f-b31007329096 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:06.564494 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1197/2401] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:57:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:57:09.368057 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dee22b-2dfe-4991-871f-007136ea0608 service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:09.370093 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-39dee22b-2dfe-4991-871f-007136ea0608 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:09.470324 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dee22b-2dfe-4991-871f-007136ea0608 service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:09.479823 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79fff1-abf0-4afe-89c0-513c7c398a9e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2e8458589b45fa8c91b0d95840e45e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:09.480671 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79fff1-abf0-4afe-89c0-513c7c398a9e service placement] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:09.481020 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79fff1-abf0-4afe-89c0-513c7c398a9e service placement] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:09.481411 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c79fff1-abf0-4afe-89c0-513c7c398a9e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:09.483519 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-2c79fff1-abf0-4afe-89c0-513c7c398a9e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:09.500396 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79fff1-abf0-4afe-89c0-513c7c398a9e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:09.502631 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c79fff1-abf0-4afe-89c0-513c7c398a9e service placement] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:09.518289 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1205/2402] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:57:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:57:13.025115 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0835a-4a2e-4117-9e3f-b31007329096 service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:13.027884 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-9db0835a-4a2e-4117-9e3f-b31007329096 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:13.106835 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0835a-4a2e-4117-9e3f-b31007329096 service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:13.117577 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b93c48-78e0-4124-85b1-dd18fca1dfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:13.118508 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b93c48-78e0-4124-85b1-dd18fca1dfaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:13.118800 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b93c48-78e0-4124-85b1-dd18fca1dfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:13.119064 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b93c48-78e0-4124-85b1-dd18fca1dfaf admin admin] PATH_INFO: `/v3/users/e6055ea4298a492b8e49c11e70c8356f` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:13.120436 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b93c48-78e0-4124-85b1-dd18fca1dfaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6055ea4298a492b8e49c11e70c8356f)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:13.122441 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b93c48-78e0-4124-85b1-dd18fca1dfaf admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:13.174474 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-b5b93c48-78e0-4124-85b1-dd18fca1dfaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6055ea4298a492b8e49c11e70c8356f'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:13.175211 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-b5b93c48-78e0-4124-85b1-dd18fca1dfaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6055ea4298a492b8e49c11e70c8356f'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:13.185708 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-b5b93c48-78e0-4124-85b1-dd18fca1dfaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6055ea4298a492b8e49c11e70c8356f'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:13.198504 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-b5b93c48-78e0-4124-85b1-dd18fca1dfaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6055ea4298a492b8e49c11e70c8356f'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:13.205624 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-b5b93c48-78e0-4124-85b1-dd18fca1dfaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6055ea4298a492b8e49c11e70c8356f'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:13.215587 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1198/2403] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:57:13 2022] DELETE /identity/v3/users/e6055ea4298a492b8e49c11e70c8356f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:57:13.445184 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79fff1-abf0-4afe-89c0-513c7c398a9e service placement] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:13.466159 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c79fff1-abf0-4afe-89c0-513c7c398a9e service placement] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:13.542663 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbc11f-f089-4928-a205-b0b6f8bcc27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:13.543814 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbc11f-f089-4928-a205-b0b6f8bcc27f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:13.544244 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbc11f-f089-4928-a205-b0b6f8bcc27f admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:13.544765 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbc11f-f089-4928-a205-b0b6f8bcc27f admin admin] PATH_INFO: `/v3/projects/81fd0fd8a1cc499f8479307f01f32b24` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:13.546216 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbc11f-f089-4928-a205-b0b6f8bcc27f admin admin] RBAC: Authorizing `identity:delete_project(project_id=81fd0fd8a1cc499f8479307f01f32b24)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:13.548266 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbc11f-f089-4928-a205-b0b6f8bcc27f admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:13.595988 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-bbcbc11f-f089-4928-a205-b0b6f8bcc27f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81fd0fd8a1cc499f8479307f01f32b24', 'request_id': 'req-bbcbc11f-f089-4928-a205-b0b6f8bcc27f'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:13.602045 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-bbcbc11f-f089-4928-a205-b0b6f8bcc27f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81fd0fd8a1cc499f8479307f01f32b24', 'request_id': 'req-bbcbc11f-f089-4928-a205-b0b6f8bcc27f'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:13.610303 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-bbcbc11f-f089-4928-a205-b0b6f8bcc27f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81fd0fd8a1cc499f8479307f01f32b24', 'request_id': 'req-bbcbc11f-f089-4928-a205-b0b6f8bcc27f'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:13.621578 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-bbcbc11f-f089-4928-a205-b0b6f8bcc27f admin admin] The token cache is being invalidate because project 81fd0fd8a1cc499f8479307f01f32b24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:57:13.622015 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-bbcbc11f-f089-4928-a205-b0b6f8bcc27f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:13.623010 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-bbcbc11f-f089-4928-a205-b0b6f8bcc27f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:13.624907 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1206/2404] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:57:13 2022] DELETE /identity/v3/projects/81fd0fd8a1cc499f8479307f01f32b24 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:57:13.629311 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b93c48-78e0-4124-85b1-dd18fca1dfaf admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:13.631024 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-b5b93c48-78e0-4124-85b1-dd18fca1dfaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:13.645432 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b93c48-78e0-4124-85b1-dd18fca1dfaf admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:13.699521 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea3ab9-fb54-4be5-ae4d-bf39643fe3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:13.700392 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea3ab9-fb54-4be5-ae4d-bf39643fe3c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:13.700697 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea3ab9-fb54-4be5-ae4d-bf39643fe3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:13.700968 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eea3ab9-fb54-4be5-ae4d-bf39643fe3c3 admin admin] PATH_INFO: `/v3/users/d2ee2a69b50c4d8aa455b498dffcbbee` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:13.702178 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea3ab9-fb54-4be5-ae4d-bf39643fe3c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2ee2a69b50c4d8aa455b498dffcbbee)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:13.704100 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eea3ab9-fb54-4be5-ae4d-bf39643fe3c3 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:13.752148 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0eea3ab9-fb54-4be5-ae4d-bf39643fe3c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2ee2a69b50c4d8aa455b498dffcbbee'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:13.752810 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0eea3ab9-fb54-4be5-ae4d-bf39643fe3c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2ee2a69b50c4d8aa455b498dffcbbee'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:13.761596 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0eea3ab9-fb54-4be5-ae4d-bf39643fe3c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2ee2a69b50c4d8aa455b498dffcbbee'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:13.773312 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0eea3ab9-fb54-4be5-ae4d-bf39643fe3c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2ee2a69b50c4d8aa455b498dffcbbee'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:13.780914 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0eea3ab9-fb54-4be5-ae4d-bf39643fe3c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2ee2a69b50c4d8aa455b498dffcbbee'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:13.786936 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1199/2405] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:57:13 2022] DELETE /identity/v3/users/d2ee2a69b50c4d8aa455b498dffcbbee => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:57:13.964802 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbc11f-f089-4928-a205-b0b6f8bcc27f admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:13.966321 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-bbcbc11f-f089-4928-a205-b0b6f8bcc27f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:13.979597 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbc11f-f089-4928-a205-b0b6f8bcc27f admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:14.038880 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3affe9f-4e8d-4e66-9824-c41beefdf9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:14.039748 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3affe9f-4e8d-4e66-9824-c41beefdf9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:14.040027 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3affe9f-4e8d-4e66-9824-c41beefdf9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:14.040298 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3affe9f-4e8d-4e66-9824-c41beefdf9aa admin admin] PATH_INFO: `/v3/projects/ca627d4d3c3b4951a997a56a11eb118e` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:14.041552 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3affe9f-4e8d-4e66-9824-c41beefdf9aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca627d4d3c3b4951a997a56a11eb118e)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:14.043535 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3affe9f-4e8d-4e66-9824-c41beefdf9aa admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:14.097766 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-e3affe9f-4e8d-4e66-9824-c41beefdf9aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca627d4d3c3b4951a997a56a11eb118e', 'request_id': 'req-e3affe9f-4e8d-4e66-9824-c41beefdf9aa'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:14.104316 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-e3affe9f-4e8d-4e66-9824-c41beefdf9aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca627d4d3c3b4951a997a56a11eb118e', 'request_id': 'req-e3affe9f-4e8d-4e66-9824-c41beefdf9aa'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:14.114720 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-e3affe9f-4e8d-4e66-9824-c41beefdf9aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca627d4d3c3b4951a997a56a11eb118e', 'request_id': 'req-e3affe9f-4e8d-4e66-9824-c41beefdf9aa'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:14.126318 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-e3affe9f-4e8d-4e66-9824-c41beefdf9aa admin admin] The token cache is being invalidate because project ca627d4d3c3b4951a997a56a11eb118e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:57:14.126717 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-e3affe9f-4e8d-4e66-9824-c41beefdf9aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:14.127468 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-e3affe9f-4e8d-4e66-9824-c41beefdf9aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:57:14.129088 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1207/2406] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:57:13 2022] DELETE /identity/v3/projects/ca627d4d3c3b4951a997a56a11eb118e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:57:23.926040 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea3ab9-fb54-4be5-ae4d-bf39643fe3c3 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:23.927681 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-0eea3ab9-fb54-4be5-ae4d-bf39643fe3c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:23.988644 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eea3ab9-fb54-4be5-ae4d-bf39643fe3c3 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:24.047488 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53287b9-388a-4dad-9e34-3460d97cd91f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:24.048140 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53287b9-388a-4dad-9e34-3460d97cd91f service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:24.048424 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53287b9-388a-4dad-9e34-3460d97cd91f service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:24.048693 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53287b9-388a-4dad-9e34-3460d97cd91f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:24.050857 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-a53287b9-388a-4dad-9e34-3460d97cd91f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:24.060329 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53287b9-388a-4dad-9e34-3460d97cd91f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:24.061774 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53287b9-388a-4dad-9e34-3460d97cd91f service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:24.069938 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1200/2407] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:57:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:57:26.312545 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3affe9f-4e8d-4e66-9824-c41beefdf9aa admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:26.314139 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-e3affe9f-4e8d-4e66-9824-c41beefdf9aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:26.327634 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3affe9f-4e8d-4e66-9824-c41beefdf9aa admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:26.332219 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ef965-9c49-4512-989a-7a07945865f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:26.332863 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ef965-9c49-4512-989a-7a07945865f5 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:26.333147 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ef965-9c49-4512-989a-7a07945865f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:26.333481 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ef965-9c49-4512-989a-7a07945865f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:26.335363 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-877ef965-9c49-4512-989a-7a07945865f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:26.404859 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ef965-9c49-4512-989a-7a07945865f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:26.406343 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ef965-9c49-4512-989a-7a07945865f5 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:26.416163 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1208/2408] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:57:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:57:31.237731 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53287b9-388a-4dad-9e34-3460d97cd91f service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:31.239817 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-a53287b9-388a-4dad-9e34-3460d97cd91f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:31.327461 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53287b9-388a-4dad-9e34-3460d97cd91f service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:31.333838 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c154cb-1650-4371-887b-0a5794dfab91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:31.334480 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c154cb-1650-4371-887b-0a5794dfab91 service nova] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:31.334759 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c154cb-1650-4371-887b-0a5794dfab91 service nova] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:31.335030 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c154cb-1650-4371-887b-0a5794dfab91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:31.336985 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f5c154cb-1650-4371-887b-0a5794dfab91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:31.396858 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c154cb-1650-4371-887b-0a5794dfab91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:31.398475 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c154cb-1650-4371-887b-0a5794dfab91 service nova] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:31.408045 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1201/2409] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:57:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:57:47.783502 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ef965-9c49-4512-989a-7a07945865f5 service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:47.799348 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ef965-9c49-4512-989a-7a07945865f5 service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:47.806778 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac327c-27e4-4b2a-85df-0d7e54331bae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:47.807410 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac327c-27e4-4b2a-85df-0d7e54331bae service nova] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:47.807707 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac327c-27e4-4b2a-85df-0d7e54331bae service nova] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:47.808088 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac327c-27e4-4b2a-85df-0d7e54331bae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:47.810624 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-bcac327c-27e4-4b2a-85df-0d7e54331bae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:47.868796 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac327c-27e4-4b2a-85df-0d7e54331bae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:47.870512 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac327c-27e4-4b2a-85df-0d7e54331bae service nova] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:47.879527 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1209/2410] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:57:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:57:57.212250 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd261009-cf42-4d13-a669-0b9002bc05a0 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:57.212778 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd261009-cf42-4d13-a669-0b9002bc05a0 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:57.212881 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd261009-cf42-4d13-a669-0b9002bc05a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:57.229979 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-dd261009-cf42-4d13-a669-0b9002bc05a0 None None] MFA Rules not processed for user `817bcd2c5f6e4bceb049eeb122d4e432`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:57:57.231174 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-dd261009-cf42-4d13-a669-0b9002bc05a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:57.287050 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1202/2411] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Mar 8 13:57:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:57:57.300789 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac327c-27e4-4b2a-85df-0d7e54331bae service nova] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:57.302359 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-bcac327c-27e4-4b2a-85df-0d7e54331bae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:57.373536 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac327c-27e4-4b2a-85df-0d7e54331bae service nova] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:57.388392 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93599e8-f7e7-4049-ac04-16ffafa5c291 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0f442666d0459aa9a34fc2f91228e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:57.389115 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93599e8-f7e7-4049-ac04-16ffafa5c291 service swift] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:57.389847 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93599e8-f7e7-4049-ac04-16ffafa5c291 service swift] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:57.389847 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93599e8-f7e7-4049-ac04-16ffafa5c291 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:57.399129 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93599e8-f7e7-4049-ac04-16ffafa5c291 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:57.401103 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93599e8-f7e7-4049-ac04-16ffafa5c291 service swift] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:57.410253 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1210/2412] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Mar 8 13:57:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Mar 08 13:57:57.872036 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd261009-cf42-4d13-a669-0b9002bc05a0 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:57:57.887694 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd261009-cf42-4d13-a669-0b9002bc05a0 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:57:57.897225 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af4e9b-16aa-479a-a799-bed4f98fdfea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:57:57.898364 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af4e9b-16aa-479a-a799-bed4f98fdfea service nova] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:57:57.898851 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af4e9b-16aa-479a-a799-bed4f98fdfea service nova] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:57:57.899292 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af4e9b-16aa-479a-a799-bed4f98fdfea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:57:57.901327 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-17af4e9b-16aa-479a-a799-bed4f98fdfea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:57:57.917342 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af4e9b-16aa-479a-a799-bed4f98fdfea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:57:57.919519 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af4e9b-16aa-479a-a799-bed4f98fdfea service nova] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:57:57.949726 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1203/2413] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:57:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:58:10.935146 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bac93-86a8-4655-80d2-e631b41b73fc None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:10.935655 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bac93-86a8-4655-80d2-e631b41b73fc None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:10.935928 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bac93-86a8-4655-80d2-e631b41b73fc None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:10.938186 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1211/2414] 10.222.0.18 () {54 vars in 921 bytes} [Tue Mar 8 13:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:58:10.944535 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ac767-76ff-4b50-95d0-e8fda9fe0b33 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:10.945419 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ac767-76ff-4b50-95d0-e8fda9fe0b33 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:10.945974 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ac767-76ff-4b50-95d0-e8fda9fe0b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:10.968454 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-1a6ac767-76ff-4b50-95d0-e8fda9fe0b33 None None] MFA Rules not processed for user `21ec894123044d4382995791c74c587b`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:10.969991 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-1a6ac767-76ff-4b50-95d0-e8fda9fe0b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:10.985688 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1204/2415] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Mar 8 13:58:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:58:10.997368 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bac93-86a8-4655-80d2-e631b41b73fc None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:10.999160 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-3c0bac93-86a8-4655-80d2-e631b41b73fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:11.096293 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bac93-86a8-4655-80d2-e631b41b73fc None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:11.106859 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f8c5d-f4b4-43c4-b200-8776782be7e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b8e066deb49e6b48804cbbe5cd6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:11.107534 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f8c5d-f4b4-43c4-b200-8776782be7e5 service glance] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:11.107846 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f8c5d-f4b4-43c4-b200-8776782be7e5 service glance] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:11.108075 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f8c5d-f4b4-43c4-b200-8776782be7e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:11.119759 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f8c5d-f4b4-43c4-b200-8776782be7e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:11.121213 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f8c5d-f4b4-43c4-b200-8776782be7e5 service glance] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:11.132316 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1212/2416] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:58:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:58:11.201838 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10f35e-c010-4211-9390-c4c47bb67d9b None None] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:11.202127 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10f35e-c010-4211-9390-c4c47bb67d9b None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:11.202401 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10f35e-c010-4211-9390-c4c47bb67d9b None None] PATH_INFO: `/` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:11.205065 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1205/2417] 10.222.0.18 () {54 vars in 921 bytes} [Tue Mar 8 13:58:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:58:11.211182 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd5ce7-a15d-47f3-a50f-283d674f3ddf None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:11.211473 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd5ce7-a15d-47f3-a50f-283d674f3ddf None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:11.211736 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd5ce7-a15d-47f3-a50f-283d674f3ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:11.238231 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-2dcd5ce7-a15d-47f3-a50f-283d674f3ddf None None] MFA Rules not processed for user `4c610d719b3049f98b95cc8e9bd56834`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:11.239781 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-2dcd5ce7-a15d-47f3-a50f-283d674f3ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:11.247222 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1213/2418] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Mar 8 13:58:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Mar 08 13:58:11.261630 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10f35e-c010-4211-9390-c4c47bb67d9b None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:11.261630 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-bd10f35e-c010-4211-9390-c4c47bb67d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:11.274814 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10f35e-c010-4211-9390-c4c47bb67d9b None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:11.278276 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6345c31a-3f21-4329-aad1-4cdf0445eee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:11.278931 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345c31a-3f21-4329-aad1-4cdf0445eee8 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:11.279230 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345c31a-3f21-4329-aad1-4cdf0445eee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:11.279495 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6345c31a-3f21-4329-aad1-4cdf0445eee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:11.286552 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345c31a-3f21-4329-aad1-4cdf0445eee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:11.287959 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6345c31a-3f21-4329-aad1-4cdf0445eee8 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:11.295597 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1206/2419] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:58:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:58:11.399832 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed1eb7-9573-442b-936c-dbd5ee8a9330 None None] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:11.400117 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed1eb7-9573-442b-936c-dbd5ee8a9330 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:11.400390 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed1eb7-9573-442b-936c-dbd5ee8a9330 None None] PATH_INFO: `/` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:11.402222 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1214/2420] 10.222.0.18 () {54 vars in 921 bytes} [Tue Mar 8 13:58:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Mar 08 13:58:11.407858 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f2256-3ba3-45d2-8875-8d9b8a0eb4c5 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:11.408138 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f2256-3ba3-45d2-8875-8d9b8a0eb4c5 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:11.408405 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f2256-3ba3-45d2-8875-8d9b8a0eb4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:11.428207 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-c82f2256-3ba3-45d2-8875-8d9b8a0eb4c5 None None] MFA Rules not processed for user `21ec894123044d4382995791c74c587b`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:11.429388 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-c82f2256-3ba3-45d2-8875-8d9b8a0eb4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:11.440283 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1207/2421] 10.222.0.18 () {58 vars in 1018 bytes} [Tue Mar 8 13:58:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:58:11.451076 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed1eb7-9573-442b-936c-dbd5ee8a9330 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:11.464077 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed1eb7-9573-442b-936c-dbd5ee8a9330 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:11.468378 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc768220-cea4-410c-a151-7c8f11203e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:11.469068 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc768220-cea4-410c-a151-7c8f11203e61 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:11.469371 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc768220-cea4-410c-a151-7c8f11203e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:11.469664 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc768220-cea4-410c-a151-7c8f11203e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:11.480623 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc768220-cea4-410c-a151-7c8f11203e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:11.482120 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc768220-cea4-410c-a151-7c8f11203e61 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:11.493163 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1215/2422] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:58:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:58:12.952844 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f2256-3ba3-45d2-8875-8d9b8a0eb4c5 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:12.972194 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f2256-3ba3-45d2-8875-8d9b8a0eb4c5 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:12.994414 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da661b-f197-4a4a-b9c6-548c0839c6cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:12.995504 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da661b-f197-4a4a-b9c6-548c0839c6cb service nova] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:12.995789 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da661b-f197-4a4a-b9c6-548c0839c6cb service nova] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:12.996064 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da661b-f197-4a4a-b9c6-548c0839c6cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:12.998358 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f6da661b-f197-4a4a-b9c6-548c0839c6cb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:13.012570 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da661b-f197-4a4a-b9c6-548c0839c6cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:13.014342 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da661b-f197-4a4a-b9c6-548c0839c6cb service nova] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:13.033713 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1208/2423] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:58:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:58:13.330294 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee4c63-7cfe-482c-b2f7-cd1f5b80502a None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:13.330779 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee4c63-7cfe-482c-b2f7-cd1f5b80502a None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:13.330882 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adee4c63-7cfe-482c-b2f7-cd1f5b80502a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:13.349581 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-adee4c63-7cfe-482c-b2f7-cd1f5b80502a None None] MFA Rules not processed for user `817bcd2c5f6e4bceb049eeb122d4e432`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:13.350783 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-adee4c63-7cfe-482c-b2f7-cd1f5b80502a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:13.358943 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1216/2424] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Mar 8 13:58:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:58:13.371309 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da661b-f197-4a4a-b9c6-548c0839c6cb service nova] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:13.385064 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da661b-f197-4a4a-b9c6-548c0839c6cb service nova] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:13.391575 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b6f58-74a3-46d1-9f05-9da21083bb4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0f442666d0459aa9a34fc2f91228e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:13.392223 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b6f58-74a3-46d1-9f05-9da21083bb4a service swift] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:13.392499 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b6f58-74a3-46d1-9f05-9da21083bb4a service swift] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:13.392776 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b6f58-74a3-46d1-9f05-9da21083bb4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:13.401552 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b6f58-74a3-46d1-9f05-9da21083bb4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:13.403114 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b6f58-74a3-46d1-9f05-9da21083bb4a service swift] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:13.412497 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1209/2425] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Mar 8 13:58:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 13:58:16.826851 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d008d-af68-4be7-ad17-c0075214aa8b None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:16.827492 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d008d-af68-4be7-ad17-c0075214aa8b None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:16.827591 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d008d-af68-4be7-ad17-c0075214aa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:16.852007 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-366d008d-af68-4be7-ad17-c0075214aa8b None None] MFA Rules not processed for user `4f705be9921a4daabe961e170fe7efd2`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:16.854414 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-366d008d-af68-4be7-ad17-c0075214aa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:16.922631 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1217/2426] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:58:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:58:17.267167 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b6f58-74a3-46d1-9f05-9da21083bb4a service swift] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:17.278311 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b6f58-74a3-46d1-9f05-9da21083bb4a service swift] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:17.282830 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26965031-cb63-4761-a5cb-8061c51a5f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:17.283498 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26965031-cb63-4761-a5cb-8061c51a5f27 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:17.283849 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26965031-cb63-4761-a5cb-8061c51a5f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:17.284049 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26965031-cb63-4761-a5cb-8061c51a5f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:17.285896 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-26965031-cb63-4761-a5cb-8061c51a5f27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:17.297585 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26965031-cb63-4761-a5cb-8061c51a5f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:17.299026 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26965031-cb63-4761-a5cb-8061c51a5f27 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:17.307918 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1210/2427] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:58:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:58:21.066914 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d008d-af68-4be7-ad17-c0075214aa8b None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:21.069077 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-366d008d-af68-4be7-ad17-c0075214aa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:21.086458 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d008d-af68-4be7-ad17-c0075214aa8b None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:21.092882 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d081e9-24e7-40e7-acf5-b246f7d548b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:21.093744 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d081e9-24e7-40e7-acf5-b246f7d548b6 service nova] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:21.094018 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d081e9-24e7-40e7-acf5-b246f7d548b6 service nova] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:21.094339 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d081e9-24e7-40e7-acf5-b246f7d548b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:21.096651 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-24d081e9-24e7-40e7-acf5-b246f7d548b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:21.108862 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d081e9-24e7-40e7-acf5-b246f7d548b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:21.110531 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d081e9-24e7-40e7-acf5-b246f7d548b6 service nova] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:21.119722 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1218/2428] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:58:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:58:24.697067 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26965031-cb63-4761-a5cb-8061c51a5f27 service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:24.744184 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26965031-cb63-4761-a5cb-8061c51a5f27 service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:24.778806 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c374a-7f9c-4d66-a986-bec12cdfdc1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:24.786837 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c374a-7f9c-4d66-a986-bec12cdfdc1c service nova] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:24.793412 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c374a-7f9c-4d66-a986-bec12cdfdc1c service nova] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:24.793412 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c374a-7f9c-4d66-a986-bec12cdfdc1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:24.796050 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-c16c374a-7f9c-4d66-a986-bec12cdfdc1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:24.835958 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c374a-7f9c-4d66-a986-bec12cdfdc1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:24.838400 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16c374a-7f9c-4d66-a986-bec12cdfdc1c service nova] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:24.897563 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1211/2429] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:58:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:58:29.463731 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32673205-a3a7-4894-aabd-2b358c70a299 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:29.464708 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32673205-a3a7-4894-aabd-2b358c70a299 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:29.464708 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32673205-a3a7-4894-aabd-2b358c70a299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:29.486807 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-32673205-a3a7-4894-aabd-2b358c70a299 None None] MFA Rules not processed for user `817bcd2c5f6e4bceb049eeb122d4e432`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:29.487834 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-32673205-a3a7-4894-aabd-2b358c70a299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:29.495391 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1219/2430] 10.222.0.18 () {58 vars in 967 bytes} [Tue Mar 8 13:58:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:58:29.508274 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c374a-7f9c-4d66-a986-bec12cdfdc1c service nova] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:29.520005 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16c374a-7f9c-4d66-a986-bec12cdfdc1c service nova] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:29.525323 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fef75a-1eb1-49c9-be78-0a63e502377f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0f442666d0459aa9a34fc2f91228e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:29.525989 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fef75a-1eb1-49c9-be78-0a63e502377f service swift] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:29.526336 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fef75a-1eb1-49c9-be78-0a63e502377f service swift] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:29.526606 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fef75a-1eb1-49c9-be78-0a63e502377f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:29.535299 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fef75a-1eb1-49c9-be78-0a63e502377f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:29.536890 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fef75a-1eb1-49c9-be78-0a63e502377f service swift] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:29.545576 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1212/2431] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Mar 8 13:58:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 13:58:30.603222 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32673205-a3a7-4894-aabd-2b358c70a299 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:30.612425 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32673205-a3a7-4894-aabd-2b358c70a299 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:30.616075 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a0935-38b0-44a4-a2e2-08c4b0252e3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:30.616712 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a0935-38b0-44a4-a2e2-08c4b0252e3d service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:30.616988 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a0935-38b0-44a4-a2e2-08c4b0252e3d service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:30.617261 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a0935-38b0-44a4-a2e2-08c4b0252e3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:30.619011 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-7b4a0935-38b0-44a4-a2e2-08c4b0252e3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:30.683428 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a0935-38b0-44a4-a2e2-08c4b0252e3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:30.685501 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a0935-38b0-44a4-a2e2-08c4b0252e3d service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:30.697032 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1220/2432] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:58:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:58:35.225926 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fef75a-1eb1-49c9-be78-0a63e502377f service swift] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:35.227401 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-e7fef75a-1eb1-49c9-be78-0a63e502377f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:35.241182 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fef75a-1eb1-49c9-be78-0a63e502377f service swift] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:35.254238 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761b367-0c24-4f86-848a-6054f636bf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:35.255142 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761b367-0c24-4f86-848a-6054f636bf3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:35.255421 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761b367-0c24-4f86-848a-6054f636bf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:35.255836 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761b367-0c24-4f86-848a-6054f636bf3d admin admin] PATH_INFO: `/v3/users/14bb5a0d28894d4fb2642d00f0832cbf` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:35.257041 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761b367-0c24-4f86-848a-6054f636bf3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=14bb5a0d28894d4fb2642d00f0832cbf)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:35.259188 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761b367-0c24-4f86-848a-6054f636bf3d admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:35.306539 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-e761b367-0c24-4f86-848a-6054f636bf3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14bb5a0d28894d4fb2642d00f0832cbf'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:35.307212 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-e761b367-0c24-4f86-848a-6054f636bf3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14bb5a0d28894d4fb2642d00f0832cbf'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:35.316592 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-e761b367-0c24-4f86-848a-6054f636bf3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14bb5a0d28894d4fb2642d00f0832cbf'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:35.337256 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-e761b367-0c24-4f86-848a-6054f636bf3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14bb5a0d28894d4fb2642d00f0832cbf'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:35.344662 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-e761b367-0c24-4f86-848a-6054f636bf3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14bb5a0d28894d4fb2642d00f0832cbf'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:35.351195 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1213/2433] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:58:35 2022] DELETE /identity/v3/users/14bb5a0d28894d4fb2642d00f0832cbf => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:35.527138 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a0935-38b0-44a4-a2e2-08c4b0252e3d service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:35.542982 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a0935-38b0-44a4-a2e2-08c4b0252e3d service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:35.608769 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b25562-9f86-4a95-a02b-83134245c8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:35.609676 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b25562-9f86-4a95-a02b-83134245c8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:35.609962 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b25562-9f86-4a95-a02b-83134245c8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:35.610234 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b25562-9f86-4a95-a02b-83134245c8ca admin admin] PATH_INFO: `/v3/projects/e3f5752b78974423ab169a772d26d27a` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:35.611467 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b25562-9f86-4a95-a02b-83134245c8ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3f5752b78974423ab169a772d26d27a)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:35.613402 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b25562-9f86-4a95-a02b-83134245c8ca admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:35.660121 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-08b25562-9f86-4a95-a02b-83134245c8ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3f5752b78974423ab169a772d26d27a', 'request_id': 'req-08b25562-9f86-4a95-a02b-83134245c8ca'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:35.666153 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-08b25562-9f86-4a95-a02b-83134245c8ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3f5752b78974423ab169a772d26d27a', 'request_id': 'req-08b25562-9f86-4a95-a02b-83134245c8ca'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:35.676376 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-08b25562-9f86-4a95-a02b-83134245c8ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3f5752b78974423ab169a772d26d27a', 'request_id': 'req-08b25562-9f86-4a95-a02b-83134245c8ca'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:35.687374 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-08b25562-9f86-4a95-a02b-83134245c8ca admin admin] The token cache is being invalidate because project e3f5752b78974423ab169a772d26d27a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:58:35.687655 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-08b25562-9f86-4a95-a02b-83134245c8ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:35.688283 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-08b25562-9f86-4a95-a02b-83134245c8ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:35.690689 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1221/2434] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:58:35 2022] DELETE /identity/v3/projects/e3f5752b78974423ab169a772d26d27a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:35.697617 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83919c34-3d74-4d59-ac2f-3226c97fc4f2 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:35.697909 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83919c34-3d74-4d59-ac2f-3226c97fc4f2 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:35.698209 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83919c34-3d74-4d59-ac2f-3226c97fc4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:35.718775 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-83919c34-3d74-4d59-ac2f-3226c97fc4f2 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:35.719962 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-83919c34-3d74-4d59-ac2f-3226c97fc4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:35.780606 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1214/2435] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:58:35.789796 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52c94c-9187-4392-b548-f876ed317268 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:35.790081 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52c94c-9187-4392-b548-f876ed317268 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:35.790356 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52c94c-9187-4392-b548-f876ed317268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:35.808587 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-3e52c94c-9187-4392-b548-f876ed317268 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:35.809801 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-3e52c94c-9187-4392-b548-f876ed317268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:35.818261 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1222/2436] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:58:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:58:35.822634 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83919c34-3d74-4d59-ac2f-3226c97fc4f2 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:35.832549 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83919c34-3d74-4d59-ac2f-3226c97fc4f2 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:35.839202 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5496e-4d34-4adf-a325-2f95bb871cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:35.839927 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5496e-4d34-4adf-a325-2f95bb871cda admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:35.840203 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5496e-4d34-4adf-a325-2f95bb871cda admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:35.840614 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5496e-4d34-4adf-a325-2f95bb871cda admin admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:35.841409 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5496e-4d34-4adf-a325-2f95bb871cda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:58:35.841851 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5496e-4d34-4adf-a325-2f95bb871cda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:35.843485 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5496e-4d34-4adf-a325-2f95bb871cda admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:35.855549 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1215/2437] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:58:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:58:35.859943 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52c94c-9187-4392-b548-f876ed317268 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:35.869744 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52c94c-9187-4392-b548-f876ed317268 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:35.875721 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba8197-b22a-4528-9c43-228f2dec0d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:35.876416 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba8197-b22a-4528-9c43-228f2dec0d86 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:35.876700 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba8197-b22a-4528-9c43-228f2dec0d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:35.876988 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba8197-b22a-4528-9c43-228f2dec0d86 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:35.877709 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba8197-b22a-4528-9c43-228f2dec0d86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:35.879611 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba8197-b22a-4528-9c43-228f2dec0d86 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:35.921734 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1223/2438] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:58:35 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:58:35.926482 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5496e-4d34-4adf-a325-2f95bb871cda admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:35.951493 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5496e-4d34-4adf-a325-2f95bb871cda admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:36.015401 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9c56f-6cb7-4a4c-ac6c-0b39d039833b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:36.016098 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9c56f-6cb7-4a4c-ac6c-0b39d039833b admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:36.016379 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9c56f-6cb7-4a4c-ac6c-0b39d039833b admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:36.016652 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9c56f-6cb7-4a4c-ac6c-0b39d039833b admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:36.017373 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9c56f-6cb7-4a4c-ac6c-0b39d039833b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:36.019303 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9c56f-6cb7-4a4c-ac6c-0b39d039833b admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:36.043116 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1216/2439] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:58:35 2022] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:58:36.047895 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba8197-b22a-4528-9c43-228f2dec0d86 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:36.061230 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba8197-b22a-4528-9c43-228f2dec0d86 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:36.066632 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e3965-a755-4f6f-84f6-79aecaf09441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:36.067279 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e3965-a755-4f6f-84f6-79aecaf09441 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:36.067583 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e3965-a755-4f6f-84f6-79aecaf09441 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:36.067857 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e3965-a755-4f6f-84f6-79aecaf09441 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:36.068587 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e3965-a755-4f6f-84f6-79aecaf09441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:36.070233 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77e3965-a755-4f6f-84f6-79aecaf09441 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:36.080300 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1224/2440] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:58:36.084479 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9c56f-6cb7-4a4c-ac6c-0b39d039833b admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:36.095424 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9c56f-6cb7-4a4c-ac6c-0b39d039833b admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:36.100716 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e00bd6-95cf-45d9-8640-3d21908d5d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:36.101385 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e00bd6-95cf-45d9-8640-3d21908d5d35 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:36.101676 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e00bd6-95cf-45d9-8640-3d21908d5d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:36.101927 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e00bd6-95cf-45d9-8640-3d21908d5d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:36.102644 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e00bd6-95cf-45d9-8640-3d21908d5d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:36.104206 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e00bd6-95cf-45d9-8640-3d21908d5d35 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:36.114054 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1217/2441] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:58:36.120102 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e3965-a755-4f6f-84f6-79aecaf09441 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:36.136016 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e3965-a755-4f6f-84f6-79aecaf09441 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:36.142676 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf025d-a0cd-434a-b08d-7cf962c9af64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:36.143549 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf025d-a0cd-434a-b08d-7cf962c9af64 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:36.143778 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf025d-a0cd-434a-b08d-7cf962c9af64 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:36.144071 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf025d-a0cd-434a-b08d-7cf962c9af64 admin admin] PATH_INFO: `/v3/projects/a967f4ba13b74307b10cc26ea07dda4a/users/8569039b69f24975a4b4c3de24c408ef/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:36.159657 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf025d-a0cd-434a-b08d-7cf962c9af64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a967f4ba13b74307b10cc26ea07dda4a, user_id=8569039b69f24975a4b4c3de24c408ef, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:36.162316 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf025d-a0cd-434a-b08d-7cf962c9af64 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:36.178128 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1225/2442] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:58:36 2022] PUT /identity/v3/projects/a967f4ba13b74307b10cc26ea07dda4a/users/8569039b69f24975a4b4c3de24c408ef/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:36.192315 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a3f70-6f37-4080-807a-c5d28f7631bf None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:36.192600 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a3f70-6f37-4080-807a-c5d28f7631bf None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:36.192905 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a3f70-6f37-4080-807a-c5d28f7631bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:36.220610 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-6b4a3f70-6f37-4080-807a-c5d28f7631bf None None] MFA Rules not processed for user `8569039b69f24975a4b4c3de24c408ef`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:36.221853 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-6b4a3f70-6f37-4080-807a-c5d28f7631bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:36.286891 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1218/2443] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:58:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:58:36.291572 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf025d-a0cd-434a-b08d-7cf962c9af64 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:36.351591 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf025d-a0cd-434a-b08d-7cf962c9af64 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:36.356258 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6642d1-8c11-4a73-a38e-58193b45ec4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:36.356906 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6642d1-8c11-4a73-a38e-58193b45ec4c admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:36.357182 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6642d1-8c11-4a73-a38e-58193b45ec4c admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:36.357481 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6642d1-8c11-4a73-a38e-58193b45ec4c admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:36.358160 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6642d1-8c11-4a73-a38e-58193b45ec4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:36.360074 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6642d1-8c11-4a73-a38e-58193b45ec4c admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:36.386460 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1226/2444] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:58:36 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:58:36.390534 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a3f70-6f37-4080-807a-c5d28f7631bf None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:36.401103 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a3f70-6f37-4080-807a-c5d28f7631bf None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:36.463236 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b7e54-c3bc-4888-9aa6-78ad75f8c986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:36.463912 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b7e54-c3bc-4888-9aa6-78ad75f8c986 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:36.464196 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b7e54-c3bc-4888-9aa6-78ad75f8c986 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:36.464462 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b7e54-c3bc-4888-9aa6-78ad75f8c986 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:36.465152 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b7e54-c3bc-4888-9aa6-78ad75f8c986 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:36.467095 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b7e54-c3bc-4888-9aa6-78ad75f8c986 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:36.488782 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1219/2445] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:58:36 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:58:36.492915 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6642d1-8c11-4a73-a38e-58193b45ec4c admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:36.503478 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6642d1-8c11-4a73-a38e-58193b45ec4c admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:36.508571 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a91a4-2343-4cd2-97b3-4b5502ca6f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:36.509234 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a91a4-2343-4cd2-97b3-4b5502ca6f56 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:36.509554 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a91a4-2343-4cd2-97b3-4b5502ca6f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:36.509813 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a91a4-2343-4cd2-97b3-4b5502ca6f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:36.510540 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a91a4-2343-4cd2-97b3-4b5502ca6f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:36.512160 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a91a4-2343-4cd2-97b3-4b5502ca6f56 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:36.522738 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1227/2446] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:58:36.527195 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b7e54-c3bc-4888-9aa6-78ad75f8c986 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:36.537703 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b7e54-c3bc-4888-9aa6-78ad75f8c986 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:36.543791 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0672eb2-7d48-4533-9861-7cc6babb6a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:36.544706 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0672eb2-7d48-4533-9861-7cc6babb6a3a admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:36.544981 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0672eb2-7d48-4533-9861-7cc6babb6a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:36.545247 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0672eb2-7d48-4533-9861-7cc6babb6a3a admin admin] PATH_INFO: `/v3/projects/42066199e5234563b71a51a295413cdf/users/7d3011a786614511acb6f8c6dae3cd3f/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:36.561163 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0672eb2-7d48-4533-9861-7cc6babb6a3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=42066199e5234563b71a51a295413cdf, user_id=7d3011a786614511acb6f8c6dae3cd3f, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:36.563964 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0672eb2-7d48-4533-9861-7cc6babb6a3a admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:36.578764 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1220/2447] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:58:36 2022] PUT /identity/v3/projects/42066199e5234563b71a51a295413cdf/users/7d3011a786614511acb6f8c6dae3cd3f/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:36.582874 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a91a4-2343-4cd2-97b3-4b5502ca6f56 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:36.593990 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a91a4-2343-4cd2-97b3-4b5502ca6f56 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:36.652712 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a7000-2ac7-43f4-89f6-6b47b5bb4ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:36.653295 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a7000-2ac7-43f4-89f6-6b47b5bb4ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:36.653605 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a7000-2ac7-43f4-89f6-6b47b5bb4ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:36.653880 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a7000-2ac7-43f4-89f6-6b47b5bb4ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:36.654605 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a7000-2ac7-43f4-89f6-6b47b5bb4ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:36.656212 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a7000-2ac7-43f4-89f6-6b47b5bb4ea7 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:36.666425 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1228/2448] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:58:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:58:36.671301 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0672eb2-7d48-4533-9861-7cc6babb6a3a admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:36.682649 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0672eb2-7d48-4533-9861-7cc6babb6a3a admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:36.687412 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb23eb-4542-4f9a-baf8-b5420e14d6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:36.688288 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb23eb-4542-4f9a-baf8-b5420e14d6ec admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:36.688563 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb23eb-4542-4f9a-baf8-b5420e14d6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:36.688957 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb23eb-4542-4f9a-baf8-b5420e14d6ec admin admin] PATH_INFO: `/v3/projects/42066199e5234563b71a51a295413cdf/users/7d3011a786614511acb6f8c6dae3cd3f/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:36.691177 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb23eb-4542-4f9a-baf8-b5420e14d6ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=42066199e5234563b71a51a295413cdf, user_id=7d3011a786614511acb6f8c6dae3cd3f, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:36.693813 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb23eb-4542-4f9a-baf8-b5420e14d6ec admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:36.704230 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1221/2449] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:58:36 2022] PUT /identity/v3/projects/42066199e5234563b71a51a295413cdf/users/7d3011a786614511acb6f8c6dae3cd3f/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:36.715979 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422a7d9-2094-4fc2-a632-da45934c0bab None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:36.716272 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422a7d9-2094-4fc2-a632-da45934c0bab None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:36.716539 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422a7d9-2094-4fc2-a632-da45934c0bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:36.746325 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-8422a7d9-2094-4fc2-a632-da45934c0bab None None] MFA Rules not processed for user `7d3011a786614511acb6f8c6dae3cd3f`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:36.747512 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-8422a7d9-2094-4fc2-a632-da45934c0bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:36.817208 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1229/2450] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:58:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:58:36.828789 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb23eb-4542-4f9a-baf8-b5420e14d6ec admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:36.831153 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-59fb23eb-4542-4f9a-baf8-b5420e14d6ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:36.890209 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb23eb-4542-4f9a-baf8-b5420e14d6ec admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:36.894269 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42adbc8-bb19-46a8-8f6b-df69bb97cfa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:36.894904 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42adbc8-bb19-46a8-8f6b-df69bb97cfa0 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:36.895177 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42adbc8-bb19-46a8-8f6b-df69bb97cfa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:36.895446 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42adbc8-bb19-46a8-8f6b-df69bb97cfa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:36.906200 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42adbc8-bb19-46a8-8f6b-df69bb97cfa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:36.907561 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42adbc8-bb19-46a8-8f6b-df69bb97cfa0 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:36.918155 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1222/2451] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:58:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:58:37.003911 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422a7d9-2094-4fc2-a632-da45934c0bab None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:37.024125 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422a7d9-2094-4fc2-a632-da45934c0bab None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:37.028865 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adae74-0c2f-4806-97c6-ced574d75f7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:37.029649 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adae74-0c2f-4806-97c6-ced574d75f7f service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:37.029900 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adae74-0c2f-4806-97c6-ced574d75f7f service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:37.030195 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adae74-0c2f-4806-97c6-ced574d75f7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:37.095570 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adae74-0c2f-4806-97c6-ced574d75f7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:37.097019 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9adae74-0c2f-4806-97c6-ced574d75f7f service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:37.106146 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1230/2452] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:58:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:58:45.975336 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42adbc8-bb19-46a8-8f6b-df69bb97cfa0 service cinder] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:46.039483 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42adbc8-bb19-46a8-8f6b-df69bb97cfa0 service cinder] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:46.045199 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1c31b-b681-42c2-8ae9-65ffd9961681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:46.046045 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1c31b-b681-42c2-8ae9-65ffd9961681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:46.046327 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1c31b-b681-42c2-8ae9-65ffd9961681 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:46.046623 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1c31b-b681-42c2-8ae9-65ffd9961681 admin admin] PATH_INFO: `/v3/users/8569039b69f24975a4b4c3de24c408ef` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:46.047924 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1c31b-b681-42c2-8ae9-65ffd9961681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8569039b69f24975a4b4c3de24c408ef)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:46.050161 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1c31b-b681-42c2-8ae9-65ffd9961681 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:46.097366 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-ebf1c31b-b681-42c2-8ae9-65ffd9961681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8569039b69f24975a4b4c3de24c408ef'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:46.098051 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-ebf1c31b-b681-42c2-8ae9-65ffd9961681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8569039b69f24975a4b4c3de24c408ef'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:46.106391 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-ebf1c31b-b681-42c2-8ae9-65ffd9961681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8569039b69f24975a4b4c3de24c408ef'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:46.117716 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-ebf1c31b-b681-42c2-8ae9-65ffd9961681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8569039b69f24975a4b4c3de24c408ef'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:46.124111 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-ebf1c31b-b681-42c2-8ae9-65ffd9961681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8569039b69f24975a4b4c3de24c408ef'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:46.129759 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1223/2453] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:58:45 2022] DELETE /identity/v3/users/8569039b69f24975a4b4c3de24c408ef => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:46.134560 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b24b84-8a25-4adb-800a-27332d8f0cbe None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:46.135046 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b24b84-8a25-4adb-800a-27332d8f0cbe None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:46.135138 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b24b84-8a25-4adb-800a-27332d8f0cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:46.152533 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-30b24b84-8a25-4adb-800a-27332d8f0cbe None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:46.153769 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-30b24b84-8a25-4adb-800a-27332d8f0cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:46.215002 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1231/2454] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:58:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:58:46.224773 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1c31b-b681-42c2-8ae9-65ffd9961681 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:46.226334 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-ebf1c31b-b681-42c2-8ae9-65ffd9961681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:46.282213 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1c31b-b681-42c2-8ae9-65ffd9961681 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:46.286655 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163255c-b53a-4839-89d4-1943aaa93ce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:46.287302 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163255c-b53a-4839-89d4-1943aaa93ce0 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:46.287585 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163255c-b53a-4839-89d4-1943aaa93ce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:46.287860 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163255c-b53a-4839-89d4-1943aaa93ce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:46.297265 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163255c-b53a-4839-89d4-1943aaa93ce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:46.298707 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163255c-b53a-4839-89d4-1943aaa93ce0 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:46.309479 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1224/2455] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:58:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:58:46.576111 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b24b84-8a25-4adb-800a-27332d8f0cbe None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:46.577757 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-30b24b84-8a25-4adb-800a-27332d8f0cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:46.590270 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b24b84-8a25-4adb-800a-27332d8f0cbe None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:46.595153 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e2803-c0fb-4563-ac5b-5d3a3c2a705f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:46.596107 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e2803-c0fb-4563-ac5b-5d3a3c2a705f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:46.596387 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e2803-c0fb-4563-ac5b-5d3a3c2a705f admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:46.596648 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e2803-c0fb-4563-ac5b-5d3a3c2a705f admin admin] PATH_INFO: `/v3/projects/a967f4ba13b74307b10cc26ea07dda4a` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:46.597880 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e2803-c0fb-4563-ac5b-5d3a3c2a705f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a967f4ba13b74307b10cc26ea07dda4a)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:46.599796 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e2803-c0fb-4563-ac5b-5d3a3c2a705f admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:46.650552 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8b7e2803-c0fb-4563-ac5b-5d3a3c2a705f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a967f4ba13b74307b10cc26ea07dda4a', 'request_id': 'req-8b7e2803-c0fb-4563-ac5b-5d3a3c2a705f'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:46.656604 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8b7e2803-c0fb-4563-ac5b-5d3a3c2a705f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a967f4ba13b74307b10cc26ea07dda4a', 'request_id': 'req-8b7e2803-c0fb-4563-ac5b-5d3a3c2a705f'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:46.666153 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8b7e2803-c0fb-4563-ac5b-5d3a3c2a705f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a967f4ba13b74307b10cc26ea07dda4a', 'request_id': 'req-8b7e2803-c0fb-4563-ac5b-5d3a3c2a705f'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:46.676411 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8b7e2803-c0fb-4563-ac5b-5d3a3c2a705f admin admin] The token cache is being invalidate because project a967f4ba13b74307b10cc26ea07dda4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:58:46.676696 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8b7e2803-c0fb-4563-ac5b-5d3a3c2a705f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:46.677423 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8b7e2803-c0fb-4563-ac5b-5d3a3c2a705f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:46.679045 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1232/2456] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:58:46 2022] DELETE /identity/v3/projects/a967f4ba13b74307b10cc26ea07dda4a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:46.683215 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163255c-b53a-4839-89d4-1943aaa93ce0 service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:46.693122 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163255c-b53a-4839-89d4-1943aaa93ce0 service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:46.751886 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26decb-f62c-4ffb-8826-4d1be9bff852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:46.752791 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26decb-f62c-4ffb-8826-4d1be9bff852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:46.753070 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26decb-f62c-4ffb-8826-4d1be9bff852 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:46.753335 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26decb-f62c-4ffb-8826-4d1be9bff852 admin admin] PATH_INFO: `/v3/users/7d3011a786614511acb6f8c6dae3cd3f` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:46.754702 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26decb-f62c-4ffb-8826-4d1be9bff852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d3011a786614511acb6f8c6dae3cd3f)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:46.756629 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26decb-f62c-4ffb-8826-4d1be9bff852 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:46.803715 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-fa26decb-f62c-4ffb-8826-4d1be9bff852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d3011a786614511acb6f8c6dae3cd3f'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:46.804338 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-fa26decb-f62c-4ffb-8826-4d1be9bff852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d3011a786614511acb6f8c6dae3cd3f'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:46.812689 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-fa26decb-f62c-4ffb-8826-4d1be9bff852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d3011a786614511acb6f8c6dae3cd3f'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:46.828504 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-fa26decb-f62c-4ffb-8826-4d1be9bff852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d3011a786614511acb6f8c6dae3cd3f'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:46.836760 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-fa26decb-f62c-4ffb-8826-4d1be9bff852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d3011a786614511acb6f8c6dae3cd3f'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:46.845652 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1225/2457] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:58:46 2022] DELETE /identity/v3/users/7d3011a786614511acb6f8c6dae3cd3f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:47.119951 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e2803-c0fb-4563-ac5b-5d3a3c2a705f admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:47.121544 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-8b7e2803-c0fb-4563-ac5b-5d3a3c2a705f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:47.136304 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e2803-c0fb-4563-ac5b-5d3a3c2a705f admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:47.193899 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0fcd7-1797-426a-b073-1ecc21bd790b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:47.195066 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0fcd7-1797-426a-b073-1ecc21bd790b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:47.195905 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0fcd7-1797-426a-b073-1ecc21bd790b admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:47.195905 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0fcd7-1797-426a-b073-1ecc21bd790b admin admin] PATH_INFO: `/v3/projects/42066199e5234563b71a51a295413cdf` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:47.196791 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0fcd7-1797-426a-b073-1ecc21bd790b admin admin] RBAC: Authorizing `identity:delete_project(project_id=42066199e5234563b71a51a295413cdf)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:47.198730 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0fcd7-1797-426a-b073-1ecc21bd790b admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:47.250234 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ced0fcd7-1797-426a-b073-1ecc21bd790b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42066199e5234563b71a51a295413cdf', 'request_id': 'req-ced0fcd7-1797-426a-b073-1ecc21bd790b'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:47.256180 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ced0fcd7-1797-426a-b073-1ecc21bd790b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42066199e5234563b71a51a295413cdf', 'request_id': 'req-ced0fcd7-1797-426a-b073-1ecc21bd790b'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:47.266048 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ced0fcd7-1797-426a-b073-1ecc21bd790b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42066199e5234563b71a51a295413cdf', 'request_id': 'req-ced0fcd7-1797-426a-b073-1ecc21bd790b'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:47.278689 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ced0fcd7-1797-426a-b073-1ecc21bd790b admin admin] The token cache is being invalidate because project 42066199e5234563b71a51a295413cdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:58:47.278978 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ced0fcd7-1797-426a-b073-1ecc21bd790b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:47.280015 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ced0fcd7-1797-426a-b073-1ecc21bd790b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:47.282465 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1233/2458] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:58:47 2022] DELETE /identity/v3/projects/42066199e5234563b71a51a295413cdf => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:47.287801 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7603c3-6aca-4d9f-adac-3b3e2b0c4abb None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:47.288316 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7603c3-6aca-4d9f-adac-3b3e2b0c4abb None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:47.288316 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7603c3-6aca-4d9f-adac-3b3e2b0c4abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:47.306657 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-ca7603c3-6aca-4d9f-adac-3b3e2b0c4abb None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:47.307849 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-ca7603c3-6aca-4d9f-adac-3b3e2b0c4abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:47.376441 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1226/2459] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:58:47.387902 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9ff29-22fb-4c0f-91b1-351e0c2daf06 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:47.388187 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9ff29-22fb-4c0f-91b1-351e0c2daf06 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:47.388443 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9ff29-22fb-4c0f-91b1-351e0c2daf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:47.407679 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-8df9ff29-22fb-4c0f-91b1-351e0c2daf06 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:47.408942 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-8df9ff29-22fb-4c0f-91b1-351e0c2daf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:47.418467 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1234/2460] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:58:47.422874 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7603c3-6aca-4d9f-adac-3b3e2b0c4abb None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:47.433177 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7603c3-6aca-4d9f-adac-3b3e2b0c4abb None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:47.438628 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be961f-b6cd-434f-8a7a-ea1f9afe4264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:47.439282 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be961f-b6cd-434f-8a7a-ea1f9afe4264 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:47.439565 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be961f-b6cd-434f-8a7a-ea1f9afe4264 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:47.439837 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be961f-b6cd-434f-8a7a-ea1f9afe4264 admin admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:47.440572 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be961f-b6cd-434f-8a7a-ea1f9afe4264 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:58:47.440871 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be961f-b6cd-434f-8a7a-ea1f9afe4264 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:47.442521 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be961f-b6cd-434f-8a7a-ea1f9afe4264 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:47.457828 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1227/2461] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:58:47.459047 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9ff29-22fb-4c0f-91b1-351e0c2daf06 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:47.469027 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9ff29-22fb-4c0f-91b1-351e0c2daf06 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:47.474392 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9be61-56c9-42d9-8ad2-6cad5fa2cfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:47.475050 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9be61-56c9-42d9-8ad2-6cad5fa2cfb6 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:47.475325 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9be61-56c9-42d9-8ad2-6cad5fa2cfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:47.475593 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9be61-56c9-42d9-8ad2-6cad5fa2cfb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:47.476283 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9be61-56c9-42d9-8ad2-6cad5fa2cfb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:47.478266 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9be61-56c9-42d9-8ad2-6cad5fa2cfb6 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:47.506606 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1235/2462] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:58:47 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:58:47.511013 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be961f-b6cd-434f-8a7a-ea1f9afe4264 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:47.521678 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be961f-b6cd-434f-8a7a-ea1f9afe4264 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:47.587985 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5200b2b-d183-4e21-85ec-4af9b3148216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:47.588651 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5200b2b-d183-4e21-85ec-4af9b3148216 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:47.588928 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5200b2b-d183-4e21-85ec-4af9b3148216 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:47.589197 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5200b2b-d183-4e21-85ec-4af9b3148216 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:47.589974 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5200b2b-d183-4e21-85ec-4af9b3148216 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:47.591893 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5200b2b-d183-4e21-85ec-4af9b3148216 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:47.615598 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1228/2463] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:58:47 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:58:47.620107 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9be61-56c9-42d9-8ad2-6cad5fa2cfb6 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:47.630721 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9be61-56c9-42d9-8ad2-6cad5fa2cfb6 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:47.635863 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeae9ba-4fd7-4279-810e-6face2f02cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:47.636560 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeae9ba-4fd7-4279-810e-6face2f02cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:47.636844 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeae9ba-4fd7-4279-810e-6face2f02cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:47.637122 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeae9ba-4fd7-4279-810e-6face2f02cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:47.637921 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeae9ba-4fd7-4279-810e-6face2f02cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:47.639553 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeae9ba-4fd7-4279-810e-6face2f02cb2 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:47.649919 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1236/2464] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:58:47.653735 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5200b2b-d183-4e21-85ec-4af9b3148216 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:47.663858 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5200b2b-d183-4e21-85ec-4af9b3148216 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:47.669036 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f99cd5-75f3-43bd-a28a-1c52e57b786c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:47.669739 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f99cd5-75f3-43bd-a28a-1c52e57b786c admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:47.670014 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f99cd5-75f3-43bd-a28a-1c52e57b786c admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:47.670297 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f99cd5-75f3-43bd-a28a-1c52e57b786c admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:47.671022 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f99cd5-75f3-43bd-a28a-1c52e57b786c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:47.672596 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f99cd5-75f3-43bd-a28a-1c52e57b786c admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:47.682578 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1229/2465] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:58:47.686893 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeae9ba-4fd7-4279-810e-6face2f02cb2 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:47.697128 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeae9ba-4fd7-4279-810e-6face2f02cb2 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:47.702154 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e86681-a39f-4751-86d4-476dd669fe6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:47.703029 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e86681-a39f-4751-86d4-476dd669fe6b admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:47.703309 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e86681-a39f-4751-86d4-476dd669fe6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:47.703582 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e86681-a39f-4751-86d4-476dd669fe6b admin admin] PATH_INFO: `/v3/projects/faf4535882814f8996a023bb2bd42054/users/7e266646bacd4450a183b8b7ff3f429c/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:47.718077 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e86681-a39f-4751-86d4-476dd669fe6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf4535882814f8996a023bb2bd42054, user_id=7e266646bacd4450a183b8b7ff3f429c, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:47.720757 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e86681-a39f-4751-86d4-476dd669fe6b admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:47.735481 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1237/2466] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:58:47 2022] PUT /identity/v3/projects/faf4535882814f8996a023bb2bd42054/users/7e266646bacd4450a183b8b7ff3f429c/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:47.745676 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca6147-35d6-4be9-a223-1c961bdbd998 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:47.745964 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca6147-35d6-4be9-a223-1c961bdbd998 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:47.746235 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca6147-35d6-4be9-a223-1c961bdbd998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:47.773683 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-abca6147-35d6-4be9-a223-1c961bdbd998 None None] MFA Rules not processed for user `7e266646bacd4450a183b8b7ff3f429c`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:47.774913 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-abca6147-35d6-4be9-a223-1c961bdbd998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:47.840715 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1230/2467] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:58:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:58:47.846178 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e86681-a39f-4751-86d4-476dd669fe6b admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:47.908374 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e86681-a39f-4751-86d4-476dd669fe6b admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:47.913971 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db038ac-8b81-4caa-ba91-c08040eb5bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:47.914637 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db038ac-8b81-4caa-ba91-c08040eb5bff admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:47.914915 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db038ac-8b81-4caa-ba91-c08040eb5bff admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:47.915182 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db038ac-8b81-4caa-ba91-c08040eb5bff admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:47.915900 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db038ac-8b81-4caa-ba91-c08040eb5bff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:47.917869 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db038ac-8b81-4caa-ba91-c08040eb5bff admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:47.946133 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1238/2468] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:58:47 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:58:47.950273 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca6147-35d6-4be9-a223-1c961bdbd998 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:47.961226 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca6147-35d6-4be9-a223-1c961bdbd998 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:48.016915 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb206e-f5c0-4392-a65f-29abbaba19a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:48.017608 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb206e-f5c0-4392-a65f-29abbaba19a2 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:48.017882 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb206e-f5c0-4392-a65f-29abbaba19a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:48.018138 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb206e-f5c0-4392-a65f-29abbaba19a2 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:48.018826 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb206e-f5c0-4392-a65f-29abbaba19a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:48.020725 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb206e-f5c0-4392-a65f-29abbaba19a2 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:48.044561 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1231/2469] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:58:47 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:58:48.049101 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db038ac-8b81-4caa-ba91-c08040eb5bff admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:48.064774 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db038ac-8b81-4caa-ba91-c08040eb5bff admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:48.069801 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f22ea-0904-4944-86a6-0b042c5b4074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:48.070449 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f22ea-0904-4944-86a6-0b042c5b4074 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:48.070732 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f22ea-0904-4944-86a6-0b042c5b4074 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:48.071009 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f22ea-0904-4944-86a6-0b042c5b4074 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:48.071732 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f22ea-0904-4944-86a6-0b042c5b4074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:48.073323 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f22ea-0904-4944-86a6-0b042c5b4074 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:48.083978 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1239/2470] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:58:48.088607 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb206e-f5c0-4392-a65f-29abbaba19a2 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:48.098939 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb206e-f5c0-4392-a65f-29abbaba19a2 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:48.103913 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb1c40-a092-4651-ac59-9173ddfcc09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:48.104797 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb1c40-a092-4651-ac59-9173ddfcc09e admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:48.105074 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb1c40-a092-4651-ac59-9173ddfcc09e admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:48.105342 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb1c40-a092-4651-ac59-9173ddfcc09e admin admin] PATH_INFO: `/v3/projects/65b2096eb23549b886582a7981584b79/users/18ba7ce7d3094862bc27210cf2f7ffb3/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:48.122294 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb1c40-a092-4651-ac59-9173ddfcc09e admin admin] RBAC: Authorizing `identity:create_grant(project_id=65b2096eb23549b886582a7981584b79, user_id=18ba7ce7d3094862bc27210cf2f7ffb3, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:48.126451 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb1c40-a092-4651-ac59-9173ddfcc09e admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:48.146948 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1232/2471] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:58:48 2022] PUT /identity/v3/projects/65b2096eb23549b886582a7981584b79/users/18ba7ce7d3094862bc27210cf2f7ffb3/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:48.151067 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f22ea-0904-4944-86a6-0b042c5b4074 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:48.161080 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f22ea-0904-4944-86a6-0b042c5b4074 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:48.219987 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd3aa7-ecf7-4abf-93db-5833897083c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:48.220678 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd3aa7-ecf7-4abf-93db-5833897083c5 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:48.221013 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd3aa7-ecf7-4abf-93db-5833897083c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:48.221284 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd3aa7-ecf7-4abf-93db-5833897083c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:48.222052 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd3aa7-ecf7-4abf-93db-5833897083c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:48.223734 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd3aa7-ecf7-4abf-93db-5833897083c5 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:48.233228 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1240/2472] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:58:48.237715 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb1c40-a092-4651-ac59-9173ddfcc09e admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:48.248199 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb1c40-a092-4651-ac59-9173ddfcc09e admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:48.253788 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c8223-6551-4aeb-980a-6c51fff85e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:48.254698 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c8223-6551-4aeb-980a-6c51fff85e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:48.254979 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c8223-6551-4aeb-980a-6c51fff85e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:48.255244 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c8223-6551-4aeb-980a-6c51fff85e28 admin admin] PATH_INFO: `/v3/projects/65b2096eb23549b886582a7981584b79/users/18ba7ce7d3094862bc27210cf2f7ffb3/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:48.257533 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c8223-6551-4aeb-980a-6c51fff85e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65b2096eb23549b886582a7981584b79, user_id=18ba7ce7d3094862bc27210cf2f7ffb3, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:48.260127 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c8223-6551-4aeb-980a-6c51fff85e28 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:48.271505 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1233/2473] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:58:48 2022] PUT /identity/v3/projects/65b2096eb23549b886582a7981584b79/users/18ba7ce7d3094862bc27210cf2f7ffb3/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:48.282966 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22c6ba-767d-4622-a6e0-66fdaf99d3d8 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:48.283268 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22c6ba-767d-4622-a6e0-66fdaf99d3d8 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:48.283525 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d22c6ba-767d-4622-a6e0-66fdaf99d3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:48.313479 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-8d22c6ba-767d-4622-a6e0-66fdaf99d3d8 None None] MFA Rules not processed for user `18ba7ce7d3094862bc27210cf2f7ffb3`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:48.314686 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-8d22c6ba-767d-4622-a6e0-66fdaf99d3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:48.387365 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1241/2474] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:58:48 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:58:48.399807 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c8223-6551-4aeb-980a-6c51fff85e28 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:48.401738 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-921c8223-6551-4aeb-980a-6c51fff85e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:48.457491 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c8223-6551-4aeb-980a-6c51fff85e28 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:48.461882 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98076df-886b-4a38-94bc-5b5bcefe7374 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:48.462509 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98076df-886b-4a38-94bc-5b5bcefe7374 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:48.462783 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98076df-886b-4a38-94bc-5b5bcefe7374 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:48.463053 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98076df-886b-4a38-94bc-5b5bcefe7374 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:48.472968 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98076df-886b-4a38-94bc-5b5bcefe7374 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:48.474435 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98076df-886b-4a38-94bc-5b5bcefe7374 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:48.484376 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1234/2475] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:58:48 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:58:48.560318 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22c6ba-767d-4622-a6e0-66fdaf99d3d8 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:48.570846 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d22c6ba-767d-4622-a6e0-66fdaf99d3d8 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:48.579178 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2156aa-9d77-4749-9fd6-024d36274aa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:48.579823 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2156aa-9d77-4749-9fd6-024d36274aa6 service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:48.580130 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2156aa-9d77-4749-9fd6-024d36274aa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:48.580400 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2156aa-9d77-4749-9fd6-024d36274aa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:48.642792 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2156aa-9d77-4749-9fd6-024d36274aa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:48.644239 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2156aa-9d77-4749-9fd6-024d36274aa6 service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:48.653217 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1242/2476] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:58:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:58:51.406462 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98076df-886b-4a38-94bc-5b5bcefe7374 service cinder] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:51.472001 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98076df-886b-4a38-94bc-5b5bcefe7374 service cinder] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:51.476954 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8281a8c-ff6a-4f97-b04c-8f4468f104e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:51.477871 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8281a8c-ff6a-4f97-b04c-8f4468f104e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:51.478158 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8281a8c-ff6a-4f97-b04c-8f4468f104e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:51.478426 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8281a8c-ff6a-4f97-b04c-8f4468f104e6 admin admin] PATH_INFO: `/v3/users/7e266646bacd4450a183b8b7ff3f429c` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:51.479621 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8281a8c-ff6a-4f97-b04c-8f4468f104e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e266646bacd4450a183b8b7ff3f429c)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:51.481572 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8281a8c-ff6a-4f97-b04c-8f4468f104e6 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:51.529319 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a8281a8c-ff6a-4f97-b04c-8f4468f104e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e266646bacd4450a183b8b7ff3f429c'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:51.530041 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a8281a8c-ff6a-4f97-b04c-8f4468f104e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e266646bacd4450a183b8b7ff3f429c'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:51.539465 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a8281a8c-ff6a-4f97-b04c-8f4468f104e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e266646bacd4450a183b8b7ff3f429c'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:51.551776 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a8281a8c-ff6a-4f97-b04c-8f4468f104e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e266646bacd4450a183b8b7ff3f429c'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:51.559059 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a8281a8c-ff6a-4f97-b04c-8f4468f104e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e266646bacd4450a183b8b7ff3f429c'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:51.565178 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1235/2477] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:58:51 2022] DELETE /identity/v3/users/7e266646bacd4450a183b8b7ff3f429c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:51.569896 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f61b1e-d2c0-4079-aff3-cbf8d7625c04 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:51.570376 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f61b1e-d2c0-4079-aff3-cbf8d7625c04 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:51.570472 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f61b1e-d2c0-4079-aff3-cbf8d7625c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:51.588844 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-a6f61b1e-d2c0-4079-aff3-cbf8d7625c04 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:51.590100 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-a6f61b1e-d2c0-4079-aff3-cbf8d7625c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:51.648736 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1243/2478] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:58:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:58:51.660463 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8281a8c-ff6a-4f97-b04c-8f4468f104e6 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:51.662147 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-a8281a8c-ff6a-4f97-b04c-8f4468f104e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:51.719329 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8281a8c-ff6a-4f97-b04c-8f4468f104e6 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:51.723860 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb959ee-924a-45e1-a20e-1d27e7f0597b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:51.724537 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb959ee-924a-45e1-a20e-1d27e7f0597b service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:51.724841 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb959ee-924a-45e1-a20e-1d27e7f0597b service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:51.725111 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb959ee-924a-45e1-a20e-1d27e7f0597b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:51.736437 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb959ee-924a-45e1-a20e-1d27e7f0597b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:51.737884 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb959ee-924a-45e1-a20e-1d27e7f0597b service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:51.748213 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1236/2479] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:58:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:58:52.014266 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f61b1e-d2c0-4079-aff3-cbf8d7625c04 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:52.015731 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-a6f61b1e-d2c0-4079-aff3-cbf8d7625c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:52.028244 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f61b1e-d2c0-4079-aff3-cbf8d7625c04 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:52.033385 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ab455-8fb1-4978-a216-45ceb3b5f121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:52.034811 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ab455-8fb1-4978-a216-45ceb3b5f121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:52.035089 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ab455-8fb1-4978-a216-45ceb3b5f121 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:52.035431 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ab455-8fb1-4978-a216-45ceb3b5f121 admin admin] PATH_INFO: `/v3/projects/faf4535882814f8996a023bb2bd42054` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:52.036819 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ab455-8fb1-4978-a216-45ceb3b5f121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faf4535882814f8996a023bb2bd42054)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:52.039027 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ab455-8fb1-4978-a216-45ceb3b5f121 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:52.086648 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-713ab455-8fb1-4978-a216-45ceb3b5f121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf4535882814f8996a023bb2bd42054', 'request_id': 'req-713ab455-8fb1-4978-a216-45ceb3b5f121'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:52.092741 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-713ab455-8fb1-4978-a216-45ceb3b5f121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf4535882814f8996a023bb2bd42054', 'request_id': 'req-713ab455-8fb1-4978-a216-45ceb3b5f121'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:52.102027 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-713ab455-8fb1-4978-a216-45ceb3b5f121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf4535882814f8996a023bb2bd42054', 'request_id': 'req-713ab455-8fb1-4978-a216-45ceb3b5f121'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:52.112049 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-713ab455-8fb1-4978-a216-45ceb3b5f121 admin admin] The token cache is being invalidate because project faf4535882814f8996a023bb2bd42054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:58:52.112326 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-713ab455-8fb1-4978-a216-45ceb3b5f121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:52.112919 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-713ab455-8fb1-4978-a216-45ceb3b5f121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:52.114467 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1244/2480] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:58:52 2022] DELETE /identity/v3/projects/faf4535882814f8996a023bb2bd42054 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:52.118598 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb959ee-924a-45e1-a20e-1d27e7f0597b service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:52.128234 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb959ee-924a-45e1-a20e-1d27e7f0597b service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:52.187106 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859cdbd7-9f6b-44ad-9eec-5216a6b907a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:52.187980 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cdbd7-9f6b-44ad-9eec-5216a6b907a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:52.188258 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cdbd7-9f6b-44ad-9eec-5216a6b907a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:52.188530 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859cdbd7-9f6b-44ad-9eec-5216a6b907a5 admin admin] PATH_INFO: `/v3/users/18ba7ce7d3094862bc27210cf2f7ffb3` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:52.189727 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859cdbd7-9f6b-44ad-9eec-5216a6b907a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ba7ce7d3094862bc27210cf2f7ffb3)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:52.191611 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859cdbd7-9f6b-44ad-9eec-5216a6b907a5 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:52.242836 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-859cdbd7-9f6b-44ad-9eec-5216a6b907a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ba7ce7d3094862bc27210cf2f7ffb3'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:52.243491 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-859cdbd7-9f6b-44ad-9eec-5216a6b907a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ba7ce7d3094862bc27210cf2f7ffb3'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:52.252823 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-859cdbd7-9f6b-44ad-9eec-5216a6b907a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ba7ce7d3094862bc27210cf2f7ffb3'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:52.265131 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-859cdbd7-9f6b-44ad-9eec-5216a6b907a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ba7ce7d3094862bc27210cf2f7ffb3'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:52.271821 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-859cdbd7-9f6b-44ad-9eec-5216a6b907a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ba7ce7d3094862bc27210cf2f7ffb3'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:52.277996 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1237/2481] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:58:52 2022] DELETE /identity/v3/users/18ba7ce7d3094862bc27210cf2f7ffb3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:52.546193 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ab455-8fb1-4978-a216-45ceb3b5f121 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:52.548435 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-713ab455-8fb1-4978-a216-45ceb3b5f121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:52.561932 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ab455-8fb1-4978-a216-45ceb3b5f121 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:52.623486 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c2f9bf-0c9c-46eb-b2fd-2b7a6599f85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:52.624354 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2f9bf-0c9c-46eb-b2fd-2b7a6599f85f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:52.624628 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2f9bf-0c9c-46eb-b2fd-2b7a6599f85f admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:52.624889 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c2f9bf-0c9c-46eb-b2fd-2b7a6599f85f admin admin] PATH_INFO: `/v3/projects/65b2096eb23549b886582a7981584b79` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:52.626148 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2f9bf-0c9c-46eb-b2fd-2b7a6599f85f admin admin] RBAC: Authorizing `identity:delete_project(project_id=65b2096eb23549b886582a7981584b79)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:52.628147 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c2f9bf-0c9c-46eb-b2fd-2b7a6599f85f admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:52.677040 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-82c2f9bf-0c9c-46eb-b2fd-2b7a6599f85f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65b2096eb23549b886582a7981584b79', 'request_id': 'req-82c2f9bf-0c9c-46eb-b2fd-2b7a6599f85f'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:52.683032 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-82c2f9bf-0c9c-46eb-b2fd-2b7a6599f85f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65b2096eb23549b886582a7981584b79', 'request_id': 'req-82c2f9bf-0c9c-46eb-b2fd-2b7a6599f85f'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:52.691068 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-82c2f9bf-0c9c-46eb-b2fd-2b7a6599f85f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65b2096eb23549b886582a7981584b79', 'request_id': 'req-82c2f9bf-0c9c-46eb-b2fd-2b7a6599f85f'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:52.701513 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-82c2f9bf-0c9c-46eb-b2fd-2b7a6599f85f admin admin] The token cache is being invalidate because project 65b2096eb23549b886582a7981584b79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:58:52.701799 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-82c2f9bf-0c9c-46eb-b2fd-2b7a6599f85f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:52.702727 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-82c2f9bf-0c9c-46eb-b2fd-2b7a6599f85f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:52.704388 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1245/2482] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:58:52 2022] DELETE /identity/v3/projects/65b2096eb23549b886582a7981584b79 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:52.710273 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1d25c-d648-4cf1-ac27-319f582995a0 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:52.711090 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1d25c-d648-4cf1-ac27-319f582995a0 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:52.711279 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1d25c-d648-4cf1-ac27-319f582995a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:52.736789 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-e7e1d25c-d648-4cf1-ac27-319f582995a0 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:52.738040 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-e7e1d25c-d648-4cf1-ac27-319f582995a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:52.936498 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1238/2483] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:58:52.948269 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbadee7-ad7b-4022-a44c-0caaa9374f07 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:52.948554 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbadee7-ad7b-4022-a44c-0caaa9374f07 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:52.948825 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbadee7-ad7b-4022-a44c-0caaa9374f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:52.968935 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-afbadee7-ad7b-4022-a44c-0caaa9374f07 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:52.970220 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-afbadee7-ad7b-4022-a44c-0caaa9374f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:52.979740 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1246/2484] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:58:52.984051 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1d25c-d648-4cf1-ac27-319f582995a0 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:52.994265 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1d25c-d648-4cf1-ac27-319f582995a0 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:53.000517 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b191d-acf2-4a8a-97cf-9ba531deeb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:53.001179 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b191d-acf2-4a8a-97cf-9ba531deeb51 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:53.001490 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b191d-acf2-4a8a-97cf-9ba531deeb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:53.001757 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41b191d-acf2-4a8a-97cf-9ba531deeb51 admin admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:53.002483 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b191d-acf2-4a8a-97cf-9ba531deeb51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:58:53.002785 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b191d-acf2-4a8a-97cf-9ba531deeb51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:53.004369 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41b191d-acf2-4a8a-97cf-9ba531deeb51 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:53.017819 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1239/2485] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:58:53.022567 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbadee7-ad7b-4022-a44c-0caaa9374f07 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:53.032297 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbadee7-ad7b-4022-a44c-0caaa9374f07 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:53.038251 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf2911-277d-4e7f-9b42-ad2507575b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:53.038906 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf2911-277d-4e7f-9b42-ad2507575b34 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:53.039184 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf2911-277d-4e7f-9b42-ad2507575b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:53.039449 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf2911-277d-4e7f-9b42-ad2507575b34 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:53.040142 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf2911-277d-4e7f-9b42-ad2507575b34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:53.042141 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf2911-277d-4e7f-9b42-ad2507575b34 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:53.070981 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1247/2486] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:58:53 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:58:53.075451 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b191d-acf2-4a8a-97cf-9ba531deeb51 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:53.086040 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41b191d-acf2-4a8a-97cf-9ba531deeb51 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:53.142887 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d061f-12cd-4953-92ac-cf1e255f65af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:53.143538 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d061f-12cd-4953-92ac-cf1e255f65af admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:53.143813 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d061f-12cd-4953-92ac-cf1e255f65af admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:53.144075 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d061f-12cd-4953-92ac-cf1e255f65af admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:53.144755 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d061f-12cd-4953-92ac-cf1e255f65af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:53.146676 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d061f-12cd-4953-92ac-cf1e255f65af admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:53.169761 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1240/2487] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:58:53 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:58:53.175150 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf2911-277d-4e7f-9b42-ad2507575b34 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:53.185792 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf2911-277d-4e7f-9b42-ad2507575b34 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:53.190560 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65a40c-fdec-46b0-ad90-713725f72464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:53.191150 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65a40c-fdec-46b0-ad90-713725f72464 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:53.191499 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65a40c-fdec-46b0-ad90-713725f72464 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:53.191772 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65a40c-fdec-46b0-ad90-713725f72464 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:53.192524 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65a40c-fdec-46b0-ad90-713725f72464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:53.194158 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65a40c-fdec-46b0-ad90-713725f72464 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:53.204271 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1248/2488] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:58:53.208386 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d061f-12cd-4953-92ac-cf1e255f65af admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:53.218809 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d061f-12cd-4953-92ac-cf1e255f65af admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:53.224018 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474ae92-7d11-45d4-8284-9e8bc7660bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:53.224663 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474ae92-7d11-45d4-8284-9e8bc7660bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:53.224942 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474ae92-7d11-45d4-8284-9e8bc7660bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:53.225214 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474ae92-7d11-45d4-8284-9e8bc7660bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:53.226000 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474ae92-7d11-45d4-8284-9e8bc7660bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:53.227548 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474ae92-7d11-45d4-8284-9e8bc7660bf1 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:53.237670 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1241/2489] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:58:53.241965 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65a40c-fdec-46b0-ad90-713725f72464 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:53.252021 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65a40c-fdec-46b0-ad90-713725f72464 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:53.257781 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bf6da-4ed5-4f56-887c-2bb9d8a66aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:53.258678 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bf6da-4ed5-4f56-887c-2bb9d8a66aae admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:53.259415 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bf6da-4ed5-4f56-887c-2bb9d8a66aae admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:53.259415 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bf6da-4ed5-4f56-887c-2bb9d8a66aae admin admin] PATH_INFO: `/v3/projects/bc22975f9076445fb0e98ac1864ccef5/users/f5510520954f492c95b3cf2d590e66b9/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:53.274751 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bf6da-4ed5-4f56-887c-2bb9d8a66aae admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc22975f9076445fb0e98ac1864ccef5, user_id=f5510520954f492c95b3cf2d590e66b9, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:53.277525 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bf6da-4ed5-4f56-887c-2bb9d8a66aae admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:53.292089 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1249/2490] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:58:53 2022] PUT /identity/v3/projects/bc22975f9076445fb0e98ac1864ccef5/users/f5510520954f492c95b3cf2d590e66b9/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:58:53.302514 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cb6e1-6cde-4789-9684-a28e12e4f817 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:53.302802 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cb6e1-6cde-4789-9684-a28e12e4f817 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:53.303072 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cb6e1-6cde-4789-9684-a28e12e4f817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:53.329700 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-ae8cb6e1-6cde-4789-9684-a28e12e4f817 None None] MFA Rules not processed for user `f5510520954f492c95b3cf2d590e66b9`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:53.330876 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-ae8cb6e1-6cde-4789-9684-a28e12e4f817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:53.396427 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1242/2491] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:58:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:58:53.401116 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bf6da-4ed5-4f56-887c-2bb9d8a66aae admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:53.462087 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bf6da-4ed5-4f56-887c-2bb9d8a66aae admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:53.467228 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7587324-6aa1-401b-9aec-2a254c1974ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:53.467888 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7587324-6aa1-401b-9aec-2a254c1974ce admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:53.468225 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7587324-6aa1-401b-9aec-2a254c1974ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:53.468499 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7587324-6aa1-401b-9aec-2a254c1974ce admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:53.469173 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7587324-6aa1-401b-9aec-2a254c1974ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:53.471117 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7587324-6aa1-401b-9aec-2a254c1974ce admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:53.498326 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1250/2492] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:58:53 2022] POST /identity/v3/projects => generated 389 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:58:53.502518 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cb6e1-6cde-4789-9684-a28e12e4f817 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:53.513165 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cb6e1-6cde-4789-9684-a28e12e4f817 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:53.572481 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830e942-95c4-4a3f-af8f-e982ec419c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:53.573450 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830e942-95c4-4a3f-af8f-e982ec419c39 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:53.573800 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830e942-95c4-4a3f-af8f-e982ec419c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:53.574082 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f830e942-95c4-4a3f-af8f-e982ec419c39 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:53.575102 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830e942-95c4-4a3f-af8f-e982ec419c39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:53.578232 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f830e942-95c4-4a3f-af8f-e982ec419c39 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:53.606941 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1243/2493] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:58:53 2022] POST /identity/v3/users => generated 301 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:58:53.611131 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7587324-6aa1-401b-9aec-2a254c1974ce admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:53.621637 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7587324-6aa1-401b-9aec-2a254c1974ce admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:53.626304 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ebdc6-a43c-4419-8f52-c1e9bfb04d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:53.626959 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ebdc6-a43c-4419-8f52-c1e9bfb04d51 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:53.627239 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ebdc6-a43c-4419-8f52-c1e9bfb04d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:53.627515 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266ebdc6-a43c-4419-8f52-c1e9bfb04d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:53.628242 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ebdc6-a43c-4419-8f52-c1e9bfb04d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:53.629942 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266ebdc6-a43c-4419-8f52-c1e9bfb04d51 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:53.646959 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1251/2494] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:58:53.652924 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830e942-95c4-4a3f-af8f-e982ec419c39 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:53.663415 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f830e942-95c4-4a3f-af8f-e982ec419c39 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:53.668818 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb37ffb-03ca-4304-99ec-36eafdb95ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:53.669730 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb37ffb-03ca-4304-99ec-36eafdb95ce6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:53.670003 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb37ffb-03ca-4304-99ec-36eafdb95ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:53.670269 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb37ffb-03ca-4304-99ec-36eafdb95ce6 admin admin] PATH_INFO: `/v3/projects/b808c9d574d642f191528ad923fd1814/users/a5f5cbdad6e54173b94e9170a6ebc9cc/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:53.688342 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb37ffb-03ca-4304-99ec-36eafdb95ce6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b808c9d574d642f191528ad923fd1814, user_id=a5f5cbdad6e54173b94e9170a6ebc9cc, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:53.692535 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb37ffb-03ca-4304-99ec-36eafdb95ce6 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:53.712260 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1244/2495] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:58:53 2022] PUT /identity/v3/projects/b808c9d574d642f191528ad923fd1814/users/a5f5cbdad6e54173b94e9170a6ebc9cc/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:53.716109 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ebdc6-a43c-4419-8f52-c1e9bfb04d51 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:53.726260 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266ebdc6-a43c-4419-8f52-c1e9bfb04d51 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:53.788445 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b85928-c1ba-45d9-b070-f74460cbe17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:53.789445 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b85928-c1ba-45d9-b070-f74460cbe17b admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:53.789847 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b85928-c1ba-45d9-b070-f74460cbe17b admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:53.790139 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b85928-c1ba-45d9-b070-f74460cbe17b admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:53.791233 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b85928-c1ba-45d9-b070-f74460cbe17b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:53.793840 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b85928-c1ba-45d9-b070-f74460cbe17b admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:53.807332 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1252/2496] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:58:53.811740 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb37ffb-03ca-4304-99ec-36eafdb95ce6 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:53.822606 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb37ffb-03ca-4304-99ec-36eafdb95ce6 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:53.828448 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24958365-49b9-4b2f-ba97-da7b856a8287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:53.829397 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24958365-49b9-4b2f-ba97-da7b856a8287 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:53.829661 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24958365-49b9-4b2f-ba97-da7b856a8287 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:53.829930 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24958365-49b9-4b2f-ba97-da7b856a8287 admin admin] PATH_INFO: `/v3/projects/b808c9d574d642f191528ad923fd1814/users/a5f5cbdad6e54173b94e9170a6ebc9cc/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:53.831979 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24958365-49b9-4b2f-ba97-da7b856a8287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b808c9d574d642f191528ad923fd1814, user_id=a5f5cbdad6e54173b94e9170a6ebc9cc, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:53.834623 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24958365-49b9-4b2f-ba97-da7b856a8287 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:53.846960 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1245/2497] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:58:53 2022] PUT /identity/v3/projects/b808c9d574d642f191528ad923fd1814/users/a5f5cbdad6e54173b94e9170a6ebc9cc/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:53.859268 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1ba72-16d0-49a2-b88a-07381a12e579 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:53.859597 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1ba72-16d0-49a2-b88a-07381a12e579 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:53.859966 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d1ba72-16d0-49a2-b88a-07381a12e579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:53.889029 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-34d1ba72-16d0-49a2-b88a-07381a12e579 None None] MFA Rules not processed for user `a5f5cbdad6e54173b94e9170a6ebc9cc`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:53.890240 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-34d1ba72-16d0-49a2-b88a-07381a12e579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:53.969093 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1253/2498] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:58:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:58:53.981630 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24958365-49b9-4b2f-ba97-da7b856a8287 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:53.983671 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-24958365-49b9-4b2f-ba97-da7b856a8287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:54.045507 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24958365-49b9-4b2f-ba97-da7b856a8287 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:54.049202 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4059d55-32d4-438e-a851-83fb076d1974 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:54.049870 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4059d55-32d4-438e-a851-83fb076d1974 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:54.050149 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4059d55-32d4-438e-a851-83fb076d1974 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:54.050418 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4059d55-32d4-438e-a851-83fb076d1974 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:54.059873 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4059d55-32d4-438e-a851-83fb076d1974 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:54.061325 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4059d55-32d4-438e-a851-83fb076d1974 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:54.071246 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1246/2499] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:58:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:58:54.200114 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1ba72-16d0-49a2-b88a-07381a12e579 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:54.260846 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d1ba72-16d0-49a2-b88a-07381a12e579 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:54.265659 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2aee4-e6e4-4706-b5c6-e25f3c311bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:54.266514 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2aee4-e6e4-4706-b5c6-e25f3c311bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:54.266795 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2aee4-e6e4-4706-b5c6-e25f3c311bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:54.267060 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc2aee4-e6e4-4706-b5c6-e25f3c311bb0 admin admin] PATH_INFO: `/v3/users/f5510520954f492c95b3cf2d590e66b9` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:54.268274 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2aee4-e6e4-4706-b5c6-e25f3c311bb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5510520954f492c95b3cf2d590e66b9)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:54.270218 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc2aee4-e6e4-4706-b5c6-e25f3c311bb0 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:54.323317 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-6dc2aee4-e6e4-4706-b5c6-e25f3c311bb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5510520954f492c95b3cf2d590e66b9'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:54.323973 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-6dc2aee4-e6e4-4706-b5c6-e25f3c311bb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5510520954f492c95b3cf2d590e66b9'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:54.333151 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-6dc2aee4-e6e4-4706-b5c6-e25f3c311bb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5510520954f492c95b3cf2d590e66b9'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:54.340641 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-6dc2aee4-e6e4-4706-b5c6-e25f3c311bb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5510520954f492c95b3cf2d590e66b9'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:54.353447 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-6dc2aee4-e6e4-4706-b5c6-e25f3c311bb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5510520954f492c95b3cf2d590e66b9'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:54.359684 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1254/2500] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:58:54 2022] DELETE /identity/v3/users/f5510520954f492c95b3cf2d590e66b9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:54.364457 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc243fe8-d35e-489d-8b6a-3f35d5b84f9d None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:54.364745 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc243fe8-d35e-489d-8b6a-3f35d5b84f9d None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:54.365011 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc243fe8-d35e-489d-8b6a-3f35d5b84f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:54.382377 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-bc243fe8-d35e-489d-8b6a-3f35d5b84f9d None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:54.383664 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-bc243fe8-d35e-489d-8b6a-3f35d5b84f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:54.445062 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1247/2501] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:58:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:58:54.455126 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2aee4-e6e4-4706-b5c6-e25f3c311bb0 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:54.456682 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-6dc2aee4-e6e4-4706-b5c6-e25f3c311bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:54.512840 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc2aee4-e6e4-4706-b5c6-e25f3c311bb0 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:54.516802 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7dc5c-73d6-457b-84b1-995d13e0778c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:54.517478 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7dc5c-73d6-457b-84b1-995d13e0778c service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:54.517768 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7dc5c-73d6-457b-84b1-995d13e0778c service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:54.518039 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7dc5c-73d6-457b-84b1-995d13e0778c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:54.527490 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7dc5c-73d6-457b-84b1-995d13e0778c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:54.528915 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f7dc5c-73d6-457b-84b1-995d13e0778c service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:54.538410 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1255/2502] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:58:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:58:54.821443 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc243fe8-d35e-489d-8b6a-3f35d5b84f9d None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:54.823036 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-bc243fe8-d35e-489d-8b6a-3f35d5b84f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:54.836792 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc243fe8-d35e-489d-8b6a-3f35d5b84f9d None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:54.843021 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd30ba7-7f24-4f60-919b-ea5a68c9ecba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:54.851080 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd30ba7-7f24-4f60-919b-ea5a68c9ecba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:54.851363 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd30ba7-7f24-4f60-919b-ea5a68c9ecba admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:54.851628 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd30ba7-7f24-4f60-919b-ea5a68c9ecba admin admin] PATH_INFO: `/v3/projects/bc22975f9076445fb0e98ac1864ccef5` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:54.852880 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd30ba7-7f24-4f60-919b-ea5a68c9ecba admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc22975f9076445fb0e98ac1864ccef5)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:54.854780 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd30ba7-7f24-4f60-919b-ea5a68c9ecba admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:54.903560 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0cd30ba7-7f24-4f60-919b-ea5a68c9ecba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc22975f9076445fb0e98ac1864ccef5', 'request_id': 'req-0cd30ba7-7f24-4f60-919b-ea5a68c9ecba'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:54.909503 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0cd30ba7-7f24-4f60-919b-ea5a68c9ecba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc22975f9076445fb0e98ac1864ccef5', 'request_id': 'req-0cd30ba7-7f24-4f60-919b-ea5a68c9ecba'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:54.918336 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0cd30ba7-7f24-4f60-919b-ea5a68c9ecba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc22975f9076445fb0e98ac1864ccef5', 'request_id': 'req-0cd30ba7-7f24-4f60-919b-ea5a68c9ecba'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:54.928969 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0cd30ba7-7f24-4f60-919b-ea5a68c9ecba admin admin] The token cache is being invalidate because project bc22975f9076445fb0e98ac1864ccef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:58:54.929246 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0cd30ba7-7f24-4f60-919b-ea5a68c9ecba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:54.929890 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0cd30ba7-7f24-4f60-919b-ea5a68c9ecba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:54.931407 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1248/2503] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:58:54 2022] DELETE /identity/v3/projects/bc22975f9076445fb0e98ac1864ccef5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:54.935725 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7dc5c-73d6-457b-84b1-995d13e0778c service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:54.945815 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7dc5c-73d6-457b-84b1-995d13e0778c service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:55.004569 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6daa54-fd28-4d76-8050-3ca7f265af6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:55.005476 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6daa54-fd28-4d76-8050-3ca7f265af6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:55.005756 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6daa54-fd28-4d76-8050-3ca7f265af6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:55.006026 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6daa54-fd28-4d76-8050-3ca7f265af6d admin admin] PATH_INFO: `/v3/users/a5f5cbdad6e54173b94e9170a6ebc9cc` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:55.007257 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6daa54-fd28-4d76-8050-3ca7f265af6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5f5cbdad6e54173b94e9170a6ebc9cc)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:55.009183 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6daa54-fd28-4d76-8050-3ca7f265af6d admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:55.056068 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-3a6daa54-fd28-4d76-8050-3ca7f265af6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f5cbdad6e54173b94e9170a6ebc9cc'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:55.056624 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-3a6daa54-fd28-4d76-8050-3ca7f265af6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f5cbdad6e54173b94e9170a6ebc9cc'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:55.065322 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-3a6daa54-fd28-4d76-8050-3ca7f265af6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f5cbdad6e54173b94e9170a6ebc9cc'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:55.074739 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-3a6daa54-fd28-4d76-8050-3ca7f265af6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f5cbdad6e54173b94e9170a6ebc9cc'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:55.088472 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-3a6daa54-fd28-4d76-8050-3ca7f265af6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f5cbdad6e54173b94e9170a6ebc9cc'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:55.094380 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1256/2504] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:58:54 2022] DELETE /identity/v3/users/a5f5cbdad6e54173b94e9170a6ebc9cc => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:55.372727 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd30ba7-7f24-4f60-919b-ea5a68c9ecba admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:55.374306 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-0cd30ba7-7f24-4f60-919b-ea5a68c9ecba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:55.390220 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd30ba7-7f24-4f60-919b-ea5a68c9ecba admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:55.446201 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf40fc3-480e-4295-b21d-2c666ce0be90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:55.447054 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf40fc3-480e-4295-b21d-2c666ce0be90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:55.447373 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf40fc3-480e-4295-b21d-2c666ce0be90 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:55.447594 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf40fc3-480e-4295-b21d-2c666ce0be90 admin admin] PATH_INFO: `/v3/projects/b808c9d574d642f191528ad923fd1814` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:55.448801 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf40fc3-480e-4295-b21d-2c666ce0be90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b808c9d574d642f191528ad923fd1814)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:55.450699 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf40fc3-480e-4295-b21d-2c666ce0be90 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:55.499169 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-3bf40fc3-480e-4295-b21d-2c666ce0be90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b808c9d574d642f191528ad923fd1814', 'request_id': 'req-3bf40fc3-480e-4295-b21d-2c666ce0be90'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:55.505153 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-3bf40fc3-480e-4295-b21d-2c666ce0be90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b808c9d574d642f191528ad923fd1814', 'request_id': 'req-3bf40fc3-480e-4295-b21d-2c666ce0be90'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:55.514317 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-3bf40fc3-480e-4295-b21d-2c666ce0be90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b808c9d574d642f191528ad923fd1814', 'request_id': 'req-3bf40fc3-480e-4295-b21d-2c666ce0be90'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:55.524282 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-3bf40fc3-480e-4295-b21d-2c666ce0be90 admin admin] The token cache is being invalidate because project b808c9d574d642f191528ad923fd1814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:58:55.524559 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-3bf40fc3-480e-4295-b21d-2c666ce0be90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:55.525174 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-3bf40fc3-480e-4295-b21d-2c666ce0be90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:55.526719 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1249/2505] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:58:55 2022] DELETE /identity/v3/projects/b808c9d574d642f191528ad923fd1814 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:55.531888 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113a93f-10e0-48c1-a431-c022aa1b3c03 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:55.532184 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113a93f-10e0-48c1-a431-c022aa1b3c03 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:55.532467 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113a93f-10e0-48c1-a431-c022aa1b3c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:55.550935 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-b113a93f-10e0-48c1-a431-c022aa1b3c03 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:55.552136 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-b113a93f-10e0-48c1-a431-c022aa1b3c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:55.616064 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1257/2506] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:58:55.624122 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb89ba3-f12a-4bf4-8b65-fc507d1a028c None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:55.624401 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb89ba3-f12a-4bf4-8b65-fc507d1a028c None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:55.624635 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb89ba3-f12a-4bf4-8b65-fc507d1a028c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:55.643173 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-dfb89ba3-f12a-4bf4-8b65-fc507d1a028c None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:55.644347 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-dfb89ba3-f12a-4bf4-8b65-fc507d1a028c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:55.653264 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1250/2507] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:58:55.657993 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113a93f-10e0-48c1-a431-c022aa1b3c03 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:55.668333 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113a93f-10e0-48c1-a431-c022aa1b3c03 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:55.673703 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3219c2-c2e5-4fca-9619-990173eebbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:55.674352 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3219c2-c2e5-4fca-9619-990173eebbfb admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:55.674633 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3219c2-c2e5-4fca-9619-990173eebbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:55.674907 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3219c2-c2e5-4fca-9619-990173eebbfb admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:55.675632 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3219c2-c2e5-4fca-9619-990173eebbfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:58:55.675937 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3219c2-c2e5-4fca-9619-990173eebbfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:55.677597 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3219c2-c2e5-4fca-9619-990173eebbfb admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:55.689136 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1258/2508] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:58:55.693389 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb89ba3-f12a-4bf4-8b65-fc507d1a028c None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:55.703008 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb89ba3-f12a-4bf4-8b65-fc507d1a028c None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:55.708107 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01a0d9-e2e8-4236-b595-b8842ea08202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:55.708734 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01a0d9-e2e8-4236-b595-b8842ea08202 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:55.708989 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01a0d9-e2e8-4236-b595-b8842ea08202 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:55.709271 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01a0d9-e2e8-4236-b595-b8842ea08202 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:55.710001 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01a0d9-e2e8-4236-b595-b8842ea08202 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:55.712207 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01a0d9-e2e8-4236-b595-b8842ea08202 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:55.740674 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1251/2509] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:58:55 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:58:55.744973 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3219c2-c2e5-4fca-9619-990173eebbfb admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:55.755203 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3219c2-c2e5-4fca-9619-990173eebbfb admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:55.817663 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a392e-24a1-4890-af39-a57321c78970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:55.818311 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a392e-24a1-4890-af39-a57321c78970 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:55.818587 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a392e-24a1-4890-af39-a57321c78970 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:55.818857 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8a392e-24a1-4890-af39-a57321c78970 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:55.819546 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a392e-24a1-4890-af39-a57321c78970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:55.821597 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8a392e-24a1-4890-af39-a57321c78970 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:55.844380 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1259/2510] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:58:55 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:58:55.848631 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01a0d9-e2e8-4236-b595-b8842ea08202 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:55.858993 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01a0d9-e2e8-4236-b595-b8842ea08202 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:55.863950 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f9333-9246-4b5a-9204-fc7178a40a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:55.864594 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f9333-9246-4b5a-9204-fc7178a40a02 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:55.864869 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f9333-9246-4b5a-9204-fc7178a40a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:55.865137 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f9333-9246-4b5a-9204-fc7178a40a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:55.865892 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f9333-9246-4b5a-9204-fc7178a40a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:55.867557 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f9333-9246-4b5a-9204-fc7178a40a02 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:55.877559 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1252/2511] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:58:55.881494 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a392e-24a1-4890-af39-a57321c78970 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:55.892021 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8a392e-24a1-4890-af39-a57321c78970 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:55.897467 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8828be-d5d8-482d-970e-84d40751eda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:55.898211 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8828be-d5d8-482d-970e-84d40751eda9 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:55.898495 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8828be-d5d8-482d-970e-84d40751eda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:55.898769 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8828be-d5d8-482d-970e-84d40751eda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:55.899496 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8828be-d5d8-482d-970e-84d40751eda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:55.901123 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8828be-d5d8-482d-970e-84d40751eda9 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:55.911827 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1260/2512] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:58:55.916224 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f9333-9246-4b5a-9204-fc7178a40a02 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:55.927137 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f9333-9246-4b5a-9204-fc7178a40a02 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:55.932787 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efaeb3-6118-4023-9f4a-5f8904d74767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:55.933743 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efaeb3-6118-4023-9f4a-5f8904d74767 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:55.934012 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efaeb3-6118-4023-9f4a-5f8904d74767 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:55.934275 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efaeb3-6118-4023-9f4a-5f8904d74767 admin admin] PATH_INFO: `/v3/projects/dd4d98ccdff54d7c8b17df87172a5bc9/users/b509c1fab7d441d1bc44340908245b0f/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:55.949736 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efaeb3-6118-4023-9f4a-5f8904d74767 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd4d98ccdff54d7c8b17df87172a5bc9, user_id=b509c1fab7d441d1bc44340908245b0f, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:55.952395 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54efaeb3-6118-4023-9f4a-5f8904d74767 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:55.968789 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1253/2513] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:58:55 2022] PUT /identity/v3/projects/dd4d98ccdff54d7c8b17df87172a5bc9/users/b509c1fab7d441d1bc44340908245b0f/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:55.980438 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3fc66-dc4a-44a4-a320-ca04fc070f1c None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:55.980996 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3fc66-dc4a-44a4-a320-ca04fc070f1c None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:55.980996 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3fc66-dc4a-44a4-a320-ca04fc070f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:56.010235 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-99d3fc66-dc4a-44a4-a320-ca04fc070f1c None None] MFA Rules not processed for user `b509c1fab7d441d1bc44340908245b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:56.011446 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-99d3fc66-dc4a-44a4-a320-ca04fc070f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:56.081979 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1261/2514] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:58:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:58:56.086995 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efaeb3-6118-4023-9f4a-5f8904d74767 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:56.148821 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efaeb3-6118-4023-9f4a-5f8904d74767 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:56.154558 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9222bb8-f1aa-4d57-a67f-30d918d424f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:56.155206 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9222bb8-f1aa-4d57-a67f-30d918d424f9 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:56.155486 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9222bb8-f1aa-4d57-a67f-30d918d424f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:56.155762 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9222bb8-f1aa-4d57-a67f-30d918d424f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:56.156416 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9222bb8-f1aa-4d57-a67f-30d918d424f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:56.158382 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9222bb8-f1aa-4d57-a67f-30d918d424f9 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:56.186630 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1254/2515] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:58:56 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:58:56.190987 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3fc66-dc4a-44a4-a320-ca04fc070f1c None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:56.201989 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3fc66-dc4a-44a4-a320-ca04fc070f1c None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:56.259605 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42186cca-4ca3-471c-b459-89922d6c7fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:56.260267 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42186cca-4ca3-471c-b459-89922d6c7fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:56.260551 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42186cca-4ca3-471c-b459-89922d6c7fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:56.260824 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42186cca-4ca3-471c-b459-89922d6c7fa6 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:56.261545 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42186cca-4ca3-471c-b459-89922d6c7fa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:56.263465 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42186cca-4ca3-471c-b459-89922d6c7fa6 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:56.285213 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1262/2516] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:58:56 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:58:56.289437 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9222bb8-f1aa-4d57-a67f-30d918d424f9 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:56.299724 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9222bb8-f1aa-4d57-a67f-30d918d424f9 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:56.304824 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadf529-7942-4ea0-8d0a-e4c6aff562ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:56.305514 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadf529-7942-4ea0-8d0a-e4c6aff562ac admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:56.305791 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadf529-7942-4ea0-8d0a-e4c6aff562ac admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:56.306082 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadf529-7942-4ea0-8d0a-e4c6aff562ac admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:56.306807 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aadf529-7942-4ea0-8d0a-e4c6aff562ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:56.308374 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aadf529-7942-4ea0-8d0a-e4c6aff562ac admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:56.319060 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1255/2517] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:58:56.323156 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42186cca-4ca3-471c-b459-89922d6c7fa6 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:56.333823 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42186cca-4ca3-471c-b459-89922d6c7fa6 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:56.339994 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9c10f-8481-4dc8-b6a8-6d98c63dda71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:56.340911 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9c10f-8481-4dc8-b6a8-6d98c63dda71 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:56.341193 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9c10f-8481-4dc8-b6a8-6d98c63dda71 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:56.341574 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9c10f-8481-4dc8-b6a8-6d98c63dda71 admin admin] PATH_INFO: `/v3/projects/45d978d143c34478bfb5bec9789e0337/users/093ccd1d9f604096bde0c7c7a04c34a1/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:56.357236 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9c10f-8481-4dc8-b6a8-6d98c63dda71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d978d143c34478bfb5bec9789e0337, user_id=093ccd1d9f604096bde0c7c7a04c34a1, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:56.360047 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9c10f-8481-4dc8-b6a8-6d98c63dda71 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:56.375575 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1263/2518] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:58:56 2022] PUT /identity/v3/projects/45d978d143c34478bfb5bec9789e0337/users/093ccd1d9f604096bde0c7c7a04c34a1/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:56.379993 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadf529-7942-4ea0-8d0a-e4c6aff562ac admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:56.392065 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadf529-7942-4ea0-8d0a-e4c6aff562ac admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:56.453998 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d67277-713f-4a17-a908-0cb223df5c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:56.454666 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d67277-713f-4a17-a908-0cb223df5c7a admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:56.455018 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d67277-713f-4a17-a908-0cb223df5c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:56.455293 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d67277-713f-4a17-a908-0cb223df5c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:56.456011 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d67277-713f-4a17-a908-0cb223df5c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:56.457608 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d67277-713f-4a17-a908-0cb223df5c7a admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:56.467793 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1256/2519] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:58:56 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:58:56.472264 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9c10f-8481-4dc8-b6a8-6d98c63dda71 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:56.483629 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9c10f-8481-4dc8-b6a8-6d98c63dda71 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:56.489236 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4640653-bee6-408c-8332-e0700c59a4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:56.490159 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4640653-bee6-408c-8332-e0700c59a4ad admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:56.490440 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4640653-bee6-408c-8332-e0700c59a4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:56.490708 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4640653-bee6-408c-8332-e0700c59a4ad admin admin] PATH_INFO: `/v3/projects/45d978d143c34478bfb5bec9789e0337/users/093ccd1d9f604096bde0c7c7a04c34a1/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:56.492975 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4640653-bee6-408c-8332-e0700c59a4ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d978d143c34478bfb5bec9789e0337, user_id=093ccd1d9f604096bde0c7c7a04c34a1, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:56.495688 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4640653-bee6-408c-8332-e0700c59a4ad admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:56.507177 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1264/2520] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:58:56 2022] PUT /identity/v3/projects/45d978d143c34478bfb5bec9789e0337/users/093ccd1d9f604096bde0c7c7a04c34a1/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:56.517415 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee2623-08af-43d7-bc01-d9232b33b757 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:56.517712 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee2623-08af-43d7-bc01-d9232b33b757 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:56.517988 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee2623-08af-43d7-bc01-d9232b33b757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:56.544263 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-78ee2623-08af-43d7-bc01-d9232b33b757 None None] MFA Rules not processed for user `093ccd1d9f604096bde0c7c7a04c34a1`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:56.545510 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-78ee2623-08af-43d7-bc01-d9232b33b757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:56.619595 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1257/2521] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:58:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:58:56.632296 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4640653-bee6-408c-8332-e0700c59a4ad admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:56.634404 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-b4640653-bee6-408c-8332-e0700c59a4ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:56.704893 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4640653-bee6-408c-8332-e0700c59a4ad admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:56.711894 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6aaa72-e65f-48c9-a874-4fdb85428324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:56.712534 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6aaa72-e65f-48c9-a874-4fdb85428324 service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:56.712804 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6aaa72-e65f-48c9-a874-4fdb85428324 service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:56.713070 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6aaa72-e65f-48c9-a874-4fdb85428324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:56.723049 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6aaa72-e65f-48c9-a874-4fdb85428324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:56.724488 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6aaa72-e65f-48c9-a874-4fdb85428324 service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:56.733949 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1265/2522] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:58:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:58:56.805757 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee2623-08af-43d7-bc01-d9232b33b757 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:56.815661 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee2623-08af-43d7-bc01-d9232b33b757 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:56.819498 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e735a80-53dd-4802-82cc-705389d911f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:56.820151 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e735a80-53dd-4802-82cc-705389d911f1 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:56.820424 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e735a80-53dd-4802-82cc-705389d911f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:56.820861 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e735a80-53dd-4802-82cc-705389d911f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:56.876640 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e735a80-53dd-4802-82cc-705389d911f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:56.878080 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e735a80-53dd-4802-82cc-705389d911f1 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:56.886908 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1258/2523] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:58:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:58:57.146593 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6aaa72-e65f-48c9-a874-4fdb85428324 service cinder] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:57.205721 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6aaa72-e65f-48c9-a874-4fdb85428324 service cinder] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:57.211616 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165bf0c-e47c-491b-b2b2-bd13915170cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:57.212406 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165bf0c-e47c-491b-b2b2-bd13915170cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:57.212690 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165bf0c-e47c-491b-b2b2-bd13915170cd admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:57.212949 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165bf0c-e47c-491b-b2b2-bd13915170cd admin admin] PATH_INFO: `/v3/users/b509c1fab7d441d1bc44340908245b0f` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:57.214168 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165bf0c-e47c-491b-b2b2-bd13915170cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b509c1fab7d441d1bc44340908245b0f)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:57.216062 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165bf0c-e47c-491b-b2b2-bd13915170cd admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:57.267160 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-7165bf0c-e47c-491b-b2b2-bd13915170cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b509c1fab7d441d1bc44340908245b0f'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:57.267819 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-7165bf0c-e47c-491b-b2b2-bd13915170cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b509c1fab7d441d1bc44340908245b0f'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:57.278708 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-7165bf0c-e47c-491b-b2b2-bd13915170cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b509c1fab7d441d1bc44340908245b0f'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:57.285731 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-7165bf0c-e47c-491b-b2b2-bd13915170cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b509c1fab7d441d1bc44340908245b0f'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:57.297115 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-7165bf0c-e47c-491b-b2b2-bd13915170cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b509c1fab7d441d1bc44340908245b0f'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:57.302986 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1266/2524] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:58:57 2022] DELETE /identity/v3/users/b509c1fab7d441d1bc44340908245b0f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:57.307724 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642609f-5ab3-4376-bea2-5b3b5927de72 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:57.308009 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642609f-5ab3-4376-bea2-5b3b5927de72 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:57.308279 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642609f-5ab3-4376-bea2-5b3b5927de72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:57.325474 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-b642609f-5ab3-4376-bea2-5b3b5927de72 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:57.326647 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-b642609f-5ab3-4376-bea2-5b3b5927de72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:57.389653 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1259/2525] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:58:57.400020 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165bf0c-e47c-491b-b2b2-bd13915170cd admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:57.401597 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-7165bf0c-e47c-491b-b2b2-bd13915170cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:57.459538 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165bf0c-e47c-491b-b2b2-bd13915170cd admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:57.464322 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767e9b3-5350-494d-9b98-764ca5a636d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:57.464918 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767e9b3-5350-494d-9b98-764ca5a636d5 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:57.465196 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767e9b3-5350-494d-9b98-764ca5a636d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:57.465531 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7767e9b3-5350-494d-9b98-764ca5a636d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:57.476561 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767e9b3-5350-494d-9b98-764ca5a636d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:57.478047 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7767e9b3-5350-494d-9b98-764ca5a636d5 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:57.488007 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1267/2526] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:58:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:58:57.779076 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642609f-5ab3-4376-bea2-5b3b5927de72 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:57.780833 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-b642609f-5ab3-4376-bea2-5b3b5927de72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:57.793059 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642609f-5ab3-4376-bea2-5b3b5927de72 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:57.797902 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f292c5-d45f-451a-8e80-08bd1e544841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:57.798747 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f292c5-d45f-451a-8e80-08bd1e544841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:57.799025 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f292c5-d45f-451a-8e80-08bd1e544841 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:57.799293 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f292c5-d45f-451a-8e80-08bd1e544841 admin admin] PATH_INFO: `/v3/projects/dd4d98ccdff54d7c8b17df87172a5bc9` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:57.800474 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f292c5-d45f-451a-8e80-08bd1e544841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd4d98ccdff54d7c8b17df87172a5bc9)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:57.802577 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f292c5-d45f-451a-8e80-08bd1e544841 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:57.849584 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-80f292c5-d45f-451a-8e80-08bd1e544841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd4d98ccdff54d7c8b17df87172a5bc9', 'request_id': 'req-80f292c5-d45f-451a-8e80-08bd1e544841'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:57.855441 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-80f292c5-d45f-451a-8e80-08bd1e544841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd4d98ccdff54d7c8b17df87172a5bc9', 'request_id': 'req-80f292c5-d45f-451a-8e80-08bd1e544841'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:57.864537 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-80f292c5-d45f-451a-8e80-08bd1e544841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd4d98ccdff54d7c8b17df87172a5bc9', 'request_id': 'req-80f292c5-d45f-451a-8e80-08bd1e544841'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:57.874571 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-80f292c5-d45f-451a-8e80-08bd1e544841 admin admin] The token cache is being invalidate because project dd4d98ccdff54d7c8b17df87172a5bc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:58:57.874834 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-80f292c5-d45f-451a-8e80-08bd1e544841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:57.875455 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-80f292c5-d45f-451a-8e80-08bd1e544841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:57.876967 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1260/2527] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:58:57 2022] DELETE /identity/v3/projects/dd4d98ccdff54d7c8b17df87172a5bc9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:57.881155 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767e9b3-5350-494d-9b98-764ca5a636d5 service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:57.890790 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7767e9b3-5350-494d-9b98-764ca5a636d5 service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:57.953648 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f441f02-6630-4d2a-886a-394161cf6261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:57.954502 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f441f02-6630-4d2a-886a-394161cf6261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:57.954775 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f441f02-6630-4d2a-886a-394161cf6261 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:57.955043 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f441f02-6630-4d2a-886a-394161cf6261 admin admin] PATH_INFO: `/v3/users/093ccd1d9f604096bde0c7c7a04c34a1` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:57.956285 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f441f02-6630-4d2a-886a-394161cf6261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=093ccd1d9f604096bde0c7c7a04c34a1)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:57.958248 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f441f02-6630-4d2a-886a-394161cf6261 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:58.009243 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8f441f02-6630-4d2a-886a-394161cf6261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093ccd1d9f604096bde0c7c7a04c34a1'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:58.009874 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8f441f02-6630-4d2a-886a-394161cf6261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093ccd1d9f604096bde0c7c7a04c34a1'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:58.018855 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8f441f02-6630-4d2a-886a-394161cf6261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093ccd1d9f604096bde0c7c7a04c34a1'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:58.026030 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8f441f02-6630-4d2a-886a-394161cf6261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093ccd1d9f604096bde0c7c7a04c34a1'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:58.037896 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8f441f02-6630-4d2a-886a-394161cf6261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093ccd1d9f604096bde0c7c7a04c34a1'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:58.044072 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1268/2528] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:58:57 2022] DELETE /identity/v3/users/093ccd1d9f604096bde0c7c7a04c34a1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:58.325717 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f292c5-d45f-451a-8e80-08bd1e544841 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:58.327155 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-80f292c5-d45f-451a-8e80-08bd1e544841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:58.341937 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f292c5-d45f-451a-8e80-08bd1e544841 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:58.401865 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e5ad5-0cab-426c-a81f-edfe4b289583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:58.402729 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e5ad5-0cab-426c-a81f-edfe4b289583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:58.403005 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e5ad5-0cab-426c-a81f-edfe4b289583 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:58.403286 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e5ad5-0cab-426c-a81f-edfe4b289583 admin admin] PATH_INFO: `/v3/projects/45d978d143c34478bfb5bec9789e0337` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:58.404641 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e5ad5-0cab-426c-a81f-edfe4b289583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d978d143c34478bfb5bec9789e0337)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:58.406610 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e5ad5-0cab-426c-a81f-edfe4b289583 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:58.453477 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0a5e5ad5-0cab-426c-a81f-edfe4b289583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d978d143c34478bfb5bec9789e0337', 'request_id': 'req-0a5e5ad5-0cab-426c-a81f-edfe4b289583'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:58.459163 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0a5e5ad5-0cab-426c-a81f-edfe4b289583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d978d143c34478bfb5bec9789e0337', 'request_id': 'req-0a5e5ad5-0cab-426c-a81f-edfe4b289583'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:58.468916 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0a5e5ad5-0cab-426c-a81f-edfe4b289583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d978d143c34478bfb5bec9789e0337', 'request_id': 'req-0a5e5ad5-0cab-426c-a81f-edfe4b289583'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:58.480903 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0a5e5ad5-0cab-426c-a81f-edfe4b289583 admin admin] The token cache is being invalidate because project 45d978d143c34478bfb5bec9789e0337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:58:58.481184 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0a5e5ad5-0cab-426c-a81f-edfe4b289583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:58.481896 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0a5e5ad5-0cab-426c-a81f-edfe4b289583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:58:58.483713 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1261/2529] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:58:58 2022] DELETE /identity/v3/projects/45d978d143c34478bfb5bec9789e0337 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:58.488976 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45f4a5-9e66-4a38-bda7-23eb07753832 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:58.489499 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45f4a5-9e66-4a38-bda7-23eb07753832 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:58.489604 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b45f4a5-9e66-4a38-bda7-23eb07753832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:58.507871 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-3b45f4a5-9e66-4a38-bda7-23eb07753832 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:58.509058 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-3b45f4a5-9e66-4a38-bda7-23eb07753832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:58.568553 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1269/2530] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:58:58.576368 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c25d0e-298a-431c-981f-73b97ea2467d None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:58.576641 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c25d0e-298a-431c-981f-73b97ea2467d None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:58.576906 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c25d0e-298a-431c-981f-73b97ea2467d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:58.595688 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-d4c25d0e-298a-431c-981f-73b97ea2467d None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:58.596849 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-d4c25d0e-298a-431c-981f-73b97ea2467d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:58.605846 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1262/2531] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:58:58.612299 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45f4a5-9e66-4a38-bda7-23eb07753832 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:58.627365 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b45f4a5-9e66-4a38-bda7-23eb07753832 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:58.635229 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0a953-cb05-4ac8-bba5-63498e5d7b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:58.635895 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0a953-cb05-4ac8-bba5-63498e5d7b80 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:58.636149 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0a953-cb05-4ac8-bba5-63498e5d7b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:58.636424 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c0a953-cb05-4ac8-bba5-63498e5d7b80 admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:58.637156 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0a953-cb05-4ac8-bba5-63498e5d7b80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:58:58.637503 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0a953-cb05-4ac8-bba5-63498e5d7b80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:58.639118 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c0a953-cb05-4ac8-bba5-63498e5d7b80 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:58.651225 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1270/2532] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:58:58.655618 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c25d0e-298a-431c-981f-73b97ea2467d None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:58.665064 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c25d0e-298a-431c-981f-73b97ea2467d None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:58.671086 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca22385-0bf8-4fe0-b42d-3625b6327d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:58.671711 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca22385-0bf8-4fe0-b42d-3625b6327d3d admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:58.672010 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca22385-0bf8-4fe0-b42d-3625b6327d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:58.672270 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca22385-0bf8-4fe0-b42d-3625b6327d3d admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:58.673024 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca22385-0bf8-4fe0-b42d-3625b6327d3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:58.674980 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca22385-0bf8-4fe0-b42d-3625b6327d3d admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:58.706348 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1263/2533] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:58:58 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:58:58.712112 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0a953-cb05-4ac8-bba5-63498e5d7b80 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:58.727846 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c0a953-cb05-4ac8-bba5-63498e5d7b80 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:58.786943 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f04274-fd99-4594-8e56-95dc692236d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:58.787600 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f04274-fd99-4594-8e56-95dc692236d0 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:58.787885 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f04274-fd99-4594-8e56-95dc692236d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:58.788149 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f04274-fd99-4594-8e56-95dc692236d0 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:58.788869 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f04274-fd99-4594-8e56-95dc692236d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:58.790926 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f04274-fd99-4594-8e56-95dc692236d0 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:58.813031 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1271/2534] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:58:58 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:58:58.817433 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca22385-0bf8-4fe0-b42d-3625b6327d3d admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:58.828110 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca22385-0bf8-4fe0-b42d-3625b6327d3d admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:58.833953 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c9462-53b4-4316-8e1f-7a6d85a05e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:58.834614 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c9462-53b4-4316-8e1f-7a6d85a05e61 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:58.834887 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c9462-53b4-4316-8e1f-7a6d85a05e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:58.835151 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c9462-53b4-4316-8e1f-7a6d85a05e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:58.836258 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c9462-53b4-4316-8e1f-7a6d85a05e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:58.837884 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89c9462-53b4-4316-8e1f-7a6d85a05e61 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:58.849391 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1264/2535] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:58:58.853723 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f04274-fd99-4594-8e56-95dc692236d0 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:58.864207 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f04274-fd99-4594-8e56-95dc692236d0 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:58.870106 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3df0e-86f2-4b85-a3d5-d6a5b7471266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:58.870770 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3df0e-86f2-4b85-a3d5-d6a5b7471266 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:58.871050 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3df0e-86f2-4b85-a3d5-d6a5b7471266 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:58.871341 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3df0e-86f2-4b85-a3d5-d6a5b7471266 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:58.872059 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3df0e-86f2-4b85-a3d5-d6a5b7471266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:58.873698 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3df0e-86f2-4b85-a3d5-d6a5b7471266 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:58.883821 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1272/2536] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:58:58.888754 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c9462-53b4-4316-8e1f-7a6d85a05e61 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:58.902573 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c9462-53b4-4316-8e1f-7a6d85a05e61 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:58.908363 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9238633-5a7f-4a2f-8e99-b65d08ddcd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:58.909241 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9238633-5a7f-4a2f-8e99-b65d08ddcd05 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:58.909557 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9238633-5a7f-4a2f-8e99-b65d08ddcd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:58.909829 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9238633-5a7f-4a2f-8e99-b65d08ddcd05 admin admin] PATH_INFO: `/v3/projects/c40885295e954fdda4061783132df231/users/2f71f534d33a42a881ad33cd816e9335/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:58.924960 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9238633-5a7f-4a2f-8e99-b65d08ddcd05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c40885295e954fdda4061783132df231, user_id=2f71f534d33a42a881ad33cd816e9335, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:58.927592 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9238633-5a7f-4a2f-8e99-b65d08ddcd05 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:58.943195 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1265/2537] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:58:58 2022] PUT /identity/v3/projects/c40885295e954fdda4061783132df231/users/2f71f534d33a42a881ad33cd816e9335/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:58:58.955254 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dafe95-1c05-4582-bbcd-c5981eb2384c None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:58.955615 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dafe95-1c05-4582-bbcd-c5981eb2384c None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:58.956004 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dafe95-1c05-4582-bbcd-c5981eb2384c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:58.985924 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-44dafe95-1c05-4582-bbcd-c5981eb2384c None None] MFA Rules not processed for user `2f71f534d33a42a881ad33cd816e9335`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:58:58.987123 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-44dafe95-1c05-4582-bbcd-c5981eb2384c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:59.047811 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1273/2538] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:58:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:58:59.058560 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9238633-5a7f-4a2f-8e99-b65d08ddcd05 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:58:59.060458 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-a9238633-5a7f-4a2f-8e99-b65d08ddcd05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:58:59.119196 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9238633-5a7f-4a2f-8e99-b65d08ddcd05 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:58:59.123592 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98784327-d24f-4279-95f4-c70e0be59955 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:58:59.124231 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98784327-d24f-4279-95f4-c70e0be59955 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:58:59.124509 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98784327-d24f-4279-95f4-c70e0be59955 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:58:59.124778 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98784327-d24f-4279-95f4-c70e0be59955 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:58:59.133611 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98784327-d24f-4279-95f4-c70e0be59955 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:58:59.135011 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98784327-d24f-4279-95f4-c70e0be59955 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:58:59.143848 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1266/2539] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:58:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:59:06.582989 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dafe95-1c05-4582-bbcd-c5981eb2384c None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:06.657754 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dafe95-1c05-4582-bbcd-c5981eb2384c None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:06.662811 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf363e-d791-4aed-ad6a-5c437b10c323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:06.663686 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf363e-d791-4aed-ad6a-5c437b10c323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:06.663971 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf363e-d791-4aed-ad6a-5c437b10c323 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:06.664244 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf363e-d791-4aed-ad6a-5c437b10c323 admin admin] PATH_INFO: `/v3/users/2f71f534d33a42a881ad33cd816e9335` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:06.665460 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf363e-d791-4aed-ad6a-5c437b10c323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f71f534d33a42a881ad33cd816e9335)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:06.667406 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf363e-d791-4aed-ad6a-5c437b10c323 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:06.717022 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-80cf363e-d791-4aed-ad6a-5c437b10c323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f71f534d33a42a881ad33cd816e9335'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:06.717752 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-80cf363e-d791-4aed-ad6a-5c437b10c323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f71f534d33a42a881ad33cd816e9335'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:06.726662 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-80cf363e-d791-4aed-ad6a-5c437b10c323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f71f534d33a42a881ad33cd816e9335'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:06.734297 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-80cf363e-d791-4aed-ad6a-5c437b10c323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f71f534d33a42a881ad33cd816e9335'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:06.745720 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-80cf363e-d791-4aed-ad6a-5c437b10c323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f71f534d33a42a881ad33cd816e9335'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:06.751511 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1274/2540] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:59:06 2022] DELETE /identity/v3/users/2f71f534d33a42a881ad33cd816e9335 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:06.756298 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1528476-7a52-4ce3-beb8-75ad8ce45ccc None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:06.756775 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1528476-7a52-4ce3-beb8-75ad8ce45ccc None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:06.756884 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1528476-7a52-4ce3-beb8-75ad8ce45ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:06.774770 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-a1528476-7a52-4ce3-beb8-75ad8ce45ccc None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:06.775957 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-a1528476-7a52-4ce3-beb8-75ad8ce45ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:06.839961 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1267/2541] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:06.850057 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf363e-d791-4aed-ad6a-5c437b10c323 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:06.851561 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-80cf363e-d791-4aed-ad6a-5c437b10c323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:06.908383 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf363e-d791-4aed-ad6a-5c437b10c323 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:06.912787 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb865e36-0ad0-4147-b45f-303c5066c643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:06.913450 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb865e36-0ad0-4147-b45f-303c5066c643 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:06.913728 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb865e36-0ad0-4147-b45f-303c5066c643 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:06.914008 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb865e36-0ad0-4147-b45f-303c5066c643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:06.924282 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb865e36-0ad0-4147-b45f-303c5066c643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:06.926509 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb865e36-0ad0-4147-b45f-303c5066c643 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:06.941693 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1275/2542] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:59:07.207308 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1528476-7a52-4ce3-beb8-75ad8ce45ccc None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:07.208845 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-a1528476-7a52-4ce3-beb8-75ad8ce45ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:07.221747 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1528476-7a52-4ce3-beb8-75ad8ce45ccc None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:07.226727 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b353c-77f1-4a2a-beab-504e52ab4a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:07.227607 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b353c-77f1-4a2a-beab-504e52ab4a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:07.227868 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b353c-77f1-4a2a-beab-504e52ab4a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:07.228134 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b353c-77f1-4a2a-beab-504e52ab4a8b admin admin] PATH_INFO: `/v3/projects/c40885295e954fdda4061783132df231` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:07.229485 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b353c-77f1-4a2a-beab-504e52ab4a8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c40885295e954fdda4061783132df231)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:07.231432 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44b353c-77f1-4a2a-beab-504e52ab4a8b admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:07.280614 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-d44b353c-77f1-4a2a-beab-504e52ab4a8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c40885295e954fdda4061783132df231', 'request_id': 'req-d44b353c-77f1-4a2a-beab-504e52ab4a8b'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:07.287210 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-d44b353c-77f1-4a2a-beab-504e52ab4a8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c40885295e954fdda4061783132df231', 'request_id': 'req-d44b353c-77f1-4a2a-beab-504e52ab4a8b'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:07.295276 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-d44b353c-77f1-4a2a-beab-504e52ab4a8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c40885295e954fdda4061783132df231', 'request_id': 'req-d44b353c-77f1-4a2a-beab-504e52ab4a8b'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:07.305051 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-d44b353c-77f1-4a2a-beab-504e52ab4a8b admin admin] The token cache is being invalidate because project c40885295e954fdda4061783132df231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:59:07.305338 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-d44b353c-77f1-4a2a-beab-504e52ab4a8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:07.305996 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-d44b353c-77f1-4a2a-beab-504e52ab4a8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:07.307547 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1268/2543] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:59:07 2022] DELETE /identity/v3/projects/c40885295e954fdda4061783132df231 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:07.312659 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c39d2-4033-4fdc-8db3-b97dc9e5238c None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:07.312945 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c39d2-4033-4fdc-8db3-b97dc9e5238c None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:07.313218 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c39d2-4033-4fdc-8db3-b97dc9e5238c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:07.332075 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-519c39d2-4033-4fdc-8db3-b97dc9e5238c None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:07.333285 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-519c39d2-4033-4fdc-8db3-b97dc9e5238c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:07.406689 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1276/2544] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:07.415562 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b989ac0-8492-4ce8-8064-da47872dcd84 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:07.415909 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b989ac0-8492-4ce8-8064-da47872dcd84 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:07.416248 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b989ac0-8492-4ce8-8064-da47872dcd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:07.435685 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-5b989ac0-8492-4ce8-8064-da47872dcd84 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:07.436864 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-5b989ac0-8492-4ce8-8064-da47872dcd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:07.445583 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1269/2545] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:07.450588 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c39d2-4033-4fdc-8db3-b97dc9e5238c None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:07.464500 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c39d2-4033-4fdc-8db3-b97dc9e5238c None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:07.470023 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fce71-f8fa-4220-b217-594138e64b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:07.470700 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fce71-f8fa-4220-b217-594138e64b2d admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:07.470982 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fce71-f8fa-4220-b217-594138e64b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:07.471251 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fce71-f8fa-4220-b217-594138e64b2d admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:07.471991 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fce71-f8fa-4220-b217-594138e64b2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:59:07.472295 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fce71-f8fa-4220-b217-594138e64b2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:07.474016 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fce71-f8fa-4220-b217-594138e64b2d admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:07.486012 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1277/2546] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:59:07.490531 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b989ac0-8492-4ce8-8064-da47872dcd84 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:07.499921 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b989ac0-8492-4ce8-8064-da47872dcd84 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:07.505319 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836384a-81ab-4bcb-9b53-8cb2589efbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:07.506039 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836384a-81ab-4bcb-9b53-8cb2589efbba admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:07.506310 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836384a-81ab-4bcb-9b53-8cb2589efbba admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:07.506576 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836384a-81ab-4bcb-9b53-8cb2589efbba admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:07.507272 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836384a-81ab-4bcb-9b53-8cb2589efbba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:07.509181 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836384a-81ab-4bcb-9b53-8cb2589efbba admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:07.542347 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1270/2547] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:59:07 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:59:07.546838 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fce71-f8fa-4220-b217-594138e64b2d admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:07.561649 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fce71-f8fa-4220-b217-594138e64b2d admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:07.629809 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fa7ed-3110-467a-bbc2-ed444703c30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:07.630888 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fa7ed-3110-467a-bbc2-ed444703c30d admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:07.631234 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fa7ed-3110-467a-bbc2-ed444703c30d admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:07.631680 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fa7ed-3110-467a-bbc2-ed444703c30d admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:07.632809 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890fa7ed-3110-467a-bbc2-ed444703c30d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:07.635987 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890fa7ed-3110-467a-bbc2-ed444703c30d admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:07.662078 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1278/2548] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:59:07 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:59:07.666370 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836384a-81ab-4bcb-9b53-8cb2589efbba admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:07.677082 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836384a-81ab-4bcb-9b53-8cb2589efbba admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:07.682738 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376113a1-a47a-4b8a-9828-c5eb65dc96b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:07.683390 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376113a1-a47a-4b8a-9828-c5eb65dc96b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:07.683693 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376113a1-a47a-4b8a-9828-c5eb65dc96b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:07.683963 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376113a1-a47a-4b8a-9828-c5eb65dc96b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:07.684690 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376113a1-a47a-4b8a-9828-c5eb65dc96b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:07.686297 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376113a1-a47a-4b8a-9828-c5eb65dc96b8 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:07.696789 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1271/2549] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:59:07.700948 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fa7ed-3110-467a-bbc2-ed444703c30d admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:07.710983 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fa7ed-3110-467a-bbc2-ed444703c30d admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:07.716533 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fa35c-a55c-479a-9453-eab2fbb7877f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:07.717188 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fa35c-a55c-479a-9453-eab2fbb7877f admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:07.717510 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fa35c-a55c-479a-9453-eab2fbb7877f admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:07.717787 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fa35c-a55c-479a-9453-eab2fbb7877f admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:07.718534 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fa35c-a55c-479a-9453-eab2fbb7877f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:07.720151 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96fa35c-a55c-479a-9453-eab2fbb7877f admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:07.730179 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1279/2550] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:59:07.734510 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376113a1-a47a-4b8a-9828-c5eb65dc96b8 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:07.744575 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376113a1-a47a-4b8a-9828-c5eb65dc96b8 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:07.749659 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78207ba3-b6a9-47f2-bd3b-54b01464439f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:07.750534 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78207ba3-b6a9-47f2-bd3b-54b01464439f admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:07.750813 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78207ba3-b6a9-47f2-bd3b-54b01464439f admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:07.751084 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78207ba3-b6a9-47f2-bd3b-54b01464439f admin admin] PATH_INFO: `/v3/projects/3dd0af95b4eb48e581f461018ea4fdf9/users/ed5ef66d20844420893a92ce69656c56/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:07.766773 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78207ba3-b6a9-47f2-bd3b-54b01464439f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dd0af95b4eb48e581f461018ea4fdf9, user_id=ed5ef66d20844420893a92ce69656c56, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:07.769436 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78207ba3-b6a9-47f2-bd3b-54b01464439f admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:07.788559 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1272/2551] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:59:07 2022] PUT /identity/v3/projects/3dd0af95b4eb48e581f461018ea4fdf9/users/ed5ef66d20844420893a92ce69656c56/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:07.800177 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e50b33-50d1-46fa-9527-f858beb74141 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:07.800425 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e50b33-50d1-46fa-9527-f858beb74141 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:07.800800 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e50b33-50d1-46fa-9527-f858beb74141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:07.830244 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-76e50b33-50d1-46fa-9527-f858beb74141 None None] MFA Rules not processed for user `ed5ef66d20844420893a92ce69656c56`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:07.831510 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-76e50b33-50d1-46fa-9527-f858beb74141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:07.899328 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1280/2552] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:07.912173 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78207ba3-b6a9-47f2-bd3b-54b01464439f admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:07.914191 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-78207ba3-b6a9-47f2-bd3b-54b01464439f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:07.972148 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78207ba3-b6a9-47f2-bd3b-54b01464439f admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:07.976089 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cc499-dae3-44d4-bd0e-d22a8e72bc6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:07.976724 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cc499-dae3-44d4-bd0e-d22a8e72bc6f service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:07.977068 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cc499-dae3-44d4-bd0e-d22a8e72bc6f service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:07.977309 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cc499-dae3-44d4-bd0e-d22a8e72bc6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:07.986639 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cc499-dae3-44d4-bd0e-d22a8e72bc6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:07.988117 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cc499-dae3-44d4-bd0e-d22a8e72bc6f service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:07.997989 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1273/2553] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:59:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:59:10.545844 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e50b33-50d1-46fa-9527-f858beb74141 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:10.616067 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e50b33-50d1-46fa-9527-f858beb74141 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:10.616348 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e26667-b040-4e23-bbe8-25eb92ca4190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:10.617446 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e26667-b040-4e23-bbe8-25eb92ca4190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:10.617587 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e26667-b040-4e23-bbe8-25eb92ca4190 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:10.617826 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e26667-b040-4e23-bbe8-25eb92ca4190 admin admin] PATH_INFO: `/v3/users/ed5ef66d20844420893a92ce69656c56` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:10.619359 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e26667-b040-4e23-bbe8-25eb92ca4190 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed5ef66d20844420893a92ce69656c56)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:10.620982 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e26667-b040-4e23-bbe8-25eb92ca4190 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:10.677504 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-29e26667-b040-4e23-bbe8-25eb92ca4190 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed5ef66d20844420893a92ce69656c56'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:10.678335 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-29e26667-b040-4e23-bbe8-25eb92ca4190 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed5ef66d20844420893a92ce69656c56'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:10.687116 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-29e26667-b040-4e23-bbe8-25eb92ca4190 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed5ef66d20844420893a92ce69656c56'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:10.694721 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-29e26667-b040-4e23-bbe8-25eb92ca4190 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed5ef66d20844420893a92ce69656c56'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:10.709314 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-29e26667-b040-4e23-bbe8-25eb92ca4190 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed5ef66d20844420893a92ce69656c56'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:10.719555 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1281/2554] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:59:10 2022] DELETE /identity/v3/users/ed5ef66d20844420893a92ce69656c56 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:10.721230 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840320d-9e6f-46a4-ad41-d3458cf97af4 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:10.721728 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840320d-9e6f-46a4-ad41-d3458cf97af4 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:10.721830 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840320d-9e6f-46a4-ad41-d3458cf97af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:10.740288 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-e840320d-9e6f-46a4-ad41-d3458cf97af4 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:10.741530 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-e840320d-9e6f-46a4-ad41-d3458cf97af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:10.807613 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1274/2555] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:10.817623 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e26667-b040-4e23-bbe8-25eb92ca4190 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:10.819040 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-29e26667-b040-4e23-bbe8-25eb92ca4190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:10.902107 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e26667-b040-4e23-bbe8-25eb92ca4190 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:10.906779 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7fec6-c666-40e1-a713-ba1bf17a8bed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:10.907440 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7fec6-c666-40e1-a713-ba1bf17a8bed service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:10.907721 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7fec6-c666-40e1-a713-ba1bf17a8bed service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:10.907989 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7fec6-c666-40e1-a713-ba1bf17a8bed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:10.918080 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7fec6-c666-40e1-a713-ba1bf17a8bed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:10.919659 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7fec6-c666-40e1-a713-ba1bf17a8bed service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:10.930437 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1282/2556] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:59:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:59:11.198570 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840320d-9e6f-46a4-ad41-d3458cf97af4 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:11.200365 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-e840320d-9e6f-46a4-ad41-d3458cf97af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:11.213655 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840320d-9e6f-46a4-ad41-d3458cf97af4 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:11.218406 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e758c-4045-4b20-acd7-bc7fa8608c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:11.219275 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e758c-4045-4b20-acd7-bc7fa8608c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:11.219541 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e758c-4045-4b20-acd7-bc7fa8608c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:11.220008 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e758c-4045-4b20-acd7-bc7fa8608c1e admin admin] PATH_INFO: `/v3/projects/3dd0af95b4eb48e581f461018ea4fdf9` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:11.221219 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e758c-4045-4b20-acd7-bc7fa8608c1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dd0af95b4eb48e581f461018ea4fdf9)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:11.223133 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e758c-4045-4b20-acd7-bc7fa8608c1e admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:11.277564 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0b7e758c-4045-4b20-acd7-bc7fa8608c1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dd0af95b4eb48e581f461018ea4fdf9', 'request_id': 'req-0b7e758c-4045-4b20-acd7-bc7fa8608c1e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:11.283511 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0b7e758c-4045-4b20-acd7-bc7fa8608c1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dd0af95b4eb48e581f461018ea4fdf9', 'request_id': 'req-0b7e758c-4045-4b20-acd7-bc7fa8608c1e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:11.293240 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0b7e758c-4045-4b20-acd7-bc7fa8608c1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dd0af95b4eb48e581f461018ea4fdf9', 'request_id': 'req-0b7e758c-4045-4b20-acd7-bc7fa8608c1e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:11.304322 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0b7e758c-4045-4b20-acd7-bc7fa8608c1e admin admin] The token cache is being invalidate because project 3dd0af95b4eb48e581f461018ea4fdf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:59:11.304609 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0b7e758c-4045-4b20-acd7-bc7fa8608c1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:11.305295 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0b7e758c-4045-4b20-acd7-bc7fa8608c1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:11.306979 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1275/2557] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:59:11 2022] DELETE /identity/v3/projects/3dd0af95b4eb48e581f461018ea4fdf9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:11.312055 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e84cd-b35a-4ad8-8e19-1eb72d688c41 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:11.312340 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e84cd-b35a-4ad8-8e19-1eb72d688c41 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:11.312618 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e84cd-b35a-4ad8-8e19-1eb72d688c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:11.338747 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-b49e84cd-b35a-4ad8-8e19-1eb72d688c41 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:11.340229 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-b49e84cd-b35a-4ad8-8e19-1eb72d688c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:11.455792 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1283/2558] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:11.464630 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1a852-5434-49d0-9ac1-355336332daf None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:11.464960 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1a852-5434-49d0-9ac1-355336332daf None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:11.465239 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1a852-5434-49d0-9ac1-355336332daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:11.497523 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-39a1a852-5434-49d0-9ac1-355336332daf None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:11.499195 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-39a1a852-5434-49d0-9ac1-355336332daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:11.517080 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1276/2559] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:11.517997 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e84cd-b35a-4ad8-8e19-1eb72d688c41 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:11.531268 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e84cd-b35a-4ad8-8e19-1eb72d688c41 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:11.540620 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba8e3a-1050-4b77-b675-387602aea860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:11.541583 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba8e3a-1050-4b77-b675-387602aea860 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:11.542350 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba8e3a-1050-4b77-b675-387602aea860 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:11.542350 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba8e3a-1050-4b77-b675-387602aea860 admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:11.543390 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba8e3a-1050-4b77-b675-387602aea860 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:59:11.544479 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba8e3a-1050-4b77-b675-387602aea860 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:11.546355 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba8e3a-1050-4b77-b675-387602aea860 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:11.560320 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1284/2560] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:59:11.565369 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1a852-5434-49d0-9ac1-355336332daf None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:11.583374 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1a852-5434-49d0-9ac1-355336332daf None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:11.588908 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd18f6-e884-4c71-ba19-eda06605cb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:11.589624 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd18f6-e884-4c71-ba19-eda06605cb3a admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:11.589972 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd18f6-e884-4c71-ba19-eda06605cb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:11.590494 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd18f6-e884-4c71-ba19-eda06605cb3a admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:11.591208 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd18f6-e884-4c71-ba19-eda06605cb3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:11.593570 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd18f6-e884-4c71-ba19-eda06605cb3a admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:11.631601 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1277/2561] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:59:11 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:59:11.636259 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba8e3a-1050-4b77-b675-387602aea860 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:11.650008 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba8e3a-1050-4b77-b675-387602aea860 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:11.849019 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2cc63-fde9-4cd9-9fb1-37e50cda54df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:11.849801 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2cc63-fde9-4cd9-9fb1-37e50cda54df admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:11.850323 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2cc63-fde9-4cd9-9fb1-37e50cda54df admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:11.850428 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2cc63-fde9-4cd9-9fb1-37e50cda54df admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:11.851206 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2cc63-fde9-4cd9-9fb1-37e50cda54df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:11.853275 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2cc63-fde9-4cd9-9fb1-37e50cda54df admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:11.875374 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1285/2562] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:59:11 2022] POST /identity/v3/users => generated 288 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:59:11.879595 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd18f6-e884-4c71-ba19-eda06605cb3a admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:11.889732 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd18f6-e884-4c71-ba19-eda06605cb3a admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:11.897625 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160795ae-8992-4ee1-9000-8bfafffcb542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:11.898304 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160795ae-8992-4ee1-9000-8bfafffcb542 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:11.898666 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160795ae-8992-4ee1-9000-8bfafffcb542 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:11.898942 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160795ae-8992-4ee1-9000-8bfafffcb542 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:11.899887 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160795ae-8992-4ee1-9000-8bfafffcb542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:11.901824 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160795ae-8992-4ee1-9000-8bfafffcb542 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:11.913680 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1278/2563] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:59:11.918011 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2cc63-fde9-4cd9-9fb1-37e50cda54df admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:11.928358 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2cc63-fde9-4cd9-9fb1-37e50cda54df admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:11.933194 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1e0633-88d6-4a98-9bb1-46257c4470e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:11.933929 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e0633-88d6-4a98-9bb1-46257c4470e3 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:11.934082 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e0633-88d6-4a98-9bb1-46257c4470e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:11.934348 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1e0633-88d6-4a98-9bb1-46257c4470e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:11.935068 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e0633-88d6-4a98-9bb1-46257c4470e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:11.936643 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1e0633-88d6-4a98-9bb1-46257c4470e3 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:11.952941 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1286/2564] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:59:11.957326 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160795ae-8992-4ee1-9000-8bfafffcb542 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:11.968634 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160795ae-8992-4ee1-9000-8bfafffcb542 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:11.973129 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccd3d8-822c-4398-a4c3-1310c65c75fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:11.974065 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccd3d8-822c-4398-a4c3-1310c65c75fe admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:11.974340 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccd3d8-822c-4398-a4c3-1310c65c75fe admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:11.974607 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccd3d8-822c-4398-a4c3-1310c65c75fe admin admin] PATH_INFO: `/v3/projects/0d4e8bfdf8ce4456a9cf6849b84b9eb2/users/7127893ff848407a9c2b17e60acde39e/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:11.992126 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccd3d8-822c-4398-a4c3-1310c65c75fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d4e8bfdf8ce4456a9cf6849b84b9eb2, user_id=7127893ff848407a9c2b17e60acde39e, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:11.995400 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccd3d8-822c-4398-a4c3-1310c65c75fe admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:12.013654 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1279/2565] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:59:11 2022] PUT /identity/v3/projects/0d4e8bfdf8ce4456a9cf6849b84b9eb2/users/7127893ff848407a9c2b17e60acde39e/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:59:12.024327 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eedc94-23bf-4d4d-9fce-81260d6c3341 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:12.024781 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eedc94-23bf-4d4d-9fce-81260d6c3341 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:12.025052 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eedc94-23bf-4d4d-9fce-81260d6c3341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:12.053673 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-16eedc94-23bf-4d4d-9fce-81260d6c3341 None None] MFA Rules not processed for user `7127893ff848407a9c2b17e60acde39e`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:12.054891 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-16eedc94-23bf-4d4d-9fce-81260d6c3341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:12.122665 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1287/2566] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:12.133084 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccd3d8-822c-4398-a4c3-1310c65c75fe admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:12.134860 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f1ccd3d8-822c-4398-a4c3-1310c65c75fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:12.194118 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccd3d8-822c-4398-a4c3-1310c65c75fe admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:12.198092 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92aa66-f686-4f06-a4d1-863f8584dcdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:12.199001 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92aa66-f686-4f06-a4d1-863f8584dcdb service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:12.199452 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92aa66-f686-4f06-a4d1-863f8584dcdb service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:12.200270 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92aa66-f686-4f06-a4d1-863f8584dcdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:12.210862 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92aa66-f686-4f06-a4d1-863f8584dcdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:12.212767 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92aa66-f686-4f06-a4d1-863f8584dcdb service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:12.222312 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1280/2567] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:59:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:59:15.599056 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eedc94-23bf-4d4d-9fce-81260d6c3341 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:15.600580 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-16eedc94-23bf-4d4d-9fce-81260d6c3341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:15.656227 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eedc94-23bf-4d4d-9fce-81260d6c3341 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:15.659894 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa7d0f-d7f1-475f-9450-e62eae3e2f00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:15.660597 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa7d0f-d7f1-475f-9450-e62eae3e2f00 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:15.660833 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa7d0f-d7f1-475f-9450-e62eae3e2f00 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:15.661099 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa7d0f-d7f1-475f-9450-e62eae3e2f00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:15.662871 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-78aa7d0f-d7f1-475f-9450-e62eae3e2f00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:15.724642 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa7d0f-d7f1-475f-9450-e62eae3e2f00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:15.726104 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa7d0f-d7f1-475f-9450-e62eae3e2f00 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:15.741245 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1288/2568] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:59:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:59:19.252112 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92aa66-f686-4f06-a4d1-863f8584dcdb service cinder] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:19.253881 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-cb92aa66-f686-4f06-a4d1-863f8584dcdb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:19.275425 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92aa66-f686-4f06-a4d1-863f8584dcdb service cinder] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:19.279982 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f022e55-0f45-4d2c-9ad3-d7fa1961c925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:19.280878 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f022e55-0f45-4d2c-9ad3-d7fa1961c925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:19.281155 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f022e55-0f45-4d2c-9ad3-d7fa1961c925 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:19.281460 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f022e55-0f45-4d2c-9ad3-d7fa1961c925 admin admin] PATH_INFO: `/v3/users/3f7d37d467324d88ae189dc8d89c314a` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:19.282638 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f022e55-0f45-4d2c-9ad3-d7fa1961c925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f7d37d467324d88ae189dc8d89c314a)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:19.284538 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f022e55-0f45-4d2c-9ad3-d7fa1961c925 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:19.334364 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-6f022e55-0f45-4d2c-9ad3-d7fa1961c925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f7d37d467324d88ae189dc8d89c314a'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:19.335120 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-6f022e55-0f45-4d2c-9ad3-d7fa1961c925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f7d37d467324d88ae189dc8d89c314a'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:19.345274 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-6f022e55-0f45-4d2c-9ad3-d7fa1961c925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f7d37d467324d88ae189dc8d89c314a'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:19.357380 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-6f022e55-0f45-4d2c-9ad3-d7fa1961c925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f7d37d467324d88ae189dc8d89c314a'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:19.364414 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-6f022e55-0f45-4d2c-9ad3-d7fa1961c925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f7d37d467324d88ae189dc8d89c314a'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:19.370401 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1281/2569] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:59:19 2022] DELETE /identity/v3/users/3f7d37d467324d88ae189dc8d89c314a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:19.544683 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa7d0f-d7f1-475f-9450-e62eae3e2f00 service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:19.563294 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa7d0f-d7f1-475f-9450-e62eae3e2f00 service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:19.619108 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed25c42d-ce3c-4200-af03-6ba869b17e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:19.620334 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25c42d-ce3c-4200-af03-6ba869b17e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:19.620609 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25c42d-ce3c-4200-af03-6ba869b17e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:19.620878 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed25c42d-ce3c-4200-af03-6ba869b17e3a admin admin] PATH_INFO: `/v3/projects/98537a177d784e0cb148e3f73688f0c0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:19.622178 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25c42d-ce3c-4200-af03-6ba869b17e3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=98537a177d784e0cb148e3f73688f0c0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:19.624756 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed25c42d-ce3c-4200-af03-6ba869b17e3a admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:19.672551 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ed25c42d-ce3c-4200-af03-6ba869b17e3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98537a177d784e0cb148e3f73688f0c0', 'request_id': 'req-ed25c42d-ce3c-4200-af03-6ba869b17e3a'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:19.678734 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ed25c42d-ce3c-4200-af03-6ba869b17e3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98537a177d784e0cb148e3f73688f0c0', 'request_id': 'req-ed25c42d-ce3c-4200-af03-6ba869b17e3a'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:19.688236 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ed25c42d-ce3c-4200-af03-6ba869b17e3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98537a177d784e0cb148e3f73688f0c0', 'request_id': 'req-ed25c42d-ce3c-4200-af03-6ba869b17e3a'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:19.698217 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ed25c42d-ce3c-4200-af03-6ba869b17e3a admin admin] The token cache is being invalidate because project 98537a177d784e0cb148e3f73688f0c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:59:19.698534 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ed25c42d-ce3c-4200-af03-6ba869b17e3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:19.699146 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ed25c42d-ce3c-4200-af03-6ba869b17e3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:19.700706 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1289/2570] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:59:19 2022] DELETE /identity/v3/projects/98537a177d784e0cb148e3f73688f0c0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:59:19.705732 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618ed3c-4c59-4a3a-bd11-3c4204ac63a6 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:19.706042 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618ed3c-4c59-4a3a-bd11-3c4204ac63a6 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:19.706314 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618ed3c-4c59-4a3a-bd11-3c4204ac63a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:19.724694 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-e618ed3c-4c59-4a3a-bd11-3c4204ac63a6 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:19.725853 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-e618ed3c-4c59-4a3a-bd11-3c4204ac63a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:19.784018 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1282/2571] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:59:19.792166 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafb84f-8125-40a0-b147-9403cec4b9cf None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:19.792454 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafb84f-8125-40a0-b147-9403cec4b9cf None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:19.792729 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafb84f-8125-40a0-b147-9403cec4b9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:19.811479 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-6bafb84f-8125-40a0-b147-9403cec4b9cf None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:19.812759 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-6bafb84f-8125-40a0-b147-9403cec4b9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:19.821219 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1290/2572] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:59:19.825241 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618ed3c-4c59-4a3a-bd11-3c4204ac63a6 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:19.835231 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618ed3c-4c59-4a3a-bd11-3c4204ac63a6 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:19.840826 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08dfd5c-d5df-438d-807d-7ba8064af221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:19.841586 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dfd5c-d5df-438d-807d-7ba8064af221 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:19.841910 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dfd5c-d5df-438d-807d-7ba8064af221 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:19.842207 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08dfd5c-d5df-438d-807d-7ba8064af221 admin admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:19.843915 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08dfd5c-d5df-438d-807d-7ba8064af221 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:59:19.844595 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08dfd5c-d5df-438d-807d-7ba8064af221 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:19.847441 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08dfd5c-d5df-438d-807d-7ba8064af221 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:19.869040 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1283/2573] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:59:19.870608 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafb84f-8125-40a0-b147-9403cec4b9cf None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:19.883663 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafb84f-8125-40a0-b147-9403cec4b9cf None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:19.889670 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8676dd-273f-47be-ac0a-26ee2caa22f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:19.890507 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8676dd-273f-47be-ac0a-26ee2caa22f1 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:19.890955 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8676dd-273f-47be-ac0a-26ee2caa22f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:19.891345 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8676dd-273f-47be-ac0a-26ee2caa22f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:19.892367 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8676dd-273f-47be-ac0a-26ee2caa22f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:19.895106 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8676dd-273f-47be-ac0a-26ee2caa22f1 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:19.924710 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1291/2574] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:59:19 2022] POST /identity/v3/projects => generated 403 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:59:19.928815 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08dfd5c-d5df-438d-807d-7ba8064af221 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:19.938893 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08dfd5c-d5df-438d-807d-7ba8064af221 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:19.997206 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed27664-80d9-454c-b2e3-a489d6296bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:19.997913 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed27664-80d9-454c-b2e3-a489d6296bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:19.998190 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed27664-80d9-454c-b2e3-a489d6296bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:19.998456 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed27664-80d9-454c-b2e3-a489d6296bf9 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:19.999473 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed27664-80d9-454c-b2e3-a489d6296bf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:20.001217 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed27664-80d9-454c-b2e3-a489d6296bf9 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:20.023450 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1284/2575] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:59:19 2022] POST /identity/v3/users => generated 302 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:59:20.027750 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8676dd-273f-47be-ac0a-26ee2caa22f1 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:20.047562 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8676dd-273f-47be-ac0a-26ee2caa22f1 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:20.047562 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bbe74-e71f-41bd-86fe-ad306d86b4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:20.047562 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bbe74-e71f-41bd-86fe-ad306d86b4dc admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:20.047562 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bbe74-e71f-41bd-86fe-ad306d86b4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:20.047987 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bbe74-e71f-41bd-86fe-ad306d86b4dc admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:20.047987 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4bbe74-e71f-41bd-86fe-ad306d86b4dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:20.048921 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4bbe74-e71f-41bd-86fe-ad306d86b4dc admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:20.059879 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1292/2576] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:59:20.064192 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed27664-80d9-454c-b2e3-a489d6296bf9 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:20.074020 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed27664-80d9-454c-b2e3-a489d6296bf9 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:20.078801 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c206fc5-955b-41fe-99c0-b201d15b76dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:20.079452 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c206fc5-955b-41fe-99c0-b201d15b76dc admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:20.079729 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c206fc5-955b-41fe-99c0-b201d15b76dc admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:20.079998 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c206fc5-955b-41fe-99c0-b201d15b76dc admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:20.080744 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c206fc5-955b-41fe-99c0-b201d15b76dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:20.082371 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c206fc5-955b-41fe-99c0-b201d15b76dc admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:20.092364 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1285/2577] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:59:20.096629 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bbe74-e71f-41bd-86fe-ad306d86b4dc admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:20.106888 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bbe74-e71f-41bd-86fe-ad306d86b4dc admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:20.111884 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d65601-b46a-4fd6-a2f2-66368be4cc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:20.112812 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d65601-b46a-4fd6-a2f2-66368be4cc94 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:20.113145 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d65601-b46a-4fd6-a2f2-66368be4cc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:20.113456 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d65601-b46a-4fd6-a2f2-66368be4cc94 admin admin] PATH_INFO: `/v3/projects/a83496ad604041208907d111bf48dd8a/users/19c384fb8fdc4e9097b0cba0e886d846/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:20.128074 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d65601-b46a-4fd6-a2f2-66368be4cc94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a83496ad604041208907d111bf48dd8a, user_id=19c384fb8fdc4e9097b0cba0e886d846, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:20.130791 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d65601-b46a-4fd6-a2f2-66368be4cc94 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:20.144839 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1293/2578] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:59:20 2022] PUT /identity/v3/projects/a83496ad604041208907d111bf48dd8a/users/19c384fb8fdc4e9097b0cba0e886d846/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:20.155302 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63da47-ad29-4945-86e0-0b0c82b8c0e3 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:20.155591 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63da47-ad29-4945-86e0-0b0c82b8c0e3 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:20.155864 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63da47-ad29-4945-86e0-0b0c82b8c0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:20.182390 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-1a63da47-ad29-4945-86e0-0b0c82b8c0e3 None None] MFA Rules not processed for user `19c384fb8fdc4e9097b0cba0e886d846`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:20.183646 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-1a63da47-ad29-4945-86e0-0b0c82b8c0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:20.255898 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1286/2579] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:20.260651 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d65601-b46a-4fd6-a2f2-66368be4cc94 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:20.323762 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d65601-b46a-4fd6-a2f2-66368be4cc94 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:20.328697 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c3def-4750-4c6a-8b8c-a9e3c76b8458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:20.329372 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c3def-4750-4c6a-8b8c-a9e3c76b8458 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:20.329665 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c3def-4750-4c6a-8b8c-a9e3c76b8458 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:20.330036 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c3def-4750-4c6a-8b8c-a9e3c76b8458 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:20.330616 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c3def-4750-4c6a-8b8c-a9e3c76b8458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:20.332502 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c3def-4750-4c6a-8b8c-a9e3c76b8458 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:20.358253 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1294/2580] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:59:20 2022] POST /identity/v3/projects => generated 405 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:59:20.362596 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63da47-ad29-4945-86e0-0b0c82b8c0e3 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:20.372995 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63da47-ad29-4945-86e0-0b0c82b8c0e3 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:20.430841 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe109c-5dee-49ab-9f91-76da17b7697d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:20.431698 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe109c-5dee-49ab-9f91-76da17b7697d admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:20.432076 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe109c-5dee-49ab-9f91-76da17b7697d admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:20.432360 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe109c-5dee-49ab-9f91-76da17b7697d admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:20.433166 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe109c-5dee-49ab-9f91-76da17b7697d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:20.435204 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe109c-5dee-49ab-9f91-76da17b7697d admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:20.457409 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1287/2581] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:59:20 2022] POST /identity/v3/users => generated 309 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:59:20.462179 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c3def-4750-4c6a-8b8c-a9e3c76b8458 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:20.473292 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c3def-4750-4c6a-8b8c-a9e3c76b8458 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:20.478825 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e6aae-3207-440d-a798-71535b3e74b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:20.479516 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e6aae-3207-440d-a798-71535b3e74b8 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:20.479797 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e6aae-3207-440d-a798-71535b3e74b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:20.480068 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e6aae-3207-440d-a798-71535b3e74b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:20.480789 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e6aae-3207-440d-a798-71535b3e74b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:20.482483 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e6aae-3207-440d-a798-71535b3e74b8 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:20.493956 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1295/2582] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:59:20.498330 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe109c-5dee-49ab-9f91-76da17b7697d admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:20.509053 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe109c-5dee-49ab-9f91-76da17b7697d admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:20.514213 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ce796-665a-4e29-9f60-e6772790f98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:20.515205 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ce796-665a-4e29-9f60-e6772790f98d admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:20.515672 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ce796-665a-4e29-9f60-e6772790f98d admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:20.516073 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ce796-665a-4e29-9f60-e6772790f98d admin admin] PATH_INFO: `/v3/projects/20536cfb1d5b4a5ea168965493007bf5/users/e66f97b71c0b4fdaa168cf75c1c55401/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:20.531556 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ce796-665a-4e29-9f60-e6772790f98d admin admin] RBAC: Authorizing `identity:create_grant(project_id=20536cfb1d5b4a5ea168965493007bf5, user_id=e66f97b71c0b4fdaa168cf75c1c55401, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:20.534509 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ce796-665a-4e29-9f60-e6772790f98d admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:20.550180 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1288/2583] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:59:20 2022] PUT /identity/v3/projects/20536cfb1d5b4a5ea168965493007bf5/users/e66f97b71c0b4fdaa168cf75c1c55401/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:20.554308 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e6aae-3207-440d-a798-71535b3e74b8 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:20.564633 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e6aae-3207-440d-a798-71535b3e74b8 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:20.619572 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00117d00-b2af-477e-8fe0-d0d951e93ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:20.620246 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00117d00-b2af-477e-8fe0-d0d951e93ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:20.620556 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00117d00-b2af-477e-8fe0-d0d951e93ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:20.620996 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00117d00-b2af-477e-8fe0-d0d951e93ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:20.621811 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00117d00-b2af-477e-8fe0-d0d951e93ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:20.623413 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00117d00-b2af-477e-8fe0-d0d951e93ac1 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:20.633009 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1296/2584] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:59:20.637519 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ce796-665a-4e29-9f60-e6772790f98d admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:20.647888 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ce796-665a-4e29-9f60-e6772790f98d admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:20.652729 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d54779-6ef4-4ec9-9314-718e44c7c576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:20.653625 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d54779-6ef4-4ec9-9314-718e44c7c576 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:20.653896 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d54779-6ef4-4ec9-9314-718e44c7c576 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:20.654161 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d54779-6ef4-4ec9-9314-718e44c7c576 admin admin] PATH_INFO: `/v3/projects/20536cfb1d5b4a5ea168965493007bf5/users/e66f97b71c0b4fdaa168cf75c1c55401/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:20.656221 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d54779-6ef4-4ec9-9314-718e44c7c576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20536cfb1d5b4a5ea168965493007bf5, user_id=e66f97b71c0b4fdaa168cf75c1c55401, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:20.658893 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d54779-6ef4-4ec9-9314-718e44c7c576 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:20.670007 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1289/2585] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:59:20 2022] PUT /identity/v3/projects/20536cfb1d5b4a5ea168965493007bf5/users/e66f97b71c0b4fdaa168cf75c1c55401/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:20.681143 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc3ab4-6423-444f-bd84-08ec46e3b928 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:20.681431 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc3ab4-6423-444f-bd84-08ec46e3b928 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:20.681726 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc3ab4-6423-444f-bd84-08ec46e3b928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:20.709023 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-04bc3ab4-6423-444f-bd84-08ec46e3b928 None None] MFA Rules not processed for user `e66f97b71c0b4fdaa168cf75c1c55401`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:20.710268 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-04bc3ab4-6423-444f-bd84-08ec46e3b928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:20.780591 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1297/2586] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:20 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:20.791922 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d54779-6ef4-4ec9-9314-718e44c7c576 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:20.793776 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-88d54779-6ef4-4ec9-9314-718e44c7c576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:20.855608 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d54779-6ef4-4ec9-9314-718e44c7c576 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:20.860809 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975d575-c959-4c4c-a5d0-1f023c6dbca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:20.861513 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975d575-c959-4c4c-a5d0-1f023c6dbca4 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:20.861780 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975d575-c959-4c4c-a5d0-1f023c6dbca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:20.862053 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975d575-c959-4c4c-a5d0-1f023c6dbca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:20.872297 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975d575-c959-4c4c-a5d0-1f023c6dbca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:20.873752 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975d575-c959-4c4c-a5d0-1f023c6dbca4 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:20.884107 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1290/2587] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:59:20 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:59:21.018997 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc3ab4-6423-444f-bd84-08ec46e3b928 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:21.082655 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc3ab4-6423-444f-bd84-08ec46e3b928 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:21.087729 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584defc-6b17-4d29-977e-265619d576c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:21.088595 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584defc-6b17-4d29-977e-265619d576c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:21.088995 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584defc-6b17-4d29-977e-265619d576c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:21.089271 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584defc-6b17-4d29-977e-265619d576c5 admin admin] PATH_INFO: `/v3/users/19c384fb8fdc4e9097b0cba0e886d846` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:21.090501 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584defc-6b17-4d29-977e-265619d576c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19c384fb8fdc4e9097b0cba0e886d846)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:21.092521 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584defc-6b17-4d29-977e-265619d576c5 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:21.141043 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-2584defc-6b17-4d29-977e-265619d576c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19c384fb8fdc4e9097b0cba0e886d846'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:21.141291 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-2584defc-6b17-4d29-977e-265619d576c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19c384fb8fdc4e9097b0cba0e886d846'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:21.148703 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-2584defc-6b17-4d29-977e-265619d576c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19c384fb8fdc4e9097b0cba0e886d846'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:21.156160 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-2584defc-6b17-4d29-977e-265619d576c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19c384fb8fdc4e9097b0cba0e886d846'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:21.168078 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-2584defc-6b17-4d29-977e-265619d576c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19c384fb8fdc4e9097b0cba0e886d846'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:21.174042 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1298/2588] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:59:21 2022] DELETE /identity/v3/users/19c384fb8fdc4e9097b0cba0e886d846 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:21.178536 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868f7f2-3e5e-4566-b881-21b1c6849375 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:21.178821 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868f7f2-3e5e-4566-b881-21b1c6849375 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:21.179090 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868f7f2-3e5e-4566-b881-21b1c6849375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:21.196289 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-5868f7f2-3e5e-4566-b881-21b1c6849375 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:21.197466 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-5868f7f2-3e5e-4566-b881-21b1c6849375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:21.256937 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1291/2589] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:21.266931 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584defc-6b17-4d29-977e-265619d576c5 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:21.268507 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-2584defc-6b17-4d29-977e-265619d576c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:21.325551 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584defc-6b17-4d29-977e-265619d576c5 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:21.329579 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6395e77-4879-4cf8-b851-60d353228743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:21.330226 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6395e77-4879-4cf8-b851-60d353228743 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:21.330506 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6395e77-4879-4cf8-b851-60d353228743 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:21.330805 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6395e77-4879-4cf8-b851-60d353228743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:21.340251 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6395e77-4879-4cf8-b851-60d353228743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:21.341774 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6395e77-4879-4cf8-b851-60d353228743 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:21.351450 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1299/2590] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:59:21.647265 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868f7f2-3e5e-4566-b881-21b1c6849375 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:21.648978 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-5868f7f2-3e5e-4566-b881-21b1c6849375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:21.663113 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868f7f2-3e5e-4566-b881-21b1c6849375 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:21.668862 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1695e-f3f2-4e37-ab49-fd32cf57fe28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:21.670412 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1695e-f3f2-4e37-ab49-fd32cf57fe28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:21.671273 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1695e-f3f2-4e37-ab49-fd32cf57fe28 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:21.671972 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1695e-f3f2-4e37-ab49-fd32cf57fe28 admin admin] PATH_INFO: `/v3/projects/a83496ad604041208907d111bf48dd8a` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:21.674963 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1695e-f3f2-4e37-ab49-fd32cf57fe28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a83496ad604041208907d111bf48dd8a)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:21.677128 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1695e-f3f2-4e37-ab49-fd32cf57fe28 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:21.724790 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-ebc1695e-f3f2-4e37-ab49-fd32cf57fe28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a83496ad604041208907d111bf48dd8a', 'request_id': 'req-ebc1695e-f3f2-4e37-ab49-fd32cf57fe28'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:21.731168 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-ebc1695e-f3f2-4e37-ab49-fd32cf57fe28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a83496ad604041208907d111bf48dd8a', 'request_id': 'req-ebc1695e-f3f2-4e37-ab49-fd32cf57fe28'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:21.739842 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-ebc1695e-f3f2-4e37-ab49-fd32cf57fe28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a83496ad604041208907d111bf48dd8a', 'request_id': 'req-ebc1695e-f3f2-4e37-ab49-fd32cf57fe28'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:21.750298 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-ebc1695e-f3f2-4e37-ab49-fd32cf57fe28 admin admin] The token cache is being invalidate because project a83496ad604041208907d111bf48dd8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:59:21.750582 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-ebc1695e-f3f2-4e37-ab49-fd32cf57fe28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:21.751192 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-ebc1695e-f3f2-4e37-ab49-fd32cf57fe28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:21.753613 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1292/2591] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:59:21 2022] DELETE /identity/v3/projects/a83496ad604041208907d111bf48dd8a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:21.757495 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6395e77-4879-4cf8-b851-60d353228743 service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:21.768069 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6395e77-4879-4cf8-b851-60d353228743 service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:21.823483 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c90146-d12e-496f-acdd-14939fd19482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:21.824357 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c90146-d12e-496f-acdd-14939fd19482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:21.824640 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c90146-d12e-496f-acdd-14939fd19482 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:21.824910 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c90146-d12e-496f-acdd-14939fd19482 admin admin] PATH_INFO: `/v3/users/e66f97b71c0b4fdaa168cf75c1c55401` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:21.826138 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c90146-d12e-496f-acdd-14939fd19482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e66f97b71c0b4fdaa168cf75c1c55401)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:21.828177 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c90146-d12e-496f-acdd-14939fd19482 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:21.878574 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-e0c90146-d12e-496f-acdd-14939fd19482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e66f97b71c0b4fdaa168cf75c1c55401'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:21.882205 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-e0c90146-d12e-496f-acdd-14939fd19482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e66f97b71c0b4fdaa168cf75c1c55401'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:21.894942 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-e0c90146-d12e-496f-acdd-14939fd19482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e66f97b71c0b4fdaa168cf75c1c55401'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:21.902559 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-e0c90146-d12e-496f-acdd-14939fd19482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e66f97b71c0b4fdaa168cf75c1c55401'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:21.914307 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-e0c90146-d12e-496f-acdd-14939fd19482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e66f97b71c0b4fdaa168cf75c1c55401'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:21.920433 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1300/2592] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:59:21 2022] DELETE /identity/v3/users/e66f97b71c0b4fdaa168cf75c1c55401 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:59:22.201819 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1695e-f3f2-4e37-ab49-fd32cf57fe28 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:22.203315 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-ebc1695e-f3f2-4e37-ab49-fd32cf57fe28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:22.217986 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1695e-f3f2-4e37-ab49-fd32cf57fe28 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:22.276285 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9de00-a0be-47a0-b2f8-38ae04db7577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:22.277428 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9de00-a0be-47a0-b2f8-38ae04db7577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:22.277549 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9de00-a0be-47a0-b2f8-38ae04db7577 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:22.278565 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9de00-a0be-47a0-b2f8-38ae04db7577 admin admin] PATH_INFO: `/v3/users/7127893ff848407a9c2b17e60acde39e` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:22.280061 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9de00-a0be-47a0-b2f8-38ae04db7577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7127893ff848407a9c2b17e60acde39e)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:22.282389 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9de00-a0be-47a0-b2f8-38ae04db7577 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:22.314979 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c90146-d12e-496f-acdd-14939fd19482 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:22.317016 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-e0c90146-d12e-496f-acdd-14939fd19482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:22.330882 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c90146-d12e-496f-acdd-14939fd19482 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:22.335568 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d61b8-9f10-4d55-bff0-eb288fd81dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:22.336483 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d61b8-9f10-4d55-bff0-eb288fd81dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:22.336843 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d61b8-9f10-4d55-bff0-eb288fd81dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:22.337562 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d61b8-9f10-4d55-bff0-eb288fd81dbe admin admin] PATH_INFO: `/v3/projects/20536cfb1d5b4a5ea168965493007bf5` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:22.338819 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d61b8-9f10-4d55-bff0-eb288fd81dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=20536cfb1d5b4a5ea168965493007bf5)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:22.340801 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d61b8-9f10-4d55-bff0-eb288fd81dbe admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:22.345817 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-b4c9de00-a0be-47a0-b2f8-38ae04db7577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7127893ff848407a9c2b17e60acde39e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:22.346384 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-b4c9de00-a0be-47a0-b2f8-38ae04db7577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7127893ff848407a9c2b17e60acde39e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:22.357930 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-b4c9de00-a0be-47a0-b2f8-38ae04db7577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7127893ff848407a9c2b17e60acde39e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:22.371741 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-b4c9de00-a0be-47a0-b2f8-38ae04db7577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7127893ff848407a9c2b17e60acde39e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:22.378894 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-b4c9de00-a0be-47a0-b2f8-38ae04db7577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7127893ff848407a9c2b17e60acde39e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:22.384583 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1293/2593] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:59:22 2022] DELETE /identity/v3/users/7127893ff848407a9c2b17e60acde39e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:59:22.389751 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f974f-c9e0-46f8-86a8-33dab0ea6ea9 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:22.389899 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f974f-c9e0-46f8-86a8-33dab0ea6ea9 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:22.390121 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f974f-c9e0-46f8-86a8-33dab0ea6ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:22.391928 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-7d2d61b8-9f10-4d55-bff0-eb288fd81dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20536cfb1d5b4a5ea168965493007bf5', 'request_id': 'req-7d2d61b8-9f10-4d55-bff0-eb288fd81dbe'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:22.398224 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-7d2d61b8-9f10-4d55-bff0-eb288fd81dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20536cfb1d5b4a5ea168965493007bf5', 'request_id': 'req-7d2d61b8-9f10-4d55-bff0-eb288fd81dbe'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:22.407739 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-0d7f974f-c9e0-46f8-86a8-33dab0ea6ea9 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:22.408027 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-7d2d61b8-9f10-4d55-bff0-eb288fd81dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20536cfb1d5b4a5ea168965493007bf5', 'request_id': 'req-7d2d61b8-9f10-4d55-bff0-eb288fd81dbe'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:22.409541 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-0d7f974f-c9e0-46f8-86a8-33dab0ea6ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:22.421533 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-7d2d61b8-9f10-4d55-bff0-eb288fd81dbe admin admin] The token cache is being invalidate because project 20536cfb1d5b4a5ea168965493007bf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:59:22.421996 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-7d2d61b8-9f10-4d55-bff0-eb288fd81dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:22.422755 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-7d2d61b8-9f10-4d55-bff0-eb288fd81dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:22.424606 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1301/2594] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:59:22 2022] DELETE /identity/v3/projects/20536cfb1d5b4a5ea168965493007bf5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:59:22.429071 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eae628-acfa-4c16-9344-f873b11dcad8 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:22.429384 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eae628-acfa-4c16-9344-f873b11dcad8 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:22.429701 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eae628-acfa-4c16-9344-f873b11dcad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:22.447724 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-05eae628-acfa-4c16-9344-f873b11dcad8 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:22.449053 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-05eae628-acfa-4c16-9344-f873b11dcad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:22.471843 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1294/2595] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:59:22.490395 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f974f-c9e0-46f8-86a8-33dab0ea6ea9 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:22.491835 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-0d7f974f-c9e0-46f8-86a8-33dab0ea6ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:22.511397 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1302/2596] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:22.519375 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c6c78-bdc2-42f9-b033-9af20215293a None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:22.519665 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c6c78-bdc2-42f9-b033-9af20215293a None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:22.519948 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c6c78-bdc2-42f9-b033-9af20215293a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:22.539720 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-ae7c6c78-bdc2-42f9-b033-9af20215293a None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:22.541204 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-ae7c6c78-bdc2-42f9-b033-9af20215293a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:22.550377 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1303/2597] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:59:22.551585 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f974f-c9e0-46f8-86a8-33dab0ea6ea9 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:22.554546 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c6c78-bdc2-42f9-b033-9af20215293a None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:22.556309 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d54aa-4dd7-4d2f-85c8-626c6e06dd14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:22.556977 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d54aa-4dd7-4d2f-85c8-626c6e06dd14 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:22.557245 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d54aa-4dd7-4d2f-85c8-626c6e06dd14 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:22.557541 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d54aa-4dd7-4d2f-85c8-626c6e06dd14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:22.565244 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c6c78-bdc2-42f9-b033-9af20215293a None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:22.569583 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d54aa-4dd7-4d2f-85c8-626c6e06dd14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:22.571092 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7d54aa-4dd7-4d2f-85c8-626c6e06dd14 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:22.573810 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd762ee2-490c-48d7-bd97-c62fb1218f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:22.574721 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd762ee2-490c-48d7-bd97-c62fb1218f6b admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:22.575075 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd762ee2-490c-48d7-bd97-c62fb1218f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:22.575453 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd762ee2-490c-48d7-bd97-c62fb1218f6b admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:22.576392 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd762ee2-490c-48d7-bd97-c62fb1218f6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:59:22.576766 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd762ee2-490c-48d7-bd97-c62fb1218f6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:22.578651 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd762ee2-490c-48d7-bd97-c62fb1218f6b admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:22.582194 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1295/2598] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:59:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:59:22.591076 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1304/2599] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:59:22.595714 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d54aa-4dd7-4d2f-85c8-626c6e06dd14 service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:22.605595 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d54aa-4dd7-4d2f-85c8-626c6e06dd14 service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:22.612485 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc11a8-27d0-4ed5-8e16-3544f54d7492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:22.613141 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc11a8-27d0-4ed5-8e16-3544f54d7492 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:22.613445 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc11a8-27d0-4ed5-8e16-3544f54d7492 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:22.613742 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc11a8-27d0-4ed5-8e16-3544f54d7492 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:22.614404 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc11a8-27d0-4ed5-8e16-3544f54d7492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:22.616558 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc11a8-27d0-4ed5-8e16-3544f54d7492 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:22.646411 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1296/2600] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:59:22 2022] POST /identity/v3/projects => generated 407 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:59:22.650531 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd762ee2-490c-48d7-bd97-c62fb1218f6b admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:22.673973 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd762ee2-490c-48d7-bd97-c62fb1218f6b admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:22.739254 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0805e4f-f816-4d2f-add0-ec694a90c4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:22.740052 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0805e4f-f816-4d2f-add0-ec694a90c4aa admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:22.740396 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0805e4f-f816-4d2f-add0-ec694a90c4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:22.740730 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0805e4f-f816-4d2f-add0-ec694a90c4aa admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:22.741678 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0805e4f-f816-4d2f-add0-ec694a90c4aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:22.744019 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0805e4f-f816-4d2f-add0-ec694a90c4aa admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:22.768108 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1305/2601] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:59:22 2022] POST /identity/v3/users => generated 304 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:59:22.772417 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc11a8-27d0-4ed5-8e16-3544f54d7492 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:22.784393 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc11a8-27d0-4ed5-8e16-3544f54d7492 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:22.790757 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c22236-3207-4057-9a99-3671abdca096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:22.791876 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c22236-3207-4057-9a99-3671abdca096 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:22.792340 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c22236-3207-4057-9a99-3671abdca096 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:22.792974 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c22236-3207-4057-9a99-3671abdca096 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:22.794872 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c22236-3207-4057-9a99-3671abdca096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:22.813050 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c22236-3207-4057-9a99-3671abdca096 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:22.838467 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1297/2602] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:59:22.840273 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0805e4f-f816-4d2f-add0-ec694a90c4aa admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:22.857078 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0805e4f-f816-4d2f-add0-ec694a90c4aa admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:22.866740 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02670780-1be4-479d-af4f-b1fab3797b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:22.867471 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02670780-1be4-479d-af4f-b1fab3797b3c admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:22.867835 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02670780-1be4-479d-af4f-b1fab3797b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:22.868127 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02670780-1be4-479d-af4f-b1fab3797b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:22.868958 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02670780-1be4-479d-af4f-b1fab3797b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:22.875154 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02670780-1be4-479d-af4f-b1fab3797b3c admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:22.890619 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1306/2603] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:59:22.895167 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c22236-3207-4057-9a99-3671abdca096 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:22.909746 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c22236-3207-4057-9a99-3671abdca096 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:22.915216 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90741a12-82cc-4bac-a5ac-f6d237a62bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:22.916643 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90741a12-82cc-4bac-a5ac-f6d237a62bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:22.917017 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90741a12-82cc-4bac-a5ac-f6d237a62bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:22.917285 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90741a12-82cc-4bac-a5ac-f6d237a62bb6 admin admin] PATH_INFO: `/v3/projects/aef772d3c38f47caa738d4f21d1859bf/users/3a830dfb804a4369b79160d6ff3522da/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:22.931913 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02670780-1be4-479d-af4f-b1fab3797b3c admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:22.934133 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-02670780-1be4-479d-af4f-b1fab3797b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:22.940464 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90741a12-82cc-4bac-a5ac-f6d237a62bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef772d3c38f47caa738d4f21d1859bf, user_id=3a830dfb804a4369b79160d6ff3522da, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:22.950611 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02670780-1be4-479d-af4f-b1fab3797b3c admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:22.951798 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90741a12-82cc-4bac-a5ac-f6d237a62bb6 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:22.956337 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c092efd-fc0d-45d6-ae59-4572a97ad51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:22.957757 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c092efd-fc0d-45d6-ae59-4572a97ad51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:22.958259 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c092efd-fc0d-45d6-ae59-4572a97ad51a admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:22.958616 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c092efd-fc0d-45d6-ae59-4572a97ad51a admin admin] PATH_INFO: `/v3/projects/0d4e8bfdf8ce4456a9cf6849b84b9eb2` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:22.960479 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c092efd-fc0d-45d6-ae59-4572a97ad51a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d4e8bfdf8ce4456a9cf6849b84b9eb2)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:22.963093 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c092efd-fc0d-45d6-ae59-4572a97ad51a admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:22.981968 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1298/2604] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:59:22 2022] PUT /identity/v3/projects/aef772d3c38f47caa738d4f21d1859bf/users/3a830dfb804a4369b79160d6ff3522da/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:22.994140 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb4cd7-d0e5-4a5e-a5a8-7a104e0ec6cd None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:22.995028 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb4cd7-d0e5-4a5e-a5a8-7a104e0ec6cd None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:22.995028 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb4cd7-d0e5-4a5e-a5a8-7a104e0ec6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:23.022501 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8c092efd-fc0d-45d6-ae59-4572a97ad51a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d4e8bfdf8ce4456a9cf6849b84b9eb2', 'request_id': 'req-8c092efd-fc0d-45d6-ae59-4572a97ad51a'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:23.025430 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-31fb4cd7-d0e5-4a5e-a5a8-7a104e0ec6cd None None] MFA Rules not processed for user `3a830dfb804a4369b79160d6ff3522da`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:23.026794 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-31fb4cd7-d0e5-4a5e-a5a8-7a104e0ec6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:23.030639 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8c092efd-fc0d-45d6-ae59-4572a97ad51a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d4e8bfdf8ce4456a9cf6849b84b9eb2', 'request_id': 'req-8c092efd-fc0d-45d6-ae59-4572a97ad51a'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:23.042204 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8c092efd-fc0d-45d6-ae59-4572a97ad51a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d4e8bfdf8ce4456a9cf6849b84b9eb2', 'request_id': 'req-8c092efd-fc0d-45d6-ae59-4572a97ad51a'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:23.056486 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8c092efd-fc0d-45d6-ae59-4572a97ad51a admin admin] The token cache is being invalidate because project 0d4e8bfdf8ce4456a9cf6849b84b9eb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:59:23.057032 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8c092efd-fc0d-45d6-ae59-4572a97ad51a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:23.057988 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8c092efd-fc0d-45d6-ae59-4572a97ad51a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:23.059995 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1307/2605] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:59:22 2022] DELETE /identity/v3/projects/0d4e8bfdf8ce4456a9cf6849b84b9eb2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:59:23.137634 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1299/2606] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:22 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:59:23.142098 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c092efd-fc0d-45d6-ae59-4572a97ad51a admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:23.143759 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-8c092efd-fc0d-45d6-ae59-4572a97ad51a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:23.224738 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c092efd-fc0d-45d6-ae59-4572a97ad51a admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:23.231184 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e28218-6473-45b6-94fe-1918bd467e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:23.231881 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e28218-6473-45b6-94fe-1918bd467e32 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:23.232162 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e28218-6473-45b6-94fe-1918bd467e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:23.232464 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e28218-6473-45b6-94fe-1918bd467e32 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:23.233327 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e28218-6473-45b6-94fe-1918bd467e32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:23.235288 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e28218-6473-45b6-94fe-1918bd467e32 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:23.279112 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1308/2607] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:59:23 2022] POST /identity/v3/projects => generated 407 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:59:23.279263 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb4cd7-d0e5-4a5e-a5a8-7a104e0ec6cd None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:23.297325 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb4cd7-d0e5-4a5e-a5a8-7a104e0ec6cd None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:23.390325 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d816b3-14bb-4568-8a38-3ae8c0d31d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:23.391478 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d816b3-14bb-4568-8a38-3ae8c0d31d22 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:23.391800 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d816b3-14bb-4568-8a38-3ae8c0d31d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:23.392119 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d816b3-14bb-4568-8a38-3ae8c0d31d22 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:23.392927 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d816b3-14bb-4568-8a38-3ae8c0d31d22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:23.395496 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d816b3-14bb-4568-8a38-3ae8c0d31d22 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:23.420467 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1300/2608] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:59:23 2022] POST /identity/v3/users => generated 310 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:59:23.424868 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e28218-6473-45b6-94fe-1918bd467e32 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:23.437475 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e28218-6473-45b6-94fe-1918bd467e32 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:23.442683 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134cadcf-5ee3-4d4b-b9cd-274bc49c0aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:23.443299 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cadcf-5ee3-4d4b-b9cd-274bc49c0aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:23.443577 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cadcf-5ee3-4d4b-b9cd-274bc49c0aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:23.443850 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134cadcf-5ee3-4d4b-b9cd-274bc49c0aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:23.444579 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134cadcf-5ee3-4d4b-b9cd-274bc49c0aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:23.446215 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134cadcf-5ee3-4d4b-b9cd-274bc49c0aa1 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:23.457092 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1309/2609] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:59:23.461296 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d816b3-14bb-4568-8a38-3ae8c0d31d22 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:23.471686 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d816b3-14bb-4568-8a38-3ae8c0d31d22 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:23.476199 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fe8cb-a120-4ad6-bc4a-4c892aeec654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:23.477086 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fe8cb-a120-4ad6-bc4a-4c892aeec654 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:23.477449 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fe8cb-a120-4ad6-bc4a-4c892aeec654 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:23.479031 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1fe8cb-a120-4ad6-bc4a-4c892aeec654 admin admin] PATH_INFO: `/v3/projects/dc230ba6bf474fd48f362bb59c4feb35/users/daadae5b3a3c474aacd8932ef3fa4b11/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:23.494020 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fe8cb-a120-4ad6-bc4a-4c892aeec654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc230ba6bf474fd48f362bb59c4feb35, user_id=daadae5b3a3c474aacd8932ef3fa4b11, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:23.496659 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1fe8cb-a120-4ad6-bc4a-4c892aeec654 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:23.513304 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1301/2610] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:59:23 2022] PUT /identity/v3/projects/dc230ba6bf474fd48f362bb59c4feb35/users/daadae5b3a3c474aacd8932ef3fa4b11/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:23.517947 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134cadcf-5ee3-4d4b-b9cd-274bc49c0aa1 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:23.528081 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134cadcf-5ee3-4d4b-b9cd-274bc49c0aa1 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:23.584790 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf975f1-afe1-418f-89a6-0608356e32d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:23.585494 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf975f1-afe1-418f-89a6-0608356e32d4 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:23.585811 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf975f1-afe1-418f-89a6-0608356e32d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:23.586045 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf975f1-afe1-418f-89a6-0608356e32d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:23.586776 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf975f1-afe1-418f-89a6-0608356e32d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:23.588731 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf975f1-afe1-418f-89a6-0608356e32d4 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:23.598338 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1310/2611] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:59:23.602551 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fe8cb-a120-4ad6-bc4a-4c892aeec654 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:23.612778 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1fe8cb-a120-4ad6-bc4a-4c892aeec654 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:23.617388 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6df26-ec56-46a9-a4f9-2add2fc3457f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:23.618272 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6df26-ec56-46a9-a4f9-2add2fc3457f admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:23.618550 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6df26-ec56-46a9-a4f9-2add2fc3457f admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:23.618817 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6df26-ec56-46a9-a4f9-2add2fc3457f admin admin] PATH_INFO: `/v3/projects/dc230ba6bf474fd48f362bb59c4feb35/users/daadae5b3a3c474aacd8932ef3fa4b11/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:23.620799 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6df26-ec56-46a9-a4f9-2add2fc3457f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc230ba6bf474fd48f362bb59c4feb35, user_id=daadae5b3a3c474aacd8932ef3fa4b11, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:23.623426 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6df26-ec56-46a9-a4f9-2add2fc3457f admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:23.633639 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1302/2612] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:59:23 2022] PUT /identity/v3/projects/dc230ba6bf474fd48f362bb59c4feb35/users/daadae5b3a3c474aacd8932ef3fa4b11/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:23.643954 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f4036-2fbb-4c34-82c8-c3c9b41bc6e3 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:23.644241 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f4036-2fbb-4c34-82c8-c3c9b41bc6e3 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:23.644521 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f4036-2fbb-4c34-82c8-c3c9b41bc6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:23.671496 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-698f4036-2fbb-4c34-82c8-c3c9b41bc6e3 None None] MFA Rules not processed for user `daadae5b3a3c474aacd8932ef3fa4b11`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:23.672852 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-698f4036-2fbb-4c34-82c8-c3c9b41bc6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:23.755632 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1311/2613] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:23 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:23.767972 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6df26-ec56-46a9-a4f9-2add2fc3457f admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:23.770286 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-6df6df26-ec56-46a9-a4f9-2add2fc3457f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:23.829797 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6df26-ec56-46a9-a4f9-2add2fc3457f admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:23.833308 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238b17a-b110-4556-85cd-a55b433f1187 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:23.833995 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238b17a-b110-4556-85cd-a55b433f1187 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:23.834270 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238b17a-b110-4556-85cd-a55b433f1187 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:23.834536 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238b17a-b110-4556-85cd-a55b433f1187 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:23.844180 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238b17a-b110-4556-85cd-a55b433f1187 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:23.845824 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238b17a-b110-4556-85cd-a55b433f1187 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:23.856659 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1303/2614] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:59:23 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:59:24.006714 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f4036-2fbb-4c34-82c8-c3c9b41bc6e3 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:24.022380 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f4036-2fbb-4c34-82c8-c3c9b41bc6e3 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:24.026725 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebec511-0732-4503-bc09-68436b499828 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:24.028068 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebec511-0732-4503-bc09-68436b499828 service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:24.028508 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebec511-0732-4503-bc09-68436b499828 service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:24.028944 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebec511-0732-4503-bc09-68436b499828 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:24.087926 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebec511-0732-4503-bc09-68436b499828 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:24.089540 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebec511-0732-4503-bc09-68436b499828 service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:24.099205 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1312/2615] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:59:24 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:59:30.471895 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238b17a-b110-4556-85cd-a55b433f1187 service cinder] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:30.475183 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-6238b17a-b110-4556-85cd-a55b433f1187 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:30.532620 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238b17a-b110-4556-85cd-a55b433f1187 service cinder] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:30.536722 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5609427-de3f-43fa-bb51-ccb30f02cda9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:30.537504 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5609427-de3f-43fa-bb51-ccb30f02cda9 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:30.537782 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5609427-de3f-43fa-bb51-ccb30f02cda9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:30.538050 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5609427-de3f-43fa-bb51-ccb30f02cda9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:30.539904 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-b5609427-de3f-43fa-bb51-ccb30f02cda9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:30.600381 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5609427-de3f-43fa-bb51-ccb30f02cda9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:30.601838 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5609427-de3f-43fa-bb51-ccb30f02cda9 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:30.611206 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1304/2616] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:59:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:59:31.455324 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebec511-0732-4503-bc09-68436b499828 service cinder] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:31.467273 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebec511-0732-4503-bc09-68436b499828 service cinder] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:31.473698 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e87a77-f5bb-4238-a802-3437f2f0bcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:31.474515 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e87a77-f5bb-4238-a802-3437f2f0bcd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:31.474794 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e87a77-f5bb-4238-a802-3437f2f0bcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:31.475068 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e87a77-f5bb-4238-a802-3437f2f0bcd5 admin admin] PATH_INFO: `/v3/users/3a830dfb804a4369b79160d6ff3522da` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:31.476376 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e87a77-f5bb-4238-a802-3437f2f0bcd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a830dfb804a4369b79160d6ff3522da)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:31.478361 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e87a77-f5bb-4238-a802-3437f2f0bcd5 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:31.527001 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-93e87a77-f5bb-4238-a802-3437f2f0bcd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a830dfb804a4369b79160d6ff3522da'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:31.527665 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-93e87a77-f5bb-4238-a802-3437f2f0bcd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a830dfb804a4369b79160d6ff3522da'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:31.535658 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-93e87a77-f5bb-4238-a802-3437f2f0bcd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a830dfb804a4369b79160d6ff3522da'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:31.544078 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-93e87a77-f5bb-4238-a802-3437f2f0bcd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a830dfb804a4369b79160d6ff3522da'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:31.557472 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-93e87a77-f5bb-4238-a802-3437f2f0bcd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a830dfb804a4369b79160d6ff3522da'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:31.564054 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1313/2617] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:59:31 2022] DELETE /identity/v3/users/3a830dfb804a4369b79160d6ff3522da => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:31.568713 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ee821-949e-4a04-ac90-efa04eced812 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:31.569152 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ee821-949e-4a04-ac90-efa04eced812 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:31.569415 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ee821-949e-4a04-ac90-efa04eced812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:31.586412 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-180ee821-949e-4a04-ac90-efa04eced812 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:31.587998 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-180ee821-949e-4a04-ac90-efa04eced812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:31.653061 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1305/2618] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:31.663670 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e87a77-f5bb-4238-a802-3437f2f0bcd5 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:31.665627 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-93e87a77-f5bb-4238-a802-3437f2f0bcd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:31.734985 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e87a77-f5bb-4238-a802-3437f2f0bcd5 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:31.738856 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb15945-0214-47cb-a3ef-07eebec58a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:31.740554 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb15945-0214-47cb-a3ef-07eebec58a16 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:31.740903 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb15945-0214-47cb-a3ef-07eebec58a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:31.741246 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb15945-0214-47cb-a3ef-07eebec58a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:31.758729 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb15945-0214-47cb-a3ef-07eebec58a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:31.760420 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb15945-0214-47cb-a3ef-07eebec58a16 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:31.773292 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1314/2619] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:59:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:59:32.184824 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ee821-949e-4a04-ac90-efa04eced812 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:32.186281 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-180ee821-949e-4a04-ac90-efa04eced812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:32.198422 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ee821-949e-4a04-ac90-efa04eced812 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:32.203665 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66881ecd-af2e-4a69-b139-34877f965fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:32.204743 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66881ecd-af2e-4a69-b139-34877f965fc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:32.205019 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66881ecd-af2e-4a69-b139-34877f965fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:32.205378 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66881ecd-af2e-4a69-b139-34877f965fc2 admin admin] PATH_INFO: `/v3/projects/aef772d3c38f47caa738d4f21d1859bf` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:32.206579 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66881ecd-af2e-4a69-b139-34877f965fc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aef772d3c38f47caa738d4f21d1859bf)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:32.208436 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66881ecd-af2e-4a69-b139-34877f965fc2 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:32.263996 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-66881ecd-af2e-4a69-b139-34877f965fc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aef772d3c38f47caa738d4f21d1859bf', 'request_id': 'req-66881ecd-af2e-4a69-b139-34877f965fc2'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:32.270841 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-66881ecd-af2e-4a69-b139-34877f965fc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aef772d3c38f47caa738d4f21d1859bf', 'request_id': 'req-66881ecd-af2e-4a69-b139-34877f965fc2'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:32.281631 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-66881ecd-af2e-4a69-b139-34877f965fc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aef772d3c38f47caa738d4f21d1859bf', 'request_id': 'req-66881ecd-af2e-4a69-b139-34877f965fc2'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:32.295139 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-66881ecd-af2e-4a69-b139-34877f965fc2 admin admin] The token cache is being invalidate because project aef772d3c38f47caa738d4f21d1859bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:59:32.295429 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-66881ecd-af2e-4a69-b139-34877f965fc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:32.296564 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-66881ecd-af2e-4a69-b139-34877f965fc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:32.298412 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1306/2620] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:59:32 2022] DELETE /identity/v3/projects/aef772d3c38f47caa738d4f21d1859bf => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:32.302400 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb15945-0214-47cb-a3ef-07eebec58a16 service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:32.313273 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb15945-0214-47cb-a3ef-07eebec58a16 service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:32.374610 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1a106-0657-48db-a012-fdeb62fd8cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:32.375481 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1a106-0657-48db-a012-fdeb62fd8cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:32.375761 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1a106-0657-48db-a012-fdeb62fd8cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:32.376033 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1a106-0657-48db-a012-fdeb62fd8cd4 admin admin] PATH_INFO: `/v3/users/daadae5b3a3c474aacd8932ef3fa4b11` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:32.377285 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1a106-0657-48db-a012-fdeb62fd8cd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daadae5b3a3c474aacd8932ef3fa4b11)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:32.379217 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1a106-0657-48db-a012-fdeb62fd8cd4 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:32.434703 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-bdf1a106-0657-48db-a012-fdeb62fd8cd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daadae5b3a3c474aacd8932ef3fa4b11'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:32.435513 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-bdf1a106-0657-48db-a012-fdeb62fd8cd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daadae5b3a3c474aacd8932ef3fa4b11'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:32.445865 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-bdf1a106-0657-48db-a012-fdeb62fd8cd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daadae5b3a3c474aacd8932ef3fa4b11'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:32.454113 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-bdf1a106-0657-48db-a012-fdeb62fd8cd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daadae5b3a3c474aacd8932ef3fa4b11'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:32.466177 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-bdf1a106-0657-48db-a012-fdeb62fd8cd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daadae5b3a3c474aacd8932ef3fa4b11'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:32.473021 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1315/2621] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:59:32 2022] DELETE /identity/v3/users/daadae5b3a3c474aacd8932ef3fa4b11 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:59:33.130311 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66881ecd-af2e-4a69-b139-34877f965fc2 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:33.132147 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-66881ecd-af2e-4a69-b139-34877f965fc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:33.145713 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66881ecd-af2e-4a69-b139-34877f965fc2 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:33.203334 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c2c35f-f01d-4ce6-a221-9bc24713396c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:33.204301 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2c35f-f01d-4ce6-a221-9bc24713396c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:33.204580 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2c35f-f01d-4ce6-a221-9bc24713396c admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:33.204848 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c2c35f-f01d-4ce6-a221-9bc24713396c admin admin] PATH_INFO: `/v3/projects/dc230ba6bf474fd48f362bb59c4feb35` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:33.206050 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2c35f-f01d-4ce6-a221-9bc24713396c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc230ba6bf474fd48f362bb59c4feb35)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:33.207937 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c2c35f-f01d-4ce6-a221-9bc24713396c admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:33.253101 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-62c2c35f-f01d-4ce6-a221-9bc24713396c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc230ba6bf474fd48f362bb59c4feb35', 'request_id': 'req-62c2c35f-f01d-4ce6-a221-9bc24713396c'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:33.259129 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-62c2c35f-f01d-4ce6-a221-9bc24713396c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc230ba6bf474fd48f362bb59c4feb35', 'request_id': 'req-62c2c35f-f01d-4ce6-a221-9bc24713396c'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:33.267565 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-62c2c35f-f01d-4ce6-a221-9bc24713396c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc230ba6bf474fd48f362bb59c4feb35', 'request_id': 'req-62c2c35f-f01d-4ce6-a221-9bc24713396c'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:33.277735 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-62c2c35f-f01d-4ce6-a221-9bc24713396c admin admin] The token cache is being invalidate because project dc230ba6bf474fd48f362bb59c4feb35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:59:33.278011 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-62c2c35f-f01d-4ce6-a221-9bc24713396c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:33.278613 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-62c2c35f-f01d-4ce6-a221-9bc24713396c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:33.280411 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1307/2622] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:59:33 2022] DELETE /identity/v3/projects/dc230ba6bf474fd48f362bb59c4feb35 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:33.286120 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53909b62-c025-4b6d-9695-77ba0aff1f88 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:33.286409 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53909b62-c025-4b6d-9695-77ba0aff1f88 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:33.286683 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53909b62-c025-4b6d-9695-77ba0aff1f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:33.304389 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-53909b62-c025-4b6d-9695-77ba0aff1f88 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:33.305690 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-53909b62-c025-4b6d-9695-77ba0aff1f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:33.370650 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1316/2623] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:33.378601 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a9d01-e6b5-4ae0-9989-01d20a2cbe38 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:33.378927 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a9d01-e6b5-4ae0-9989-01d20a2cbe38 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:33.379275 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9a9d01-e6b5-4ae0-9989-01d20a2cbe38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:33.399203 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-9e9a9d01-e6b5-4ae0-9989-01d20a2cbe38 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:33.400418 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-9e9a9d01-e6b5-4ae0-9989-01d20a2cbe38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:33.411335 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1308/2624] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:33.416477 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53909b62-c025-4b6d-9695-77ba0aff1f88 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:33.426990 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53909b62-c025-4b6d-9695-77ba0aff1f88 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:33.431956 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb07f8-762e-442e-8f46-4ad34e9da763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:33.432712 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb07f8-762e-442e-8f46-4ad34e9da763 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:33.433049 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb07f8-762e-442e-8f46-4ad34e9da763 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:33.433418 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb07f8-762e-442e-8f46-4ad34e9da763 admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:33.434265 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb07f8-762e-442e-8f46-4ad34e9da763 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:59:33.434679 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb07f8-762e-442e-8f46-4ad34e9da763 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:33.436390 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb07f8-762e-442e-8f46-4ad34e9da763 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:33.448334 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1317/2625] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:59:33.452784 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a9d01-e6b5-4ae0-9989-01d20a2cbe38 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:33.469778 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9a9d01-e6b5-4ae0-9989-01d20a2cbe38 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:33.475502 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80612bb1-7920-43e7-b16b-6ef7f3a86b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:33.476254 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80612bb1-7920-43e7-b16b-6ef7f3a86b09 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:33.476595 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80612bb1-7920-43e7-b16b-6ef7f3a86b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:33.476938 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80612bb1-7920-43e7-b16b-6ef7f3a86b09 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:33.478254 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80612bb1-7920-43e7-b16b-6ef7f3a86b09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:33.479730 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80612bb1-7920-43e7-b16b-6ef7f3a86b09 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:33.515093 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1309/2626] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:59:33 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:59:33.516222 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb07f8-762e-442e-8f46-4ad34e9da763 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:33.529862 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb07f8-762e-442e-8f46-4ad34e9da763 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:33.606379 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad70aa6-26d8-4805-a9b0-927cf312ba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:33.607605 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad70aa6-26d8-4805-a9b0-927cf312ba98 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:33.608043 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad70aa6-26d8-4805-a9b0-927cf312ba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:33.614238 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad70aa6-26d8-4805-a9b0-927cf312ba98 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:33.615189 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad70aa6-26d8-4805-a9b0-927cf312ba98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:33.618618 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad70aa6-26d8-4805-a9b0-927cf312ba98 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:33.648923 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1318/2627] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:59:33 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:59:33.650809 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80612bb1-7920-43e7-b16b-6ef7f3a86b09 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:33.668802 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80612bb1-7920-43e7-b16b-6ef7f3a86b09 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:33.674762 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c086db-0eba-45f0-9ab8-3ebc9f07ccd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:33.675647 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c086db-0eba-45f0-9ab8-3ebc9f07ccd3 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:33.676080 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c086db-0eba-45f0-9ab8-3ebc9f07ccd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:33.676722 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c086db-0eba-45f0-9ab8-3ebc9f07ccd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:33.677532 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c086db-0eba-45f0-9ab8-3ebc9f07ccd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:33.679165 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c086db-0eba-45f0-9ab8-3ebc9f07ccd3 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:33.697410 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1310/2628] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:59:33.700942 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad70aa6-26d8-4805-a9b0-927cf312ba98 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:33.712814 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad70aa6-26d8-4805-a9b0-927cf312ba98 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:33.726714 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061f508-b92d-4693-8160-e51118796e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:33.728536 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061f508-b92d-4693-8160-e51118796e86 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:33.729917 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061f508-b92d-4693-8160-e51118796e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:33.730412 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061f508-b92d-4693-8160-e51118796e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:33.731369 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061f508-b92d-4693-8160-e51118796e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:33.733659 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061f508-b92d-4693-8160-e51118796e86 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:33.749071 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1319/2629] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:59:33.753468 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c086db-0eba-45f0-9ab8-3ebc9f07ccd3 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:33.763524 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c086db-0eba-45f0-9ab8-3ebc9f07ccd3 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:33.768555 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831232e7-a3b6-40cb-93fe-52619b5abebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:33.769401 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831232e7-a3b6-40cb-93fe-52619b5abebb admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:33.769880 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831232e7-a3b6-40cb-93fe-52619b5abebb admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:33.770150 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831232e7-a3b6-40cb-93fe-52619b5abebb admin admin] PATH_INFO: `/v3/projects/48fb2900cb4743a5a3d764332e838494/users/c45887a694bf482ab3fb2bc282d7841d/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:33.792595 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831232e7-a3b6-40cb-93fe-52619b5abebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=48fb2900cb4743a5a3d764332e838494, user_id=c45887a694bf482ab3fb2bc282d7841d, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:33.795909 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831232e7-a3b6-40cb-93fe-52619b5abebb admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:33.814286 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1311/2630] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:59:33 2022] PUT /identity/v3/projects/48fb2900cb4743a5a3d764332e838494/users/c45887a694bf482ab3fb2bc282d7841d/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:33.819489 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6708cf4-e9b8-4b38-bc95-77101dad25fd None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:33.819784 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6708cf4-e9b8-4b38-bc95-77101dad25fd None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:33.820063 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6708cf4-e9b8-4b38-bc95-77101dad25fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:33.840922 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-d6708cf4-e9b8-4b38-bc95-77101dad25fd None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:33.842314 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-d6708cf4-e9b8-4b38-bc95-77101dad25fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:33.903887 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1320/2631] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:33.913565 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831232e7-a3b6-40cb-93fe-52619b5abebb admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:33.915391 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-831232e7-a3b6-40cb-93fe-52619b5abebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:33.976280 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831232e7-a3b6-40cb-93fe-52619b5abebb admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:33.979917 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2f013-c304-4116-a22f-859c4b3b0c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:33.980582 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2f013-c304-4116-a22f-859c4b3b0c9a service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:33.980883 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2f013-c304-4116-a22f-859c4b3b0c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:33.981155 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2f013-c304-4116-a22f-859c4b3b0c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:33.991376 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2f013-c304-4116-a22f-859c4b3b0c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:33.992808 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2f013-c304-4116-a22f-859c4b3b0c9a service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:34.003234 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1312/2632] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:59:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:59:34.355125 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6708cf4-e9b8-4b38-bc95-77101dad25fd None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:34.356972 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-d6708cf4-e9b8-4b38-bc95-77101dad25fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:34.374631 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6708cf4-e9b8-4b38-bc95-77101dad25fd None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:34.380045 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466415e2-4769-447e-88e5-d8976990dfe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:34.380940 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466415e2-4769-447e-88e5-d8976990dfe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:34.381216 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466415e2-4769-447e-88e5-d8976990dfe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:34.381514 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466415e2-4769-447e-88e5-d8976990dfe3 admin admin] PATH_INFO: `/v3/users/4f705be9921a4daabe961e170fe7efd2` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:34.382789 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466415e2-4769-447e-88e5-d8976990dfe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f705be9921a4daabe961e170fe7efd2)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:34.384954 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466415e2-4769-447e-88e5-d8976990dfe3 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:34.440179 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-466415e2-4769-447e-88e5-d8976990dfe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f705be9921a4daabe961e170fe7efd2'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:34.440909 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-466415e2-4769-447e-88e5-d8976990dfe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f705be9921a4daabe961e170fe7efd2'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:34.449292 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-466415e2-4769-447e-88e5-d8976990dfe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f705be9921a4daabe961e170fe7efd2'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:34.456830 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-466415e2-4769-447e-88e5-d8976990dfe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f705be9921a4daabe961e170fe7efd2'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:34.470719 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-466415e2-4769-447e-88e5-d8976990dfe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f705be9921a4daabe961e170fe7efd2'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:34.476789 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1321/2633] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:59:34 2022] DELETE /identity/v3/users/4f705be9921a4daabe961e170fe7efd2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:59:34.651987 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2f013-c304-4116-a22f-859c4b3b0c9a service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:34.676124 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2f013-c304-4116-a22f-859c4b3b0c9a service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:34.693040 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7105d-18c8-44bd-b261-989d56bf4797 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:34.693540 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7105d-18c8-44bd-b261-989d56bf4797 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:34.693640 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7105d-18c8-44bd-b261-989d56bf4797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:34.722087 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-06e7105d-18c8-44bd-b261-989d56bf4797 None None] MFA Rules not processed for user `c45887a694bf482ab3fb2bc282d7841d`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:34.723370 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-06e7105d-18c8-44bd-b261-989d56bf4797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:34.739208 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cae21e-c9bf-4085-804a-ddae48685a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:34.740161 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cae21e-c9bf-4085-804a-ddae48685a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:34.740460 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cae21e-c9bf-4085-804a-ddae48685a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:34.740737 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cae21e-c9bf-4085-804a-ddae48685a2a admin admin] PATH_INFO: `/v3/projects/3f51337f0fa1461c9f2b388e12176174` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:34.742371 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cae21e-c9bf-4085-804a-ddae48685a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f51337f0fa1461c9f2b388e12176174)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:34.744073 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cae21e-c9bf-4085-804a-ddae48685a2a admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:34.795593 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-f1cae21e-c9bf-4085-804a-ddae48685a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f51337f0fa1461c9f2b388e12176174', 'request_id': 'req-f1cae21e-c9bf-4085-804a-ddae48685a2a'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:34.796337 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1322/2634] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:34.801005 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7105d-18c8-44bd-b261-989d56bf4797 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:34.803477 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-06e7105d-18c8-44bd-b261-989d56bf4797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:34.808681 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-f1cae21e-c9bf-4085-804a-ddae48685a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f51337f0fa1461c9f2b388e12176174', 'request_id': 'req-f1cae21e-c9bf-4085-804a-ddae48685a2a'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:34.818766 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7105d-18c8-44bd-b261-989d56bf4797 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:34.820541 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-f1cae21e-c9bf-4085-804a-ddae48685a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f51337f0fa1461c9f2b388e12176174', 'request_id': 'req-f1cae21e-c9bf-4085-804a-ddae48685a2a'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:34.834382 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-f1cae21e-c9bf-4085-804a-ddae48685a2a admin admin] The token cache is being invalidate because project 3f51337f0fa1461c9f2b388e12176174 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:59:34.834755 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-f1cae21e-c9bf-4085-804a-ddae48685a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:34.835469 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-f1cae21e-c9bf-4085-804a-ddae48685a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:34.837064 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1313/2635] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:59:34 2022] DELETE /identity/v3/projects/3f51337f0fa1461c9f2b388e12176174 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:34.842911 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc24b02-f03d-443f-83c1-e02902ff2a07 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:34.843450 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc24b02-f03d-443f-83c1-e02902ff2a07 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:34.843786 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc24b02-f03d-443f-83c1-e02902ff2a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:34.867039 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-2cc24b02-f03d-443f-83c1-e02902ff2a07 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:34.868529 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-2cc24b02-f03d-443f-83c1-e02902ff2a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:34.899717 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ef952-22e3-428b-aef2-577148aa880b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:34.900375 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ef952-22e3-428b-aef2-577148aa880b admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:34.900653 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ef952-22e3-428b-aef2-577148aa880b admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:34.900924 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ef952-22e3-428b-aef2-577148aa880b admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:34.902100 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ef952-22e3-428b-aef2-577148aa880b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:34.904557 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ef952-22e3-428b-aef2-577148aa880b admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:34.933691 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1323/2636] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:59:34 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:59:34.937524 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ef952-22e3-428b-aef2-577148aa880b admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:34.941385 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1314/2637] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:34.941528 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-855ef952-22e3-428b-aef2-577148aa880b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:34.946192 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6b265-5a8a-4fb3-b25f-618be6cc16b5 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:34.946562 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6b265-5a8a-4fb3-b25f-618be6cc16b5 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:34.946919 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6b265-5a8a-4fb3-b25f-618be6cc16b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:34.967997 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-b6d6b265-5a8a-4fb3-b25f-618be6cc16b5 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:34.969848 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-b6d6b265-5a8a-4fb3-b25f-618be6cc16b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:35.006199 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ef952-22e3-428b-aef2-577148aa880b admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:35.010888 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109a98b-7817-4560-9ba8-3a5763eca746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:35.011565 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109a98b-7817-4560-9ba8-3a5763eca746 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:35.011842 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109a98b-7817-4560-9ba8-3a5763eca746 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:35.012159 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109a98b-7817-4560-9ba8-3a5763eca746 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:35.012888 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109a98b-7817-4560-9ba8-3a5763eca746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:35.014832 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109a98b-7817-4560-9ba8-3a5763eca746 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:35.026339 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1315/2638] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:35.030671 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6b265-5a8a-4fb3-b25f-618be6cc16b5 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:35.040171 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1324/2639] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:59:34 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:59:35.040381 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6b265-5a8a-4fb3-b25f-618be6cc16b5 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:35.041601 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109a98b-7817-4560-9ba8-3a5763eca746 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:35.044826 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa06a1-e775-45a0-873a-dafe6ed1dee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:35.045531 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa06a1-e775-45a0-873a-dafe6ed1dee3 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:35.045806 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa06a1-e775-45a0-873a-dafe6ed1dee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:35.046097 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa06a1-e775-45a0-873a-dafe6ed1dee3 admin admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:35.046818 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa06a1-e775-45a0-873a-dafe6ed1dee3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:59:35.047118 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa06a1-e775-45a0-873a-dafe6ed1dee3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:35.048746 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa06a1-e775-45a0-873a-dafe6ed1dee3 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:35.051325 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109a98b-7817-4560-9ba8-3a5763eca746 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:35.056036 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ec7e0-2920-4327-969d-cb6b50001ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:35.056720 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ec7e0-2920-4327-969d-cb6b50001ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:35.056998 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ec7e0-2920-4327-969d-cb6b50001ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:35.057264 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ec7e0-2920-4327-969d-cb6b50001ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:35.058009 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ec7e0-2920-4327-969d-cb6b50001ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:35.059591 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ec7e0-2920-4327-969d-cb6b50001ee2 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:35.060933 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1316/2640] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:59:35.065123 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa06a1-e775-45a0-873a-dafe6ed1dee3 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:35.076023 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1325/2641] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:59:35.076192 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa06a1-e775-45a0-873a-dafe6ed1dee3 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:35.076947 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ec7e0-2920-4327-969d-cb6b50001ee2 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:35.080172 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c885f8-ae56-4a3a-bf17-6a424f22aa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:35.080888 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c885f8-ae56-4a3a-bf17-6a424f22aa9d admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:35.081170 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c885f8-ae56-4a3a-bf17-6a424f22aa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:35.081475 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c885f8-ae56-4a3a-bf17-6a424f22aa9d admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:35.082159 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c885f8-ae56-4a3a-bf17-6a424f22aa9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:35.084082 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c885f8-ae56-4a3a-bf17-6a424f22aa9d admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:35.086887 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ec7e0-2920-4327-969d-cb6b50001ee2 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:35.092233 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ab04d-8abd-4c55-aac7-249e7443d12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:35.093099 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab04d-8abd-4c55-aac7-249e7443d12b admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:35.093433 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab04d-8abd-4c55-aac7-249e7443d12b admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:35.093688 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab04d-8abd-4c55-aac7-249e7443d12b admin admin] PATH_INFO: `/v3/projects/2637869956b94fd6b1821c51aefa64a6/users/6566f3bb9ed64ef9aac603465f1fbe02/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:35.109143 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ab04d-8abd-4c55-aac7-249e7443d12b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2637869956b94fd6b1821c51aefa64a6, user_id=6566f3bb9ed64ef9aac603465f1fbe02, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:35.110357 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1317/2642] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:59:35 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:59:35.111850 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ab04d-8abd-4c55-aac7-249e7443d12b admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:35.114564 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c885f8-ae56-4a3a-bf17-6a424f22aa9d admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:35.125932 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1326/2643] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:59:35 2022] PUT /identity/v3/projects/2637869956b94fd6b1821c51aefa64a6/users/6566f3bb9ed64ef9aac603465f1fbe02/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:35.129907 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ab04d-8abd-4c55-aac7-249e7443d12b admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:35.173242 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c885f8-ae56-4a3a-bf17-6a424f22aa9d admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:35.188996 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ab04d-8abd-4c55-aac7-249e7443d12b admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:35.194015 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a083b2e-c140-4c79-9287-922baf314376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:35.194659 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a083b2e-c140-4c79-9287-922baf314376 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:35.194920 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a083b2e-c140-4c79-9287-922baf314376 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:35.195186 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a083b2e-c140-4c79-9287-922baf314376 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:35.195900 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a083b2e-c140-4c79-9287-922baf314376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:35.197555 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a083b2e-c140-4c79-9287-922baf314376 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:35.207405 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1327/2644] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:59:35.211628 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a083b2e-c140-4c79-9287-922baf314376 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:35.221292 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a083b2e-c140-4c79-9287-922baf314376 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:35.226078 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173215f-5ca7-4763-a92d-e11e6da53fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:35.226921 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173215f-5ca7-4763-a92d-e11e6da53fee admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:35.227192 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173215f-5ca7-4763-a92d-e11e6da53fee admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:35.227458 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173215f-5ca7-4763-a92d-e11e6da53fee admin admin] PATH_INFO: `/v3/projects/2637869956b94fd6b1821c51aefa64a6/users/6566f3bb9ed64ef9aac603465f1fbe02/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:35.228414 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39382662-a789-4524-9a05-7c1d6b05d8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:35.229339 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39382662-a789-4524-9a05-7c1d6b05d8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:35.229479 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173215f-5ca7-4763-a92d-e11e6da53fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=2637869956b94fd6b1821c51aefa64a6, user_id=6566f3bb9ed64ef9aac603465f1fbe02, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:35.229640 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39382662-a789-4524-9a05-7c1d6b05d8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:35.229911 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39382662-a789-4524-9a05-7c1d6b05d8a0 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:35.230588 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39382662-a789-4524-9a05-7c1d6b05d8a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:35.232053 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173215f-5ca7-4763-a92d-e11e6da53fee admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:35.232470 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39382662-a789-4524-9a05-7c1d6b05d8a0 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:35.242311 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1328/2645] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:59:35 2022] PUT /identity/v3/projects/2637869956b94fd6b1821c51aefa64a6/users/6566f3bb9ed64ef9aac603465f1fbe02/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:35.253040 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1318/2646] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:59:35 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:59:35.257053 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173215f-5ca7-4763-a92d-e11e6da53fee admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:35.318299 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173215f-5ca7-4763-a92d-e11e6da53fee admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:35.322913 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001501d-6499-479f-afc6-677477b0071c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:35.323573 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001501d-6499-479f-afc6-677477b0071c admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:35.323848 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001501d-6499-479f-afc6-677477b0071c admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:35.324116 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001501d-6499-479f-afc6-677477b0071c admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:35.324831 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001501d-6499-479f-afc6-677477b0071c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:35.326644 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3001501d-6499-479f-afc6-677477b0071c admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:35.336455 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1329/2647] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:59:35.341101 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39382662-a789-4524-9a05-7c1d6b05d8a0 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:35.350999 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39382662-a789-4524-9a05-7c1d6b05d8a0 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:35.355503 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7296ed-c2e8-4789-bb72-8d2600d58ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:35.356184 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7296ed-c2e8-4789-bb72-8d2600d58ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:35.356458 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7296ed-c2e8-4789-bb72-8d2600d58ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:35.356727 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7296ed-c2e8-4789-bb72-8d2600d58ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:35.357506 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7296ed-c2e8-4789-bb72-8d2600d58ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:35.359075 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7296ed-c2e8-4789-bb72-8d2600d58ce6 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:35.369545 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1319/2648] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:59:35.373890 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001501d-6499-479f-afc6-677477b0071c admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:35.383881 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001501d-6499-479f-afc6-677477b0071c admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:35.388659 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1210d-d29f-4b54-8687-ab83e051a7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:35.389722 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1210d-d29f-4b54-8687-ab83e051a7b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:35.390115 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1210d-d29f-4b54-8687-ab83e051a7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:35.390475 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1210d-d29f-4b54-8687-ab83e051a7b9 admin admin] PATH_INFO: `/v3/projects/2bda09ec2bb341a1bc8dca75d3eae478/users/35850eb275864c0d88099b4410b0c6a7/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:35.406857 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1210d-d29f-4b54-8687-ab83e051a7b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bda09ec2bb341a1bc8dca75d3eae478, user_id=35850eb275864c0d88099b4410b0c6a7, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:35.410538 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1210d-d29f-4b54-8687-ab83e051a7b9 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:35.433417 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1330/2649] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:59:35 2022] PUT /identity/v3/projects/2bda09ec2bb341a1bc8dca75d3eae478/users/35850eb275864c0d88099b4410b0c6a7/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:35.441158 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e20a59-91c3-4d3d-adb1-d314f3575b78 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:35.441817 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e20a59-91c3-4d3d-adb1-d314f3575b78 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:35.442289 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e20a59-91c3-4d3d-adb1-d314f3575b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:35.473624 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-82e20a59-91c3-4d3d-adb1-d314f3575b78 None None] MFA Rules not processed for user `35850eb275864c0d88099b4410b0c6a7`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:35.475392 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-82e20a59-91c3-4d3d-adb1-d314f3575b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:35.556699 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1320/2650] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:35.568725 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1210d-d29f-4b54-8687-ab83e051a7b9 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:35.570513 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-e1e1210d-d29f-4b54-8687-ab83e051a7b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:35.652722 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1210d-d29f-4b54-8687-ab83e051a7b9 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:35.658249 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf2484-d932-46c1-bbdf-3e2328f9a1ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:35.659009 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf2484-d932-46c1-bbdf-3e2328f9a1ff service nova] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:35.659286 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf2484-d932-46c1-bbdf-3e2328f9a1ff service nova] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:35.659559 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf2484-d932-46c1-bbdf-3e2328f9a1ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:35.667477 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf2484-d932-46c1-bbdf-3e2328f9a1ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:35.669059 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf2484-d932-46c1-bbdf-3e2328f9a1ff service nova] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:35.678529 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1331/2651] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:59:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:59:35.881184 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e20a59-91c3-4d3d-adb1-d314f3575b78 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:35.912911 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f8540-d7e8-4373-a413-8049a152af9c None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:35.913456 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f8540-d7e8-4373-a413-8049a152af9c None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:35.913807 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198f8540-d7e8-4373-a413-8049a152af9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:35.942346 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-198f8540-d7e8-4373-a413-8049a152af9c None None] MFA Rules not processed for user `6566f3bb9ed64ef9aac603465f1fbe02`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:35.943225 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-198f8540-d7e8-4373-a413-8049a152af9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:35.946235 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e20a59-91c3-4d3d-adb1-d314f3575b78 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:35.951000 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd76ef0-a166-461e-9e97-a6e941c4ed4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:35.951881 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd76ef0-a166-461e-9e97-a6e941c4ed4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:35.952160 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd76ef0-a166-461e-9e97-a6e941c4ed4e admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:35.952637 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd76ef0-a166-461e-9e97-a6e941c4ed4e admin admin] PATH_INFO: `/v3/users/35850eb275864c0d88099b4410b0c6a7` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:35.953886 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd76ef0-a166-461e-9e97-a6e941c4ed4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=35850eb275864c0d88099b4410b0c6a7)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:35.955870 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd76ef0-a166-461e-9e97-a6e941c4ed4e admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:36.005801 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-9fd76ef0-a166-461e-9e97-a6e941c4ed4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35850eb275864c0d88099b4410b0c6a7'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:36.006433 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-9fd76ef0-a166-461e-9e97-a6e941c4ed4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35850eb275864c0d88099b4410b0c6a7'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:36.015044 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-9fd76ef0-a166-461e-9e97-a6e941c4ed4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35850eb275864c0d88099b4410b0c6a7'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:36.021609 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1332/2652] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:36.027851 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-9fd76ef0-a166-461e-9e97-a6e941c4ed4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35850eb275864c0d88099b4410b0c6a7'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:36.029641 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f8540-d7e8-4373-a413-8049a152af9c None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:36.031099 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-198f8540-d7e8-4373-a413-8049a152af9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:36.035301 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-9fd76ef0-a166-461e-9e97-a6e941c4ed4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35850eb275864c0d88099b4410b0c6a7'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:36.041908 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1321/2653] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:59:35 2022] DELETE /identity/v3/users/35850eb275864c0d88099b4410b0c6a7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:36.046201 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4aaee1-8788-436f-b7a0-fdec6fbc1db5 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:36.046496 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4aaee1-8788-436f-b7a0-fdec6fbc1db5 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:36.046816 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4aaee1-8788-436f-b7a0-fdec6fbc1db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:36.064009 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-4b4aaee1-8788-436f-b7a0-fdec6fbc1db5 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:36.065261 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-4b4aaee1-8788-436f-b7a0-fdec6fbc1db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:36.088030 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198f8540-d7e8-4373-a413-8049a152af9c None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:36.128102 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1322/2654] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:59:36.134327 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2537d-9e24-4391-bc0e-6e0d68b0b340 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:36.134974 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2537d-9e24-4391-bc0e-6e0d68b0b340 service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:36.135250 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2537d-9e24-4391-bc0e-6e0d68b0b340 service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:36.135523 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2537d-9e24-4391-bc0e-6e0d68b0b340 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:36.137399 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-60a2537d-9e24-4391-bc0e-6e0d68b0b340 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:36.138317 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4aaee1-8788-436f-b7a0-fdec6fbc1db5 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:36.139610 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-4b4aaee1-8788-436f-b7a0-fdec6fbc1db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:36.193526 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4aaee1-8788-436f-b7a0-fdec6fbc1db5 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:36.195963 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2537d-9e24-4391-bc0e-6e0d68b0b340 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:36.197204 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80130bea-328c-45c6-afe1-f83b5e63b64f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:36.197409 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2537d-9e24-4391-bc0e-6e0d68b0b340 service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:36.197873 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80130bea-328c-45c6-afe1-f83b5e63b64f service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:36.198154 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80130bea-328c-45c6-afe1-f83b5e63b64f service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:36.198421 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80130bea-328c-45c6-afe1-f83b5e63b64f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:36.206271 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1333/2655] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:59:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:59:36.207695 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80130bea-328c-45c6-afe1-f83b5e63b64f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:36.209102 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80130bea-328c-45c6-afe1-f83b5e63b64f service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:36.219251 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1323/2656] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:59:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 13:59:36.496446 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2537d-9e24-4391-bc0e-6e0d68b0b340 service cinder] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:36.502662 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-60a2537d-9e24-4391-bc0e-6e0d68b0b340 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:36.518697 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2537d-9e24-4391-bc0e-6e0d68b0b340 service cinder] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:36.523952 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ca291-8c4f-49f0-92e5-cbd82c674c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:36.524867 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ca291-8c4f-49f0-92e5-cbd82c674c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:36.525148 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ca291-8c4f-49f0-92e5-cbd82c674c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:36.525451 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ca291-8c4f-49f0-92e5-cbd82c674c4f admin admin] PATH_INFO: `/v3/projects/2bda09ec2bb341a1bc8dca75d3eae478` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:36.526645 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ca291-8c4f-49f0-92e5-cbd82c674c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bda09ec2bb341a1bc8dca75d3eae478)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:36.528650 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ca291-8c4f-49f0-92e5-cbd82c674c4f admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:36.575602 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-6c0ca291-8c4f-49f0-92e5-cbd82c674c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bda09ec2bb341a1bc8dca75d3eae478', 'request_id': 'req-6c0ca291-8c4f-49f0-92e5-cbd82c674c4f'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:36.581799 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-6c0ca291-8c4f-49f0-92e5-cbd82c674c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bda09ec2bb341a1bc8dca75d3eae478', 'request_id': 'req-6c0ca291-8c4f-49f0-92e5-cbd82c674c4f'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:36.590764 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-6c0ca291-8c4f-49f0-92e5-cbd82c674c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bda09ec2bb341a1bc8dca75d3eae478', 'request_id': 'req-6c0ca291-8c4f-49f0-92e5-cbd82c674c4f'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:36.601044 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-6c0ca291-8c4f-49f0-92e5-cbd82c674c4f admin admin] The token cache is being invalidate because project 2bda09ec2bb341a1bc8dca75d3eae478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:59:36.601301 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-6c0ca291-8c4f-49f0-92e5-cbd82c674c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:36.602041 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-6c0ca291-8c4f-49f0-92e5-cbd82c674c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:36.603623 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1334/2657] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:59:36 2022] DELETE /identity/v3/projects/2bda09ec2bb341a1bc8dca75d3eae478 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:36.608779 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b165f-a5e1-40e6-b17a-00d348bd7737 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:36.609057 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b165f-a5e1-40e6-b17a-00d348bd7737 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:36.609320 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b165f-a5e1-40e6-b17a-00d348bd7737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:36.628195 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-865b165f-a5e1-40e6-b17a-00d348bd7737 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:36.629486 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-865b165f-a5e1-40e6-b17a-00d348bd7737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:36.687972 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1324/2658] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:59:36.695978 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac62f23-7abd-4b16-a85c-b92e5fbbf528 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:36.696269 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac62f23-7abd-4b16-a85c-b92e5fbbf528 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:36.696531 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac62f23-7abd-4b16-a85c-b92e5fbbf528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:36.715161 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-aac62f23-7abd-4b16-a85c-b92e5fbbf528 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:36.716379 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-aac62f23-7abd-4b16-a85c-b92e5fbbf528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:36.725206 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1335/2659] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:36.729347 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b165f-a5e1-40e6-b17a-00d348bd7737 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:36.739782 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b165f-a5e1-40e6-b17a-00d348bd7737 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:36.745077 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f29dc-0937-4d63-bdde-32279f177931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:36.745775 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f29dc-0937-4d63-bdde-32279f177931 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:36.746050 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f29dc-0937-4d63-bdde-32279f177931 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:36.746319 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f29dc-0937-4d63-bdde-32279f177931 admin admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:36.747049 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f29dc-0937-4d63-bdde-32279f177931 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:59:36.747350 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f29dc-0937-4d63-bdde-32279f177931 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:36.748970 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f29dc-0937-4d63-bdde-32279f177931 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:36.761195 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1325/2660] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 13:59:36.765792 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac62f23-7abd-4b16-a85c-b92e5fbbf528 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:36.776496 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac62f23-7abd-4b16-a85c-b92e5fbbf528 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:36.781194 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407858a-f736-442f-bb3c-fa7273cfe104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:36.781886 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407858a-f736-442f-bb3c-fa7273cfe104 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:36.782164 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407858a-f736-442f-bb3c-fa7273cfe104 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:36.782521 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b407858a-f736-442f-bb3c-fa7273cfe104 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:36.783235 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407858a-f736-442f-bb3c-fa7273cfe104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:36.785151 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b407858a-f736-442f-bb3c-fa7273cfe104 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:36.811310 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1336/2661] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:59:36 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:59:36.815778 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f29dc-0937-4d63-bdde-32279f177931 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:36.825883 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f29dc-0937-4d63-bdde-32279f177931 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:36.881802 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ea5d0-c623-4aaa-8d1a-86d1f70c4097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:36.882487 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ea5d0-c623-4aaa-8d1a-86d1f70c4097 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:36.882723 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ea5d0-c623-4aaa-8d1a-86d1f70c4097 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:36.882995 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ea5d0-c623-4aaa-8d1a-86d1f70c4097 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:36.883686 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ea5d0-c623-4aaa-8d1a-86d1f70c4097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:36.885603 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ea5d0-c623-4aaa-8d1a-86d1f70c4097 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:36.907995 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1326/2662] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:59:36 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:59:36.912654 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407858a-f736-442f-bb3c-fa7273cfe104 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:36.922920 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b407858a-f736-442f-bb3c-fa7273cfe104 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:36.928148 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bfb5d-9fc1-430c-80f8-8cb9abf4715e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:36.928800 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bfb5d-9fc1-430c-80f8-8cb9abf4715e admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:36.929076 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bfb5d-9fc1-430c-80f8-8cb9abf4715e admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:36.929314 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9bfb5d-9fc1-430c-80f8-8cb9abf4715e admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:36.930471 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9bfb5d-9fc1-430c-80f8-8cb9abf4715e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:36.931972 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9bfb5d-9fc1-430c-80f8-8cb9abf4715e admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:36.943563 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1337/2663] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:59:36.948001 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ea5d0-c623-4aaa-8d1a-86d1f70c4097 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:36.958399 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ea5d0-c623-4aaa-8d1a-86d1f70c4097 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:36.963458 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff760f95-46cd-40dc-86c5-c985132aa844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:36.964106 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff760f95-46cd-40dc-86c5-c985132aa844 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:36.964382 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff760f95-46cd-40dc-86c5-c985132aa844 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:36.964652 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff760f95-46cd-40dc-86c5-c985132aa844 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:36.965382 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff760f95-46cd-40dc-86c5-c985132aa844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:36.966966 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff760f95-46cd-40dc-86c5-c985132aa844 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:36.976836 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1327/2664] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:59:36.981068 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bfb5d-9fc1-430c-80f8-8cb9abf4715e admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:36.991093 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9bfb5d-9fc1-430c-80f8-8cb9abf4715e admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:36.995830 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8db219-f330-40a5-9f46-0026a2bc023c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:36.996698 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8db219-f330-40a5-9f46-0026a2bc023c admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:36.996972 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8db219-f330-40a5-9f46-0026a2bc023c admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:36.997240 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8db219-f330-40a5-9f46-0026a2bc023c admin admin] PATH_INFO: `/v3/projects/93ef7d759fb64b378992c7e2ca6dfd49/users/181b15ece1284c798a2c8780549073ec/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:37.012029 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8db219-f330-40a5-9f46-0026a2bc023c admin admin] RBAC: Authorizing `identity:create_grant(project_id=93ef7d759fb64b378992c7e2ca6dfd49, user_id=181b15ece1284c798a2c8780549073ec, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:37.014689 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8db219-f330-40a5-9f46-0026a2bc023c admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:37.029652 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1338/2665] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:59:36 2022] PUT /identity/v3/projects/93ef7d759fb64b378992c7e2ca6dfd49/users/181b15ece1284c798a2c8780549073ec/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:37.041399 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1cd80-b065-48f7-9095-b27efa6b3d1c None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:37.041720 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1cd80-b065-48f7-9095-b27efa6b3d1c None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:37.042021 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1cd80-b065-48f7-9095-b27efa6b3d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:37.076005 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-45e1cd80-b065-48f7-9095-b27efa6b3d1c None None] MFA Rules not processed for user `181b15ece1284c798a2c8780549073ec`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:37.077207 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-45e1cd80-b065-48f7-9095-b27efa6b3d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:37.141451 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1328/2666] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:37.146323 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8db219-f330-40a5-9f46-0026a2bc023c admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:37.217944 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8db219-f330-40a5-9f46-0026a2bc023c admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:37.223531 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a3b98-fb02-44f1-aff7-179f071b165e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:37.224142 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a3b98-fb02-44f1-aff7-179f071b165e admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:37.224444 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a3b98-fb02-44f1-aff7-179f071b165e admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:37.224708 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a3b98-fb02-44f1-aff7-179f071b165e admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:37.225394 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a3b98-fb02-44f1-aff7-179f071b165e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:37.227300 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a3b98-fb02-44f1-aff7-179f071b165e admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:37.258185 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1339/2667] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:59:37 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:59:37.262422 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1cd80-b065-48f7-9095-b27efa6b3d1c None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:37.273173 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1cd80-b065-48f7-9095-b27efa6b3d1c None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:37.329469 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb3d2d-d9a6-4390-b6b6-e1dfbd2519c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:37.330144 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb3d2d-d9a6-4390-b6b6-e1dfbd2519c4 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:37.330506 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb3d2d-d9a6-4390-b6b6-e1dfbd2519c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:37.330781 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb3d2d-d9a6-4390-b6b6-e1dfbd2519c4 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:37.331504 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb3d2d-d9a6-4390-b6b6-e1dfbd2519c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:37.333434 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb3d2d-d9a6-4390-b6b6-e1dfbd2519c4 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:37.354547 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1329/2668] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:59:37 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:59:37.358573 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a3b98-fb02-44f1-aff7-179f071b165e admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:37.368847 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a3b98-fb02-44f1-aff7-179f071b165e admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:37.373880 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6076169-5e12-40b8-837f-f7ca2d75bb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:37.374558 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6076169-5e12-40b8-837f-f7ca2d75bb92 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:37.374836 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6076169-5e12-40b8-837f-f7ca2d75bb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:37.375110 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6076169-5e12-40b8-837f-f7ca2d75bb92 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:37.375837 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6076169-5e12-40b8-837f-f7ca2d75bb92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:37.377476 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6076169-5e12-40b8-837f-f7ca2d75bb92 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:37.387876 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1340/2669] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:59:37.392328 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb3d2d-d9a6-4390-b6b6-e1dfbd2519c4 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:37.404919 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb3d2d-d9a6-4390-b6b6-e1dfbd2519c4 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:37.412727 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7cabd-9c64-47e9-a562-763f6440c1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:37.414126 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7cabd-9c64-47e9-a562-763f6440c1f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:37.414475 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7cabd-9c64-47e9-a562-763f6440c1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:37.414822 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7cabd-9c64-47e9-a562-763f6440c1f3 admin admin] PATH_INFO: `/v3/projects/6a7177723334468184881e65d839eda2/users/00cced51fb004b51a01eab1e2992d4ca/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:37.434459 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7cabd-9c64-47e9-a562-763f6440c1f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a7177723334468184881e65d839eda2, user_id=00cced51fb004b51a01eab1e2992d4ca, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:37.437074 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7cabd-9c64-47e9-a562-763f6440c1f3 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:37.453193 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1330/2670] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:59:37 2022] PUT /identity/v3/projects/6a7177723334468184881e65d839eda2/users/00cced51fb004b51a01eab1e2992d4ca/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:59:37.457678 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6076169-5e12-40b8-837f-f7ca2d75bb92 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:37.468335 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6076169-5e12-40b8-837f-f7ca2d75bb92 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:37.527440 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf5049-0f46-48a1-bebf-572b3641135b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:37.528118 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf5049-0f46-48a1-bebf-572b3641135b admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:37.528397 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf5049-0f46-48a1-bebf-572b3641135b admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:37.528670 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf5049-0f46-48a1-bebf-572b3641135b admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:37.529392 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf5049-0f46-48a1-bebf-572b3641135b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:37.531017 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf5049-0f46-48a1-bebf-572b3641135b admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:37.540800 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1341/2671] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:59:37.545127 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7cabd-9c64-47e9-a562-763f6440c1f3 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:37.555452 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7cabd-9c64-47e9-a562-763f6440c1f3 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:37.560231 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103dd0b8-dae7-43d2-88f2-fcf7b0e56896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:37.561117 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103dd0b8-dae7-43d2-88f2-fcf7b0e56896 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:37.561431 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103dd0b8-dae7-43d2-88f2-fcf7b0e56896 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:37.561679 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103dd0b8-dae7-43d2-88f2-fcf7b0e56896 admin admin] PATH_INFO: `/v3/projects/6a7177723334468184881e65d839eda2/users/00cced51fb004b51a01eab1e2992d4ca/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:37.562781 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf5049-0f46-48a1-bebf-572b3641135b admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:37.563664 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103dd0b8-dae7-43d2-88f2-fcf7b0e56896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a7177723334468184881e65d839eda2, user_id=00cced51fb004b51a01eab1e2992d4ca, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:37.564643 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-8fbf5049-0f46-48a1-bebf-572b3641135b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:37.566393 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103dd0b8-dae7-43d2-88f2-fcf7b0e56896 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:37.577289 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1331/2672] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:59:37 2022] PUT /identity/v3/projects/6a7177723334468184881e65d839eda2/users/00cced51fb004b51a01eab1e2992d4ca/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:37.587317 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46742586-54b2-4df5-aa18-d3bb70b9f276 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:37.587601 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46742586-54b2-4df5-aa18-d3bb70b9f276 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:37.588396 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46742586-54b2-4df5-aa18-d3bb70b9f276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:37.616428 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-46742586-54b2-4df5-aa18-d3bb70b9f276 None None] MFA Rules not processed for user `00cced51fb004b51a01eab1e2992d4ca`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:37.617652 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-46742586-54b2-4df5-aa18-d3bb70b9f276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:37.622107 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf5049-0f46-48a1-bebf-572b3641135b admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:37.667740 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92acd5fc-558b-43b7-8b60-a2d2b97e9b3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:37.668380 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acd5fc-558b-43b7-8b60-a2d2b97e9b3d service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:37.668656 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acd5fc-558b-43b7-8b60-a2d2b97e9b3d service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:37.668924 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92acd5fc-558b-43b7-8b60-a2d2b97e9b3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:37.670727 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-92acd5fc-558b-43b7-8b60-a2d2b97e9b3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:37.684059 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1332/2673] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:37 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:59:37.695691 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46742586-54b2-4df5-aa18-d3bb70b9f276 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:37.697089 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-46742586-54b2-4df5-aa18-d3bb70b9f276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:37.708790 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46742586-54b2-4df5-aa18-d3bb70b9f276 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:37.712513 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e05b77-6d17-4b85-8f3e-ec6052e3bdc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:37.713531 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e05b77-6d17-4b85-8f3e-ec6052e3bdc2 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:37.713815 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e05b77-6d17-4b85-8f3e-ec6052e3bdc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:37.714084 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e05b77-6d17-4b85-8f3e-ec6052e3bdc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:37.723116 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e05b77-6d17-4b85-8f3e-ec6052e3bdc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:37.724464 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e05b77-6d17-4b85-8f3e-ec6052e3bdc2 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:37.731444 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acd5fc-558b-43b7-8b60-a2d2b97e9b3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:37.732879 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92acd5fc-558b-43b7-8b60-a2d2b97e9b3d service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:37.733725 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1333/2674] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:59:37 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:59:37.742525 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1342/2675] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:59:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:59:38.128426 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e05b77-6d17-4b85-8f3e-ec6052e3bdc2 service cinder] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:38.198061 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e05b77-6d17-4b85-8f3e-ec6052e3bdc2 service cinder] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:38.206475 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74caa93d-64f6-451f-acc5-3381ea464d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:38.207350 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74caa93d-64f6-451f-acc5-3381ea464d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:38.207626 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74caa93d-64f6-451f-acc5-3381ea464d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:38.207893 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74caa93d-64f6-451f-acc5-3381ea464d18 admin admin] PATH_INFO: `/v3/users/181b15ece1284c798a2c8780549073ec` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:38.209215 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74caa93d-64f6-451f-acc5-3381ea464d18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=181b15ece1284c798a2c8780549073ec)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:38.211157 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74caa93d-64f6-451f-acc5-3381ea464d18 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:38.266957 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-74caa93d-64f6-451f-acc5-3381ea464d18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '181b15ece1284c798a2c8780549073ec'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:38.267541 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-74caa93d-64f6-451f-acc5-3381ea464d18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '181b15ece1284c798a2c8780549073ec'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:38.279378 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-74caa93d-64f6-451f-acc5-3381ea464d18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '181b15ece1284c798a2c8780549073ec'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:38.293046 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-74caa93d-64f6-451f-acc5-3381ea464d18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '181b15ece1284c798a2c8780549073ec'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:38.299653 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-74caa93d-64f6-451f-acc5-3381ea464d18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '181b15ece1284c798a2c8780549073ec'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:38.305528 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1334/2676] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:59:38 2022] DELETE /identity/v3/users/181b15ece1284c798a2c8780549073ec => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:38.310237 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4bf65-ed34-463c-bdb7-9a2984f07cae None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:38.310745 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4bf65-ed34-463c-bdb7-9a2984f07cae None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:38.310745 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4bf65-ed34-463c-bdb7-9a2984f07cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:38.328722 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-0ba4bf65-ed34-463c-bdb7-9a2984f07cae None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:38.329952 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-0ba4bf65-ed34-463c-bdb7-9a2984f07cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:38.392346 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1343/2677] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:38.405481 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74caa93d-64f6-451f-acc5-3381ea464d18 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:38.407900 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-74caa93d-64f6-451f-acc5-3381ea464d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:38.470362 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74caa93d-64f6-451f-acc5-3381ea464d18 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:38.474334 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44178719-35b7-4415-9176-5cb63bc3a9f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:38.474978 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44178719-35b7-4415-9176-5cb63bc3a9f9 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:38.475255 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44178719-35b7-4415-9176-5cb63bc3a9f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:38.475526 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44178719-35b7-4415-9176-5cb63bc3a9f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:38.484993 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44178719-35b7-4415-9176-5cb63bc3a9f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:38.486434 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44178719-35b7-4415-9176-5cb63bc3a9f9 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:38.495834 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1335/2678] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:59:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:59:38.960622 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4bf65-ed34-463c-bdb7-9a2984f07cae None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:38.962096 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-0ba4bf65-ed34-463c-bdb7-9a2984f07cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:38.981491 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4bf65-ed34-463c-bdb7-9a2984f07cae None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:39.017121 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e2293-776e-47c3-8338-889ca30a6796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:39.020588 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e2293-776e-47c3-8338-889ca30a6796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:39.020990 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e2293-776e-47c3-8338-889ca30a6796 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:39.021336 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e2293-776e-47c3-8338-889ca30a6796 admin admin] PATH_INFO: `/v3/projects/93ef7d759fb64b378992c7e2ca6dfd49` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:39.025191 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e2293-776e-47c3-8338-889ca30a6796 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93ef7d759fb64b378992c7e2ca6dfd49)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:39.028683 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e2293-776e-47c3-8338-889ca30a6796 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:39.123899 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-382e2293-776e-47c3-8338-889ca30a6796 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93ef7d759fb64b378992c7e2ca6dfd49', 'request_id': 'req-382e2293-776e-47c3-8338-889ca30a6796'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:39.130226 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-382e2293-776e-47c3-8338-889ca30a6796 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93ef7d759fb64b378992c7e2ca6dfd49', 'request_id': 'req-382e2293-776e-47c3-8338-889ca30a6796'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:39.140836 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-382e2293-776e-47c3-8338-889ca30a6796 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93ef7d759fb64b378992c7e2ca6dfd49', 'request_id': 'req-382e2293-776e-47c3-8338-889ca30a6796'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:39.152357 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-382e2293-776e-47c3-8338-889ca30a6796 admin admin] The token cache is being invalidate because project 93ef7d759fb64b378992c7e2ca6dfd49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:59:39.152979 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-382e2293-776e-47c3-8338-889ca30a6796 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:39.153944 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-382e2293-776e-47c3-8338-889ca30a6796 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:39.159145 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1344/2679] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:59:38 2022] DELETE /identity/v3/projects/93ef7d759fb64b378992c7e2ca6dfd49 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:39.160049 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44178719-35b7-4415-9176-5cb63bc3a9f9 service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:39.171714 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44178719-35b7-4415-9176-5cb63bc3a9f9 service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:39.230120 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af754f-1724-46f7-bf2a-531568ea10c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:39.231081 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af754f-1724-46f7-bf2a-531568ea10c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:39.231422 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af754f-1724-46f7-bf2a-531568ea10c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:39.231771 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af754f-1724-46f7-bf2a-531568ea10c7 admin admin] PATH_INFO: `/v3/users/00cced51fb004b51a01eab1e2992d4ca` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:39.233035 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af754f-1724-46f7-bf2a-531568ea10c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00cced51fb004b51a01eab1e2992d4ca)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:39.235672 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af754f-1724-46f7-bf2a-531568ea10c7 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:39.288508 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a7af754f-1724-46f7-bf2a-531568ea10c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00cced51fb004b51a01eab1e2992d4ca'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:39.289073 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a7af754f-1724-46f7-bf2a-531568ea10c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00cced51fb004b51a01eab1e2992d4ca'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:39.297418 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a7af754f-1724-46f7-bf2a-531568ea10c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00cced51fb004b51a01eab1e2992d4ca'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:39.310224 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a7af754f-1724-46f7-bf2a-531568ea10c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00cced51fb004b51a01eab1e2992d4ca'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:39.317540 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a7af754f-1724-46f7-bf2a-531568ea10c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00cced51fb004b51a01eab1e2992d4ca'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:39.323558 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1336/2680] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:59:39 2022] DELETE /identity/v3/users/00cced51fb004b51a01eab1e2992d4ca => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 13:59:39.599979 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e2293-776e-47c3-8338-889ca30a6796 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:39.601400 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-382e2293-776e-47c3-8338-889ca30a6796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:39.615717 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e2293-776e-47c3-8338-889ca30a6796 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:39.673448 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e01ec9-15d1-4825-a214-59e5e672b3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:39.674386 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e01ec9-15d1-4825-a214-59e5e672b3e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:39.674667 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e01ec9-15d1-4825-a214-59e5e672b3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:39.674939 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e01ec9-15d1-4825-a214-59e5e672b3e9 admin admin] PATH_INFO: `/v3/projects/6a7177723334468184881e65d839eda2` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:39.676245 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e01ec9-15d1-4825-a214-59e5e672b3e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a7177723334468184881e65d839eda2)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:39.678211 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e01ec9-15d1-4825-a214-59e5e672b3e9 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:39.726169 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-73e01ec9-15d1-4825-a214-59e5e672b3e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a7177723334468184881e65d839eda2', 'request_id': 'req-73e01ec9-15d1-4825-a214-59e5e672b3e9'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:39.732059 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-73e01ec9-15d1-4825-a214-59e5e672b3e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a7177723334468184881e65d839eda2', 'request_id': 'req-73e01ec9-15d1-4825-a214-59e5e672b3e9'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:39.740972 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-73e01ec9-15d1-4825-a214-59e5e672b3e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a7177723334468184881e65d839eda2', 'request_id': 'req-73e01ec9-15d1-4825-a214-59e5e672b3e9'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:39.751311 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-73e01ec9-15d1-4825-a214-59e5e672b3e9 admin admin] The token cache is being invalidate because project 6a7177723334468184881e65d839eda2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:59:39.751590 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-73e01ec9-15d1-4825-a214-59e5e672b3e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:39.752232 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-73e01ec9-15d1-4825-a214-59e5e672b3e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:39.754076 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1345/2681] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:59:39 2022] DELETE /identity/v3/projects/6a7177723334468184881e65d839eda2 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:39.758936 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ab4cc-02f8-470c-bba8-d2152d86dd47 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:39.759228 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ab4cc-02f8-470c-bba8-d2152d86dd47 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:39.759503 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ab4cc-02f8-470c-bba8-d2152d86dd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:39.777202 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-0c6ab4cc-02f8-470c-bba8-d2152d86dd47 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:39.778435 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-0c6ab4cc-02f8-470c-bba8-d2152d86dd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:39.845932 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1337/2682] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:39.855561 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e0131-026b-4556-bf19-813061b50ced None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:39.855854 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e0131-026b-4556-bf19-813061b50ced None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:39.856132 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e0131-026b-4556-bf19-813061b50ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:39.875677 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-069e0131-026b-4556-bf19-813061b50ced None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:39.876851 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-069e0131-026b-4556-bf19-813061b50ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:39.885072 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1346/2683] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:39.889435 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ab4cc-02f8-470c-bba8-d2152d86dd47 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:39.899789 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ab4cc-02f8-470c-bba8-d2152d86dd47 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:39.905230 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ef5cb-0cd6-4a9f-ac5f-7e1a3b91fb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:39.905895 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ef5cb-0cd6-4a9f-ac5f-7e1a3b91fb13 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:39.906187 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ef5cb-0cd6-4a9f-ac5f-7e1a3b91fb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:39.906457 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ef5cb-0cd6-4a9f-ac5f-7e1a3b91fb13 admin admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:39.907185 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ef5cb-0cd6-4a9f-ac5f-7e1a3b91fb13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:59:39.907488 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ef5cb-0cd6-4a9f-ac5f-7e1a3b91fb13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:39.909131 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ef5cb-0cd6-4a9f-ac5f-7e1a3b91fb13 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:39.920419 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1338/2684] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:59:39.924535 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e0131-026b-4556-bf19-813061b50ced None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:39.933586 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e0131-026b-4556-bf19-813061b50ced None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:39.938581 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2caad-0696-4781-b2f2-dc874d4f33f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:39.939212 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2caad-0696-4781-b2f2-dc874d4f33f9 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:39.939484 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2caad-0696-4781-b2f2-dc874d4f33f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:39.939749 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2caad-0696-4781-b2f2-dc874d4f33f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:39.940479 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2caad-0696-4781-b2f2-dc874d4f33f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:39.942360 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2caad-0696-4781-b2f2-dc874d4f33f9 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:39.973676 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1347/2685] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:59:39 2022] POST /identity/v3/projects => generated 357 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:59:39.978239 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ef5cb-0cd6-4a9f-ac5f-7e1a3b91fb13 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:39.988482 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ef5cb-0cd6-4a9f-ac5f-7e1a3b91fb13 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:40.044705 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1cb4a-2820-4c99-8106-ae020c447598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:40.045389 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1cb4a-2820-4c99-8106-ae020c447598 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:40.045678 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1cb4a-2820-4c99-8106-ae020c447598 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:40.045946 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1cb4a-2820-4c99-8106-ae020c447598 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:40.046633 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1cb4a-2820-4c99-8106-ae020c447598 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:40.048528 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1cb4a-2820-4c99-8106-ae020c447598 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:40.072090 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1339/2686] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:59:39 2022] POST /identity/v3/users => generated 279 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:59:40.076319 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2caad-0696-4781-b2f2-dc874d4f33f9 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:40.086944 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2caad-0696-4781-b2f2-dc874d4f33f9 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:40.092725 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3cea1-2857-4bf0-b433-d0b1dd6ace04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:40.093395 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3cea1-2857-4bf0-b433-d0b1dd6ace04 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:40.093663 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3cea1-2857-4bf0-b433-d0b1dd6ace04 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:40.093930 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3cea1-2857-4bf0-b433-d0b1dd6ace04 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:40.094662 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3cea1-2857-4bf0-b433-d0b1dd6ace04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:40.096399 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3cea1-2857-4bf0-b433-d0b1dd6ace04 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:40.106998 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1348/2687] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:59:40.110903 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1cb4a-2820-4c99-8106-ae020c447598 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:40.121514 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1cb4a-2820-4c99-8106-ae020c447598 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:40.127384 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6189c-ff43-4cde-ad02-51c94c511b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:40.128074 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6189c-ff43-4cde-ad02-51c94c511b33 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:40.128346 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6189c-ff43-4cde-ad02-51c94c511b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:40.128614 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6189c-ff43-4cde-ad02-51c94c511b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:40.129401 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6189c-ff43-4cde-ad02-51c94c511b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:40.130986 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a6189c-ff43-4cde-ad02-51c94c511b33 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:40.147880 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1340/2688] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:59:40.152328 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3cea1-2857-4bf0-b433-d0b1dd6ace04 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:40.162781 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3cea1-2857-4bf0-b433-d0b1dd6ace04 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:40.167817 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f8501-cb0c-4700-b875-25a072bdab1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:40.168691 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f8501-cb0c-4700-b875-25a072bdab1d admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:40.168971 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f8501-cb0c-4700-b875-25a072bdab1d admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:40.169241 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f8501-cb0c-4700-b875-25a072bdab1d admin admin] PATH_INFO: `/v3/projects/764d3f95a6084e18a1ca9b0b7e8702c0/users/82cd8775fbc840608b86b6bb39153880/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:40.183916 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f8501-cb0c-4700-b875-25a072bdab1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=764d3f95a6084e18a1ca9b0b7e8702c0, user_id=82cd8775fbc840608b86b6bb39153880, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:40.186583 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f8501-cb0c-4700-b875-25a072bdab1d admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:40.202219 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1349/2689] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:59:40 2022] PUT /identity/v3/projects/764d3f95a6084e18a1ca9b0b7e8702c0/users/82cd8775fbc840608b86b6bb39153880/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:40.212441 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67374a97-3b3c-4476-a393-c1b832b0ea05 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:40.213299 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67374a97-3b3c-4476-a393-c1b832b0ea05 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:40.213493 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67374a97-3b3c-4476-a393-c1b832b0ea05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:40.240843 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-67374a97-3b3c-4476-a393-c1b832b0ea05 None None] MFA Rules not processed for user `82cd8775fbc840608b86b6bb39153880`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:40.242068 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-67374a97-3b3c-4476-a393-c1b832b0ea05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:40.305732 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1341/2690] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:40 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:40.310389 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f8501-cb0c-4700-b875-25a072bdab1d admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:40.373425 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f8501-cb0c-4700-b875-25a072bdab1d admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:40.378057 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c2d95-3dc5-4392-8312-289c1b079ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:40.378711 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c2d95-3dc5-4392-8312-289c1b079ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:40.378991 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c2d95-3dc5-4392-8312-289c1b079ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:40.379297 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c2d95-3dc5-4392-8312-289c1b079ef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:40.379995 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c2d95-3dc5-4392-8312-289c1b079ef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:40.381904 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c2d95-3dc5-4392-8312-289c1b079ef8 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:40.408054 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1350/2691] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:59:40 2022] POST /identity/v3/projects => generated 355 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:59:40.412357 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67374a97-3b3c-4476-a393-c1b832b0ea05 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:40.423204 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67374a97-3b3c-4476-a393-c1b832b0ea05 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:40.482747 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53de3e-fc36-4b49-903f-ed67565b8690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:40.483427 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53de3e-fc36-4b49-903f-ed67565b8690 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:40.483703 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53de3e-fc36-4b49-903f-ed67565b8690 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:40.483974 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53de3e-fc36-4b49-903f-ed67565b8690 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:40.484665 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53de3e-fc36-4b49-903f-ed67565b8690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:40.486598 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53de3e-fc36-4b49-903f-ed67565b8690 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:40.510523 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1342/2692] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:59:40 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 13:59:40.514765 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c2d95-3dc5-4392-8312-289c1b079ef8 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:40.526158 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c2d95-3dc5-4392-8312-289c1b079ef8 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:40.534876 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3938de-2b2f-49ab-bcdc-a87e2d1b8738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:40.535596 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3938de-2b2f-49ab-bcdc-a87e2d1b8738 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:40.535925 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3938de-2b2f-49ab-bcdc-a87e2d1b8738 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:40.536254 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3938de-2b2f-49ab-bcdc-a87e2d1b8738 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:40.537025 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3938de-2b2f-49ab-bcdc-a87e2d1b8738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:40.538674 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3938de-2b2f-49ab-bcdc-a87e2d1b8738 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:40.551761 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1351/2693] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:59:40.557200 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53de3e-fc36-4b49-903f-ed67565b8690 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:40.567211 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53de3e-fc36-4b49-903f-ed67565b8690 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:40.580168 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d3615-7262-412b-b684-dd5e19d17d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:40.581264 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d3615-7262-412b-b684-dd5e19d17d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:40.581567 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d3615-7262-412b-b684-dd5e19d17d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:40.581842 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d3615-7262-412b-b684-dd5e19d17d7b admin admin] PATH_INFO: `/v3/projects/affe2ca4e4da4cc4994a59e6a1532490/users/aca65bdcac3143518efef628afdbdfce/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:40.596897 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d3615-7262-412b-b684-dd5e19d17d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=affe2ca4e4da4cc4994a59e6a1532490, user_id=aca65bdcac3143518efef628afdbdfce, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:40.599593 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d3615-7262-412b-b684-dd5e19d17d7b admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:40.614168 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1343/2694] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:59:40 2022] PUT /identity/v3/projects/affe2ca4e4da4cc4994a59e6a1532490/users/aca65bdcac3143518efef628afdbdfce/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:40.618158 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3938de-2b2f-49ab-bcdc-a87e2d1b8738 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:40.627971 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3938de-2b2f-49ab-bcdc-a87e2d1b8738 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:40.682536 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf17db-94e6-4ad0-a33b-2cee4db295ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:40.683196 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf17db-94e6-4ad0-a33b-2cee4db295ce admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:40.683478 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf17db-94e6-4ad0-a33b-2cee4db295ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:40.683748 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf17db-94e6-4ad0-a33b-2cee4db295ce admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:40.684475 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf17db-94e6-4ad0-a33b-2cee4db295ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:40.686102 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf17db-94e6-4ad0-a33b-2cee4db295ce admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:40.696081 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1352/2695] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:59:40.700438 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d3615-7262-412b-b684-dd5e19d17d7b admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:40.710767 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d3615-7262-412b-b684-dd5e19d17d7b admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:40.715977 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb61ca-bbdc-4b2a-bfeb-48ea3beed5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:40.716908 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb61ca-bbdc-4b2a-bfeb-48ea3beed5bb admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:40.717176 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb61ca-bbdc-4b2a-bfeb-48ea3beed5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:40.717539 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb61ca-bbdc-4b2a-bfeb-48ea3beed5bb admin admin] PATH_INFO: `/v3/projects/affe2ca4e4da4cc4994a59e6a1532490/users/aca65bdcac3143518efef628afdbdfce/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:40.719512 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb61ca-bbdc-4b2a-bfeb-48ea3beed5bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=affe2ca4e4da4cc4994a59e6a1532490, user_id=aca65bdcac3143518efef628afdbdfce, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:40.722407 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb61ca-bbdc-4b2a-bfeb-48ea3beed5bb admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:40.732540 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1344/2696] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:59:40 2022] PUT /identity/v3/projects/affe2ca4e4da4cc4994a59e6a1532490/users/aca65bdcac3143518efef628afdbdfce/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:40.743979 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef5999-8437-4c6f-8f31-dfb9565953e2 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:40.744267 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef5999-8437-4c6f-8f31-dfb9565953e2 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:40.744539 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef5999-8437-4c6f-8f31-dfb9565953e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:40.773125 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-7fef5999-8437-4c6f-8f31-dfb9565953e2 None None] MFA Rules not processed for user `aca65bdcac3143518efef628afdbdfce`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:40.774476 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-7fef5999-8437-4c6f-8f31-dfb9565953e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:40.844324 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1353/2697] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:40 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:40.856891 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb61ca-bbdc-4b2a-bfeb-48ea3beed5bb admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:40.858950 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-deeb61ca-bbdc-4b2a-bfeb-48ea3beed5bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:40.917066 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb61ca-bbdc-4b2a-bfeb-48ea3beed5bb admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:40.920900 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18795e-1988-4359-89ae-1f35fa59fc93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:40.921577 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18795e-1988-4359-89ae-1f35fa59fc93 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:40.921854 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18795e-1988-4359-89ae-1f35fa59fc93 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:40.922126 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a18795e-1988-4359-89ae-1f35fa59fc93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:40.932378 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18795e-1988-4359-89ae-1f35fa59fc93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:40.933935 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a18795e-1988-4359-89ae-1f35fa59fc93 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:40.944150 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1345/2698] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:59:40 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:59:41.019025 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef5999-8437-4c6f-8f31-dfb9565953e2 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:41.028909 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef5999-8437-4c6f-8f31-dfb9565953e2 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:41.032783 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bb974-423d-4d33-bdf4-d602c50e2b30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:41.033419 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bb974-423d-4d33-bdf4-d602c50e2b30 service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:41.033739 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bb974-423d-4d33-bdf4-d602c50e2b30 service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:41.034011 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bb974-423d-4d33-bdf4-d602c50e2b30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:41.092542 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bb974-423d-4d33-bdf4-d602c50e2b30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:41.094648 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bb974-423d-4d33-bdf4-d602c50e2b30 service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:41.108218 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1354/2699] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:59:41 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:59:51.057258 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18795e-1988-4359-89ae-1f35fa59fc93 service cinder] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:51.059164 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-2a18795e-1988-4359-89ae-1f35fa59fc93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:51.127002 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a18795e-1988-4359-89ae-1f35fa59fc93 service cinder] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:51.131377 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04922cdc-36a5-4518-aada-748d46724135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:51.132264 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04922cdc-36a5-4518-aada-748d46724135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:51.132519 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04922cdc-36a5-4518-aada-748d46724135 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:51.132801 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04922cdc-36a5-4518-aada-748d46724135 admin admin] PATH_INFO: `/v3/users/c45887a694bf482ab3fb2bc282d7841d` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:51.134127 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04922cdc-36a5-4518-aada-748d46724135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c45887a694bf482ab3fb2bc282d7841d)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:51.136604 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04922cdc-36a5-4518-aada-748d46724135 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:51.183841 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-04922cdc-36a5-4518-aada-748d46724135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c45887a694bf482ab3fb2bc282d7841d'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:51.184504 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-04922cdc-36a5-4518-aada-748d46724135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c45887a694bf482ab3fb2bc282d7841d'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:51.194958 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-04922cdc-36a5-4518-aada-748d46724135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c45887a694bf482ab3fb2bc282d7841d'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:51.204253 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-04922cdc-36a5-4518-aada-748d46724135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c45887a694bf482ab3fb2bc282d7841d'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:51.210665 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-04922cdc-36a5-4518-aada-748d46724135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c45887a694bf482ab3fb2bc282d7841d'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:51.216829 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1346/2700] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:59:51 2022] DELETE /identity/v3/users/c45887a694bf482ab3fb2bc282d7841d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:51.408057 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bb974-423d-4d33-bdf4-d602c50e2b30 service cinder] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:51.419488 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bb974-423d-4d33-bdf4-d602c50e2b30 service cinder] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:51.477573 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c9fa3-c066-4bd4-9e23-e3aaf2ea500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:51.478431 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c9fa3-c066-4bd4-9e23-e3aaf2ea500f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:51.478708 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c9fa3-c066-4bd4-9e23-e3aaf2ea500f admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:51.479119 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0c9fa3-c066-4bd4-9e23-e3aaf2ea500f admin admin] PATH_INFO: `/v3/projects/48fb2900cb4743a5a3d764332e838494` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:51.480339 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c9fa3-c066-4bd4-9e23-e3aaf2ea500f admin admin] RBAC: Authorizing `identity:delete_project(project_id=48fb2900cb4743a5a3d764332e838494)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:51.482287 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0c9fa3-c066-4bd4-9e23-e3aaf2ea500f admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:51.529385 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-5b0c9fa3-c066-4bd4-9e23-e3aaf2ea500f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48fb2900cb4743a5a3d764332e838494', 'request_id': 'req-5b0c9fa3-c066-4bd4-9e23-e3aaf2ea500f'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:51.538452 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-5b0c9fa3-c066-4bd4-9e23-e3aaf2ea500f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48fb2900cb4743a5a3d764332e838494', 'request_id': 'req-5b0c9fa3-c066-4bd4-9e23-e3aaf2ea500f'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:51.548635 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-5b0c9fa3-c066-4bd4-9e23-e3aaf2ea500f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48fb2900cb4743a5a3d764332e838494', 'request_id': 'req-5b0c9fa3-c066-4bd4-9e23-e3aaf2ea500f'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:51.558777 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-5b0c9fa3-c066-4bd4-9e23-e3aaf2ea500f admin admin] The token cache is being invalidate because project 48fb2900cb4743a5a3d764332e838494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:59:51.559062 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-5b0c9fa3-c066-4bd4-9e23-e3aaf2ea500f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:51.559698 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-5b0c9fa3-c066-4bd4-9e23-e3aaf2ea500f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:51.561245 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1355/2701] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:59:51 2022] DELETE /identity/v3/projects/48fb2900cb4743a5a3d764332e838494 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:51.565398 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04922cdc-36a5-4518-aada-748d46724135 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:51.566902 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-04922cdc-36a5-4518-aada-748d46724135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:51.580260 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04922cdc-36a5-4518-aada-748d46724135 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:51.636324 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da238e0-75e7-4473-b899-1e49a78f7c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:51.637116 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da238e0-75e7-4473-b899-1e49a78f7c8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:51.637381 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da238e0-75e7-4473-b899-1e49a78f7c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:51.637695 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da238e0-75e7-4473-b899-1e49a78f7c8e admin admin] PATH_INFO: `/v3/users/6566f3bb9ed64ef9aac603465f1fbe02` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:51.638923 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da238e0-75e7-4473-b899-1e49a78f7c8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6566f3bb9ed64ef9aac603465f1fbe02)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:51.640808 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da238e0-75e7-4473-b899-1e49a78f7c8e admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:51.692583 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0da238e0-75e7-4473-b899-1e49a78f7c8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6566f3bb9ed64ef9aac603465f1fbe02'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:51.693290 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0da238e0-75e7-4473-b899-1e49a78f7c8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6566f3bb9ed64ef9aac603465f1fbe02'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:51.705749 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0da238e0-75e7-4473-b899-1e49a78f7c8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6566f3bb9ed64ef9aac603465f1fbe02'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:51.720158 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0da238e0-75e7-4473-b899-1e49a78f7c8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6566f3bb9ed64ef9aac603465f1fbe02'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:51.729085 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-0da238e0-75e7-4473-b899-1e49a78f7c8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6566f3bb9ed64ef9aac603465f1fbe02'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:51.735676 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1347/2702] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:59:51 2022] DELETE /identity/v3/users/6566f3bb9ed64ef9aac603465f1fbe02 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:51.923671 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c9fa3-c066-4bd4-9e23-e3aaf2ea500f admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:51.925087 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-5b0c9fa3-c066-4bd4-9e23-e3aaf2ea500f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:51.938034 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0c9fa3-c066-4bd4-9e23-e3aaf2ea500f admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:51.992906 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1103e9d-a2d9-48a4-84e6-4f5b807348b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:51.993805 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1103e9d-a2d9-48a4-84e6-4f5b807348b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:51.994085 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1103e9d-a2d9-48a4-84e6-4f5b807348b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:51.994358 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1103e9d-a2d9-48a4-84e6-4f5b807348b9 admin admin] PATH_INFO: `/v3/projects/2637869956b94fd6b1821c51aefa64a6` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:51.995542 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1103e9d-a2d9-48a4-84e6-4f5b807348b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2637869956b94fd6b1821c51aefa64a6)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:51.997477 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1103e9d-a2d9-48a4-84e6-4f5b807348b9 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:52.056725 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-a1103e9d-a2d9-48a4-84e6-4f5b807348b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2637869956b94fd6b1821c51aefa64a6', 'request_id': 'req-a1103e9d-a2d9-48a4-84e6-4f5b807348b9'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:52.062849 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-a1103e9d-a2d9-48a4-84e6-4f5b807348b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2637869956b94fd6b1821c51aefa64a6', 'request_id': 'req-a1103e9d-a2d9-48a4-84e6-4f5b807348b9'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:52.071730 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-a1103e9d-a2d9-48a4-84e6-4f5b807348b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2637869956b94fd6b1821c51aefa64a6', 'request_id': 'req-a1103e9d-a2d9-48a4-84e6-4f5b807348b9'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:52.081723 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-a1103e9d-a2d9-48a4-84e6-4f5b807348b9 admin admin] The token cache is being invalidate because project 2637869956b94fd6b1821c51aefa64a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:59:52.082001 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-a1103e9d-a2d9-48a4-84e6-4f5b807348b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:52.082611 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-a1103e9d-a2d9-48a4-84e6-4f5b807348b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:52.084156 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1356/2703] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:59:51 2022] DELETE /identity/v3/projects/2637869956b94fd6b1821c51aefa64a6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:52.089946 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e456c-0c3f-403e-8df9-69598ba59816 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:52.090434 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e456c-0c3f-403e-8df9-69598ba59816 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:52.090528 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e456c-0c3f-403e-8df9-69598ba59816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:52.108549 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-4f9e456c-0c3f-403e-8df9-69598ba59816 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:52.109782 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-4f9e456c-0c3f-403e-8df9-69598ba59816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:52.174094 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1348/2704] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:52.182292 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994926b-6dae-4b35-a139-0599f5c3e624 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:52.182574 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994926b-6dae-4b35-a139-0599f5c3e624 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:52.182840 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994926b-6dae-4b35-a139-0599f5c3e624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:52.201799 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-0994926b-6dae-4b35-a139-0599f5c3e624 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:52.202983 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-0994926b-6dae-4b35-a139-0599f5c3e624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:52.212678 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1357/2705] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:52.217669 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e456c-0c3f-403e-8df9-69598ba59816 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:52.230769 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e456c-0c3f-403e-8df9-69598ba59816 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:52.236503 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a36656-9ed6-4600-a507-0ec1f5a94635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:52.237146 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a36656-9ed6-4600-a507-0ec1f5a94635 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:52.237457 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a36656-9ed6-4600-a507-0ec1f5a94635 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:52.237709 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a36656-9ed6-4600-a507-0ec1f5a94635 admin admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:52.238427 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a36656-9ed6-4600-a507-0ec1f5a94635 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:59:52.238722 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a36656-9ed6-4600-a507-0ec1f5a94635 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:52.240306 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a36656-9ed6-4600-a507-0ec1f5a94635 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:52.252024 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1349/2706] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:59:52.257840 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994926b-6dae-4b35-a139-0599f5c3e624 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:52.272320 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994926b-6dae-4b35-a139-0599f5c3e624 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:52.279820 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0536a0f-d5c4-4361-a946-40c23c78f678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:52.280718 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0536a0f-d5c4-4361-a946-40c23c78f678 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:52.281084 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0536a0f-d5c4-4361-a946-40c23c78f678 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:52.281374 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0536a0f-d5c4-4361-a946-40c23c78f678 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:52.282265 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0536a0f-d5c4-4361-a946-40c23c78f678 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:52.284855 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0536a0f-d5c4-4361-a946-40c23c78f678 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:52.315269 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1358/2707] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:59:52 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:59:52.319325 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a36656-9ed6-4600-a507-0ec1f5a94635 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:52.329190 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a36656-9ed6-4600-a507-0ec1f5a94635 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:52.385752 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1555a-37e9-4cfd-8508-04878d32df76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:52.386421 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1555a-37e9-4cfd-8508-04878d32df76 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:52.386698 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1555a-37e9-4cfd-8508-04878d32df76 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:52.386967 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1555a-37e9-4cfd-8508-04878d32df76 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:52.387658 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd1555a-37e9-4cfd-8508-04878d32df76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:52.389633 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd1555a-37e9-4cfd-8508-04878d32df76 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:52.411609 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1350/2708] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:59:52 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:59:52.415899 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0536a0f-d5c4-4361-a946-40c23c78f678 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:52.426703 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0536a0f-d5c4-4361-a946-40c23c78f678 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:52.431980 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efb137-6f69-4443-bf01-46481917101f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:52.432644 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efb137-6f69-4443-bf01-46481917101f admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:52.433156 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efb137-6f69-4443-bf01-46481917101f admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:52.433447 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efb137-6f69-4443-bf01-46481917101f admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:52.434177 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efb137-6f69-4443-bf01-46481917101f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:52.435762 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efb137-6f69-4443-bf01-46481917101f admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:52.446703 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1359/2709] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:59:52.450810 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1555a-37e9-4cfd-8508-04878d32df76 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:52.462082 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1555a-37e9-4cfd-8508-04878d32df76 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:52.472145 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50ae7a-0dd6-4326-a057-ecc8ec2d7a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:52.472913 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50ae7a-0dd6-4326-a057-ecc8ec2d7a3f admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:52.473130 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50ae7a-0dd6-4326-a057-ecc8ec2d7a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:52.473430 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50ae7a-0dd6-4326-a057-ecc8ec2d7a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:52.474163 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50ae7a-0dd6-4326-a057-ecc8ec2d7a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:52.475744 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c50ae7a-0dd6-4326-a057-ecc8ec2d7a3f admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:52.487831 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1351/2710] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:59:52.499606 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efb137-6f69-4443-bf01-46481917101f admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:52.512101 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efb137-6f69-4443-bf01-46481917101f admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:52.518421 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc9c8b-e4bd-4034-9aca-a6966966158a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:52.519321 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc9c8b-e4bd-4034-9aca-a6966966158a admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:52.519601 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc9c8b-e4bd-4034-9aca-a6966966158a admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:52.519873 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc9c8b-e4bd-4034-9aca-a6966966158a admin admin] PATH_INFO: `/v3/projects/0048c056630a4bc39309d8005a4936c7/users/51e1af2f5401452d859b493a1006bbda/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:52.535609 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc9c8b-e4bd-4034-9aca-a6966966158a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0048c056630a4bc39309d8005a4936c7, user_id=51e1af2f5401452d859b493a1006bbda, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:52.553663 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc9c8b-e4bd-4034-9aca-a6966966158a admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:52.562395 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1360/2711] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:59:52 2022] PUT /identity/v3/projects/0048c056630a4bc39309d8005a4936c7/users/51e1af2f5401452d859b493a1006bbda/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:52.572872 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad25cf-681c-4dfd-b154-52c8830050c4 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:52.573163 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad25cf-681c-4dfd-b154-52c8830050c4 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:52.573476 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad25cf-681c-4dfd-b154-52c8830050c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:52.602173 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-a3ad25cf-681c-4dfd-b154-52c8830050c4 None None] MFA Rules not processed for user `51e1af2f5401452d859b493a1006bbda`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:52.603373 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-a3ad25cf-681c-4dfd-b154-52c8830050c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:52.668801 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1352/2712] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 13:59:52.681179 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc9c8b-e4bd-4034-9aca-a6966966158a admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:52.683271 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-d6dc9c8b-e4bd-4034-9aca-a6966966158a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:52.740109 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc9c8b-e4bd-4034-9aca-a6966966158a admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:52.744182 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db30ca5-2f27-41fc-aa0d-ea3e1714033f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '731b8e066deb49e6b48804cbbe5cd6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:52.744816 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db30ca5-2f27-41fc-aa0d-ea3e1714033f service glance] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:52.745089 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db30ca5-2f27-41fc-aa0d-ea3e1714033f service glance] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:52.745382 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db30ca5-2f27-41fc-aa0d-ea3e1714033f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:52.754054 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db30ca5-2f27-41fc-aa0d-ea3e1714033f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:52.755476 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db30ca5-2f27-41fc-aa0d-ea3e1714033f service glance] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:52.766358 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1361/2713] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:59:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:59:55.905401 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad25cf-681c-4dfd-b154-52c8830050c4 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:55.906882 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-a3ad25cf-681c-4dfd-b154-52c8830050c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:55.987624 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad25cf-681c-4dfd-b154-52c8830050c4 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:55.992355 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddffeb-723d-4622-be1f-efa4da8cc6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:55.993224 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddffeb-723d-4622-be1f-efa4da8cc6ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:55.993521 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddffeb-723d-4622-be1f-efa4da8cc6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:55.993786 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dddffeb-723d-4622-be1f-efa4da8cc6ca admin admin] PATH_INFO: `/v3/users/82cd8775fbc840608b86b6bb39153880` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:55.994977 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddffeb-723d-4622-be1f-efa4da8cc6ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=82cd8775fbc840608b86b6bb39153880)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:55.996869 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dddffeb-723d-4622-be1f-efa4da8cc6ca admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:56.049788 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-6dddffeb-723d-4622-be1f-efa4da8cc6ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82cd8775fbc840608b86b6bb39153880'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:56.050464 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-6dddffeb-723d-4622-be1f-efa4da8cc6ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82cd8775fbc840608b86b6bb39153880'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:56.060355 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-6dddffeb-723d-4622-be1f-efa4da8cc6ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82cd8775fbc840608b86b6bb39153880'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:56.073018 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-6dddffeb-723d-4622-be1f-efa4da8cc6ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82cd8775fbc840608b86b6bb39153880'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:56.079683 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-6dddffeb-723d-4622-be1f-efa4da8cc6ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82cd8775fbc840608b86b6bb39153880'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:56.085847 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1353/2714] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:59:55 2022] DELETE /identity/v3/users/82cd8775fbc840608b86b6bb39153880 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:56.091225 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7811d2-49fc-4b37-a198-27084a5ea622 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:56.091794 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7811d2-49fc-4b37-a198-27084a5ea622 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:56.091794 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7811d2-49fc-4b37-a198-27084a5ea622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:56.109209 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-2f7811d2-49fc-4b37-a198-27084a5ea622 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:56.110441 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-2f7811d2-49fc-4b37-a198-27084a5ea622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:56.170538 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1362/2715] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:56.181144 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddffeb-723d-4622-be1f-efa4da8cc6ca admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:56.182642 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-6dddffeb-723d-4622-be1f-efa4da8cc6ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:56.249275 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dddffeb-723d-4622-be1f-efa4da8cc6ca admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:56.253711 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699be94a-37e6-4766-a26e-5ce4b9bf717a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:56.254373 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699be94a-37e6-4766-a26e-5ce4b9bf717a service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:56.254649 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699be94a-37e6-4766-a26e-5ce4b9bf717a service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:56.254917 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699be94a-37e6-4766-a26e-5ce4b9bf717a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:56.265159 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699be94a-37e6-4766-a26e-5ce4b9bf717a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:56.266599 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699be94a-37e6-4766-a26e-5ce4b9bf717a service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:56.275989 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1354/2716] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:59:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 13:59:56.558036 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7811d2-49fc-4b37-a198-27084a5ea622 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:56.559567 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-2f7811d2-49fc-4b37-a198-27084a5ea622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:56.572351 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7811d2-49fc-4b37-a198-27084a5ea622 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:56.577739 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a4d36-4326-4778-93d1-a0bab3274b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:56.578633 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a4d36-4326-4778-93d1-a0bab3274b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:56.578904 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a4d36-4326-4778-93d1-a0bab3274b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:56.579178 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a4d36-4326-4778-93d1-a0bab3274b97 admin admin] PATH_INFO: `/v3/projects/764d3f95a6084e18a1ca9b0b7e8702c0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:56.580427 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a4d36-4326-4778-93d1-a0bab3274b97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=764d3f95a6084e18a1ca9b0b7e8702c0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:56.582480 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a4d36-4326-4778-93d1-a0bab3274b97 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:56.631089 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ba7a4d36-4326-4778-93d1-a0bab3274b97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '764d3f95a6084e18a1ca9b0b7e8702c0', 'request_id': 'req-ba7a4d36-4326-4778-93d1-a0bab3274b97'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:56.637611 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ba7a4d36-4326-4778-93d1-a0bab3274b97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '764d3f95a6084e18a1ca9b0b7e8702c0', 'request_id': 'req-ba7a4d36-4326-4778-93d1-a0bab3274b97'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:56.646645 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ba7a4d36-4326-4778-93d1-a0bab3274b97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '764d3f95a6084e18a1ca9b0b7e8702c0', 'request_id': 'req-ba7a4d36-4326-4778-93d1-a0bab3274b97'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:56.656684 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ba7a4d36-4326-4778-93d1-a0bab3274b97 admin admin] The token cache is being invalidate because project 764d3f95a6084e18a1ca9b0b7e8702c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:59:56.656964 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ba7a4d36-4326-4778-93d1-a0bab3274b97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:56.657834 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ba7a4d36-4326-4778-93d1-a0bab3274b97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:56.659733 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1363/2717] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:59:56 2022] DELETE /identity/v3/projects/764d3f95a6084e18a1ca9b0b7e8702c0 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:56.663608 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699be94a-37e6-4766-a26e-5ce4b9bf717a service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:56.673551 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699be94a-37e6-4766-a26e-5ce4b9bf717a service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:56.729650 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56873444-5877-4fac-93ae-d77021021a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:56.730516 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56873444-5877-4fac-93ae-d77021021a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:56.730788 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56873444-5877-4fac-93ae-d77021021a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:56.731058 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56873444-5877-4fac-93ae-d77021021a86 admin admin] PATH_INFO: `/v3/users/aca65bdcac3143518efef628afdbdfce` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:56.732243 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56873444-5877-4fac-93ae-d77021021a86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aca65bdcac3143518efef628afdbdfce)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:56.734219 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56873444-5877-4fac-93ae-d77021021a86 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:56.791619 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-56873444-5877-4fac-93ae-d77021021a86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aca65bdcac3143518efef628afdbdfce'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:56.792293 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-56873444-5877-4fac-93ae-d77021021a86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aca65bdcac3143518efef628afdbdfce'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:56.802931 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-56873444-5877-4fac-93ae-d77021021a86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aca65bdcac3143518efef628afdbdfce'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:56.816166 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-56873444-5877-4fac-93ae-d77021021a86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aca65bdcac3143518efef628afdbdfce'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:56.823318 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-56873444-5877-4fac-93ae-d77021021a86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aca65bdcac3143518efef628afdbdfce'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:56.829781 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1355/2718] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 13:59:56 2022] DELETE /identity/v3/users/aca65bdcac3143518efef628afdbdfce => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:57.111805 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a4d36-4326-4778-93d1-a0bab3274b97 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:57.113389 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-ba7a4d36-4326-4778-93d1-a0bab3274b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:57.129168 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a4d36-4326-4778-93d1-a0bab3274b97 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:57.187483 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f219c-0f2a-4817-ae8a-1642806c15ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:57.188255 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f219c-0f2a-4817-ae8a-1642806c15ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:57.188529 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f219c-0f2a-4817-ae8a-1642806c15ce admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:57.188810 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f219c-0f2a-4817-ae8a-1642806c15ce admin admin] PATH_INFO: `/v3/projects/affe2ca4e4da4cc4994a59e6a1532490` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:57.189989 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f219c-0f2a-4817-ae8a-1642806c15ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=affe2ca4e4da4cc4994a59e6a1532490)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:57.191894 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f219c-0f2a-4817-ae8a-1642806c15ce admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:57.255124 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-004f219c-0f2a-4817-ae8a-1642806c15ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'affe2ca4e4da4cc4994a59e6a1532490', 'request_id': 'req-004f219c-0f2a-4817-ae8a-1642806c15ce'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:57.263589 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-004f219c-0f2a-4817-ae8a-1642806c15ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'affe2ca4e4da4cc4994a59e6a1532490', 'request_id': 'req-004f219c-0f2a-4817-ae8a-1642806c15ce'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:57.273724 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-004f219c-0f2a-4817-ae8a-1642806c15ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'affe2ca4e4da4cc4994a59e6a1532490', 'request_id': 'req-004f219c-0f2a-4817-ae8a-1642806c15ce'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:57.285442 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-004f219c-0f2a-4817-ae8a-1642806c15ce admin admin] The token cache is being invalidate because project affe2ca4e4da4cc4994a59e6a1532490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 13:59:57.285709 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-004f219c-0f2a-4817-ae8a-1642806c15ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:57.286366 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-004f219c-0f2a-4817-ae8a-1642806c15ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 13:59:57.288059 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1364/2719] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 13:59:57 2022] DELETE /identity/v3/projects/affe2ca4e4da4cc4994a59e6a1532490 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:57.293225 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61a73b-afc7-4c9b-9aab-9a1b7410c163 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:57.293785 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61a73b-afc7-4c9b-9aab-9a1b7410c163 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:57.293785 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61a73b-afc7-4c9b-9aab-9a1b7410c163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:57.314972 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-1c61a73b-afc7-4c9b-9aab-9a1b7410c163 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:57.316189 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-1c61a73b-afc7-4c9b-9aab-9a1b7410c163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:57.381755 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1356/2720] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:57.389754 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e06283-a87e-42ee-a01e-12f92c3321e9 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:57.390158 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e06283-a87e-42ee-a01e-12f92c3321e9 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:57.390504 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e06283-a87e-42ee-a01e-12f92c3321e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:57.414597 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-74e06283-a87e-42ee-a01e-12f92c3321e9 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:57.415805 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-74e06283-a87e-42ee-a01e-12f92c3321e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:57.425385 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1365/2721] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:57.429874 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61a73b-afc7-4c9b-9aab-9a1b7410c163 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:57.439965 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61a73b-afc7-4c9b-9aab-9a1b7410c163 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:57.445590 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619554bf-568c-4597-9df3-eceb2043361e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:57.446246 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619554bf-568c-4597-9df3-eceb2043361e admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:57.446524 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619554bf-568c-4597-9df3-eceb2043361e admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:57.446786 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619554bf-568c-4597-9df3-eceb2043361e admin admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:57.447620 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619554bf-568c-4597-9df3-eceb2043361e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 13:59:57.447950 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619554bf-568c-4597-9df3-eceb2043361e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:57.449584 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619554bf-568c-4597-9df3-eceb2043361e admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:57.461667 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1357/2722] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 13:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 13:59:57.466483 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e06283-a87e-42ee-a01e-12f92c3321e9 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:57.476010 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e06283-a87e-42ee-a01e-12f92c3321e9 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:57.481232 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35bb12-41ce-4b1f-b89a-e5a990ba6cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:57.481930 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35bb12-41ce-4b1f-b89a-e5a990ba6cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:57.482335 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35bb12-41ce-4b1f-b89a-e5a990ba6cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:57.482687 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35bb12-41ce-4b1f-b89a-e5a990ba6cb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:57.483404 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35bb12-41ce-4b1f-b89a-e5a990ba6cb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:57.485316 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35bb12-41ce-4b1f-b89a-e5a990ba6cb6 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:57.515567 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1366/2723] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:59:57 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:59:57.520066 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619554bf-568c-4597-9df3-eceb2043361e admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:57.530741 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619554bf-568c-4597-9df3-eceb2043361e admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:57.586036 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eabb42-a446-4920-86b3-bce170152de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:57.586712 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eabb42-a446-4920-86b3-bce170152de4 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:57.586993 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eabb42-a446-4920-86b3-bce170152de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:57.587265 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eabb42-a446-4920-86b3-bce170152de4 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:57.587959 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eabb42-a446-4920-86b3-bce170152de4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:57.590298 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eabb42-a446-4920-86b3-bce170152de4 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:57.612711 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1358/2724] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:59:57 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:59:57.617000 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35bb12-41ce-4b1f-b89a-e5a990ba6cb6 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:57.627629 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35bb12-41ce-4b1f-b89a-e5a990ba6cb6 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:57.632516 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bbf84-2c55-4915-8e67-d686fb6e2849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:57.633176 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bbf84-2c55-4915-8e67-d686fb6e2849 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:57.633495 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bbf84-2c55-4915-8e67-d686fb6e2849 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:57.633770 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bbf84-2c55-4915-8e67-d686fb6e2849 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:57.634508 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7bbf84-2c55-4915-8e67-d686fb6e2849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:57.636126 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7bbf84-2c55-4915-8e67-d686fb6e2849 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:57.646770 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1367/2725] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:59:57.651912 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eabb42-a446-4920-86b3-bce170152de4 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:57.662224 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eabb42-a446-4920-86b3-bce170152de4 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:57.667139 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa299a2-5556-4273-a5fa-a00f605c30f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:57.667934 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa299a2-5556-4273-a5fa-a00f605c30f3 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:57.668212 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa299a2-5556-4273-a5fa-a00f605c30f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:57.668591 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa299a2-5556-4273-a5fa-a00f605c30f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:57.669385 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa299a2-5556-4273-a5fa-a00f605c30f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:57.671035 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa299a2-5556-4273-a5fa-a00f605c30f3 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:57.681110 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1359/2726] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:59:57.685495 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bbf84-2c55-4915-8e67-d686fb6e2849 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:57.696037 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bbf84-2c55-4915-8e67-d686fb6e2849 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:57.701069 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4da13a-1aac-4a40-8fc0-74e230a82644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:57.702013 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4da13a-1aac-4a40-8fc0-74e230a82644 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:57.702289 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4da13a-1aac-4a40-8fc0-74e230a82644 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:57.702789 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4da13a-1aac-4a40-8fc0-74e230a82644 admin admin] PATH_INFO: `/v3/projects/4affe3c6fb0f4dd181ca6574255abbab/users/40fe5546c24648858ffe123c4f64e50e/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:57.719688 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4da13a-1aac-4a40-8fc0-74e230a82644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4affe3c6fb0f4dd181ca6574255abbab, user_id=40fe5546c24648858ffe123c4f64e50e, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:57.722364 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4da13a-1aac-4a40-8fc0-74e230a82644 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:57.739494 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1368/2727] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:59:57 2022] PUT /identity/v3/projects/4affe3c6fb0f4dd181ca6574255abbab/users/40fe5546c24648858ffe123c4f64e50e/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:57.750380 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378df91c-b179-4285-a48e-34ab3627cad6 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:57.750776 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378df91c-b179-4285-a48e-34ab3627cad6 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:57.751250 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378df91c-b179-4285-a48e-34ab3627cad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:57.780540 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-378df91c-b179-4285-a48e-34ab3627cad6 None None] MFA Rules not processed for user `40fe5546c24648858ffe123c4f64e50e`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:57.781818 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-378df91c-b179-4285-a48e-34ab3627cad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:57.850726 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1360/2728] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:57.855374 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4da13a-1aac-4a40-8fc0-74e230a82644 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:57.922022 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4da13a-1aac-4a40-8fc0-74e230a82644 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:57.927201 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfb7de-d2ae-46f0-9408-accf89bbd381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:57.927854 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfb7de-d2ae-46f0-9408-accf89bbd381 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:57.928132 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfb7de-d2ae-46f0-9408-accf89bbd381 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:57.928448 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dfb7de-d2ae-46f0-9408-accf89bbd381 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:57.929249 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dfb7de-d2ae-46f0-9408-accf89bbd381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:57.931490 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dfb7de-d2ae-46f0-9408-accf89bbd381 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:57.960222 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1369/2729] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 13:59:57 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:59:57.964750 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378df91c-b179-4285-a48e-34ab3627cad6 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:57.975821 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378df91c-b179-4285-a48e-34ab3627cad6 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:58.035909 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77848b0a-4958-48dd-b948-16503e65fe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:58.036911 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77848b0a-4958-48dd-b948-16503e65fe72 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:58.037319 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77848b0a-4958-48dd-b948-16503e65fe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:58.037593 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77848b0a-4958-48dd-b948-16503e65fe72 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:58.038478 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77848b0a-4958-48dd-b948-16503e65fe72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:58.041111 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77848b0a-4958-48dd-b948-16503e65fe72 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:58.065961 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1361/2730] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 13:59:57 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 13:59:58.070143 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfb7de-d2ae-46f0-9408-accf89bbd381 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:58.082751 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dfb7de-d2ae-46f0-9408-accf89bbd381 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:58.088572 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfcd9c-d6a9-4fd0-bd08-945de8f574ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:58.089625 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfcd9c-d6a9-4fd0-bd08-945de8f574ee admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:58.089908 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfcd9c-d6a9-4fd0-bd08-945de8f574ee admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:58.090169 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cfcd9c-d6a9-4fd0-bd08-945de8f574ee admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:58.090891 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfcd9c-d6a9-4fd0-bd08-945de8f574ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:58.092497 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cfcd9c-d6a9-4fd0-bd08-945de8f574ee admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:58.102750 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1370/2731] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 13:59:58.107590 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77848b0a-4958-48dd-b948-16503e65fe72 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:58.118285 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77848b0a-4958-48dd-b948-16503e65fe72 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:58.124684 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118697a-9c48-4536-ad26-40d13f21ba6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:58.125605 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118697a-9c48-4536-ad26-40d13f21ba6d admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:58.125879 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118697a-9c48-4536-ad26-40d13f21ba6d admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:58.126151 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118697a-9c48-4536-ad26-40d13f21ba6d admin admin] PATH_INFO: `/v3/projects/cc2ecc411cef4676a9133327f45833e6/users/4928c00b7ed440409941dd7d143cfb08/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:58.142456 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118697a-9c48-4536-ad26-40d13f21ba6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2ecc411cef4676a9133327f45833e6, user_id=4928c00b7ed440409941dd7d143cfb08, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:58.145090 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0118697a-9c48-4536-ad26-40d13f21ba6d admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:58.160181 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1362/2732] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:59:58 2022] PUT /identity/v3/projects/cc2ecc411cef4676a9133327f45833e6/users/4928c00b7ed440409941dd7d143cfb08/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:58.164350 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfcd9c-d6a9-4fd0-bd08-945de8f574ee admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:58.175001 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cfcd9c-d6a9-4fd0-bd08-945de8f574ee admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:58.233239 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6399178-23b9-4f7e-9617-8bb4b797b009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:58.233849 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6399178-23b9-4f7e-9617-8bb4b797b009 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:58.234125 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6399178-23b9-4f7e-9617-8bb4b797b009 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:58.234395 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6399178-23b9-4f7e-9617-8bb4b797b009 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:58.235123 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6399178-23b9-4f7e-9617-8bb4b797b009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:58.236726 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6399178-23b9-4f7e-9617-8bb4b797b009 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:58.247382 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1371/2733] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 13:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 13:59:58.251862 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118697a-9c48-4536-ad26-40d13f21ba6d admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:58.262904 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118697a-9c48-4536-ad26-40d13f21ba6d admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:58.268648 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffacd6-a89d-41da-b21f-af946395b055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:58.269562 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffacd6-a89d-41da-b21f-af946395b055 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:58.269814 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffacd6-a89d-41da-b21f-af946395b055 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:58.270084 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffacd6-a89d-41da-b21f-af946395b055 admin admin] PATH_INFO: `/v3/projects/cc2ecc411cef4676a9133327f45833e6/users/4928c00b7ed440409941dd7d143cfb08/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:58.272345 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffacd6-a89d-41da-b21f-af946395b055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc2ecc411cef4676a9133327f45833e6, user_id=4928c00b7ed440409941dd7d143cfb08, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:58.274972 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffacd6-a89d-41da-b21f-af946395b055 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:58.286842 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1363/2734] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 13:59:58 2022] PUT /identity/v3/projects/cc2ecc411cef4676a9133327f45833e6/users/4928c00b7ed440409941dd7d143cfb08/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 13:59:58.298430 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667ac43-5606-4ec0-94bc-c6562c7a0691 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:58.298775 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667ac43-5606-4ec0-94bc-c6562c7a0691 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:58.299098 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6667ac43-5606-4ec0-94bc-c6562c7a0691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:58.326564 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-6667ac43-5606-4ec0-94bc-c6562c7a0691 None None] MFA Rules not processed for user `4928c00b7ed440409941dd7d143cfb08`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 13:59:58.327834 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-6667ac43-5606-4ec0-94bc-c6562c7a0691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:58.396700 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1372/2735] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 13:59:58 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 13:59:58.407908 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffacd6-a89d-41da-b21f-af946395b055 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 13:59:58.409883 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-eaffacd6-a89d-41da-b21f-af946395b055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 13:59:58.472828 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffacd6-a89d-41da-b21f-af946395b055 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 13:59:58.476619 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2eb47c-c778-4246-8c7c-84a44c776304 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 13:59:58.477272 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2eb47c-c778-4246-8c7c-84a44c776304 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 13:59:58.477575 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2eb47c-c778-4246-8c7c-84a44c776304 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 13:59:58.477851 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2eb47c-c778-4246-8c7c-84a44c776304 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 13:59:58.538169 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2eb47c-c778-4246-8c7c-84a44c776304 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 13:59:58.539611 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2eb47c-c778-4246-8c7c-84a44c776304 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 13:59:58.548620 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1364/2736] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 13:59:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:00:04.198534 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667ac43-5606-4ec0-94bc-c6562c7a0691 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:04.208670 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6667ac43-5606-4ec0-94bc-c6562c7a0691 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:04.212616 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18420faf-0dab-476b-8280-b13d5b4550c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:04.213169 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18420faf-0dab-476b-8280-b13d5b4550c8 service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:04.213458 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18420faf-0dab-476b-8280-b13d5b4550c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:04.213732 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18420faf-0dab-476b-8280-b13d5b4550c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:04.224298 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18420faf-0dab-476b-8280-b13d5b4550c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:04.225803 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18420faf-0dab-476b-8280-b13d5b4550c8 service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:04.235892 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1373/2737] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:00:04 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:00:13.450985 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2eb47c-c778-4246-8c7c-84a44c776304 service cinder] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:13.452509 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-ec2eb47c-c778-4246-8c7c-84a44c776304 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:13.524133 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2eb47c-c778-4246-8c7c-84a44c776304 service cinder] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:13.529538 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a14e3-9654-4762-9442-e78d6a8562ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2e8458589b45fa8c91b0d95840e45e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:13.530191 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a14e3-9654-4762-9442-e78d6a8562ea service placement] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:13.530480 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a14e3-9654-4762-9442-e78d6a8562ea service placement] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:13.530760 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a14e3-9654-4762-9442-e78d6a8562ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:13.532730 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-906a14e3-9654-4762-9442-e78d6a8562ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:13.545111 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a14e3-9654-4762-9442-e78d6a8562ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:13.546718 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a14e3-9654-4762-9442-e78d6a8562ea service placement] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:13.556786 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1365/2738] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:00:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:00:14.593745 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18420faf-0dab-476b-8280-b13d5b4550c8 service cinder] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:14.598190 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-18420faf-0dab-476b-8280-b13d5b4550c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:14.659033 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18420faf-0dab-476b-8280-b13d5b4550c8 service cinder] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:14.664075 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cc520-48c4-4584-945e-acbc9649155e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:14.665062 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cc520-48c4-4584-945e-acbc9649155e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:14.665342 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cc520-48c4-4584-945e-acbc9649155e admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:14.665633 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cc520-48c4-4584-945e-acbc9649155e admin admin] PATH_INFO: `/v3/users/51e1af2f5401452d859b493a1006bbda` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:14.666946 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cc520-48c4-4584-945e-acbc9649155e admin admin] RBAC: Authorizing `identity:delete_user(user_id=51e1af2f5401452d859b493a1006bbda)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:14.668843 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cc520-48c4-4584-945e-acbc9649155e admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:14.725033 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8e5cc520-48c4-4584-945e-acbc9649155e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51e1af2f5401452d859b493a1006bbda'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:14.725865 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8e5cc520-48c4-4584-945e-acbc9649155e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51e1af2f5401452d859b493a1006bbda'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:14.734956 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8e5cc520-48c4-4584-945e-acbc9649155e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51e1af2f5401452d859b493a1006bbda'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:14.741786 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8e5cc520-48c4-4584-945e-acbc9649155e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51e1af2f5401452d859b493a1006bbda'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:14.754793 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8e5cc520-48c4-4584-945e-acbc9649155e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51e1af2f5401452d859b493a1006bbda'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:14.760771 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1374/2739] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 14:00:14 2022] DELETE /identity/v3/users/51e1af2f5401452d859b493a1006bbda => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:00:14.765511 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfb124-adef-46da-83c2-798dd69942a0 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:14.765985 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfb124-adef-46da-83c2-798dd69942a0 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:14.766098 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfb124-adef-46da-83c2-798dd69942a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:14.783860 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-ecdfb124-adef-46da-83c2-798dd69942a0 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:00:14.785129 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-ecdfb124-adef-46da-83c2-798dd69942a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:14.857450 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1366/2740] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:00:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:00:14.867283 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cc520-48c4-4584-945e-acbc9649155e admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:14.868975 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-8e5cc520-48c4-4584-945e-acbc9649155e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:14.925708 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cc520-48c4-4584-945e-acbc9649155e admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:14.930225 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c14678-955d-4fb9-8f86-75bdde05947d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:14.930954 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c14678-955d-4fb9-8f86-75bdde05947d service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:14.931240 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c14678-955d-4fb9-8f86-75bdde05947d service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:14.931527 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c14678-955d-4fb9-8f86-75bdde05947d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:14.941981 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c14678-955d-4fb9-8f86-75bdde05947d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:14.943391 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c14678-955d-4fb9-8f86-75bdde05947d service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:14.953215 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1375/2741] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:00:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:00:15.231077 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfb124-adef-46da-83c2-798dd69942a0 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:15.232551 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-ecdfb124-adef-46da-83c2-798dd69942a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:15.246690 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfb124-adef-46da-83c2-798dd69942a0 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:15.252659 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361934e8-7dc3-47e8-ad9f-c48047f0a3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:15.253912 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361934e8-7dc3-47e8-ad9f-c48047f0a3c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:15.254284 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361934e8-7dc3-47e8-ad9f-c48047f0a3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:15.254459 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361934e8-7dc3-47e8-ad9f-c48047f0a3c6 admin admin] PATH_INFO: `/v3/projects/0048c056630a4bc39309d8005a4936c7` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:15.255745 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361934e8-7dc3-47e8-ad9f-c48047f0a3c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0048c056630a4bc39309d8005a4936c7)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:15.257762 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361934e8-7dc3-47e8-ad9f-c48047f0a3c6 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:15.304599 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-361934e8-7dc3-47e8-ad9f-c48047f0a3c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0048c056630a4bc39309d8005a4936c7', 'request_id': 'req-361934e8-7dc3-47e8-ad9f-c48047f0a3c6'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:15.310549 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-361934e8-7dc3-47e8-ad9f-c48047f0a3c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0048c056630a4bc39309d8005a4936c7', 'request_id': 'req-361934e8-7dc3-47e8-ad9f-c48047f0a3c6'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:15.320010 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-361934e8-7dc3-47e8-ad9f-c48047f0a3c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0048c056630a4bc39309d8005a4936c7', 'request_id': 'req-361934e8-7dc3-47e8-ad9f-c48047f0a3c6'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:15.329905 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-361934e8-7dc3-47e8-ad9f-c48047f0a3c6 admin admin] The token cache is being invalidate because project 0048c056630a4bc39309d8005a4936c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:00:15.330180 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-361934e8-7dc3-47e8-ad9f-c48047f0a3c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:15.330797 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-361934e8-7dc3-47e8-ad9f-c48047f0a3c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:15.332297 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1367/2742] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 14:00:15 2022] DELETE /identity/v3/projects/0048c056630a4bc39309d8005a4936c7 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:00:15.337320 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e19f17-77ea-43d2-ae1b-fffc1b881785 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:15.337653 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e19f17-77ea-43d2-ae1b-fffc1b881785 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:15.337928 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e19f17-77ea-43d2-ae1b-fffc1b881785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:15.355838 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-08e19f17-77ea-43d2-ae1b-fffc1b881785 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:00:15.357023 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-08e19f17-77ea-43d2-ae1b-fffc1b881785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:15.414348 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1376/2743] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:00:15.422518 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b82e2-ffeb-4516-a6cf-7ea5d3efe80e None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:15.422808 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b82e2-ffeb-4516-a6cf-7ea5d3efe80e None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:15.423076 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b82e2-ffeb-4516-a6cf-7ea5d3efe80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:15.441063 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-eb8b82e2-ffeb-4516-a6cf-7ea5d3efe80e None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:00:15.442545 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-eb8b82e2-ffeb-4516-a6cf-7ea5d3efe80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:15.451044 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1368/2744] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:00:15.456200 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e19f17-77ea-43d2-ae1b-fffc1b881785 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:15.470500 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e19f17-77ea-43d2-ae1b-fffc1b881785 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:15.478036 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6bec5-1ade-4a96-9b51-8b48923d5657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:15.478867 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6bec5-1ade-4a96-9b51-8b48923d5657 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:15.479139 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6bec5-1ade-4a96-9b51-8b48923d5657 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:15.479588 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6bec5-1ade-4a96-9b51-8b48923d5657 admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:15.480680 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6bec5-1ade-4a96-9b51-8b48923d5657 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:00:15.481099 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6bec5-1ade-4a96-9b51-8b48923d5657 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:15.489211 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6bec5-1ade-4a96-9b51-8b48923d5657 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:15.503875 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1377/2745] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 14:00:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:00:15.507430 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b82e2-ffeb-4516-a6cf-7ea5d3efe80e None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:15.516672 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b82e2-ffeb-4516-a6cf-7ea5d3efe80e None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:15.521528 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e0012-526b-42dc-845c-13d9a616d82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:15.522172 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e0012-526b-42dc-845c-13d9a616d82d admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:15.522450 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e0012-526b-42dc-845c-13d9a616d82d admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:15.522715 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e0012-526b-42dc-845c-13d9a616d82d admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:15.523414 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e0012-526b-42dc-845c-13d9a616d82d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:15.525387 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e0012-526b-42dc-845c-13d9a616d82d admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:15.552523 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1369/2746] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 14:00:15 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:00:15.557325 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6bec5-1ade-4a96-9b51-8b48923d5657 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:15.567766 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6bec5-1ade-4a96-9b51-8b48923d5657 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:15.623085 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e15411-09bb-4d47-a84f-f322c767ffc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:15.623729 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e15411-09bb-4d47-a84f-f322c767ffc4 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:15.624128 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e15411-09bb-4d47-a84f-f322c767ffc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:15.624364 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e15411-09bb-4d47-a84f-f322c767ffc4 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:15.625057 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e15411-09bb-4d47-a84f-f322c767ffc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:15.627024 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e15411-09bb-4d47-a84f-f322c767ffc4 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:15.648801 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1378/2747] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 14:00:15 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:00:15.652900 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e0012-526b-42dc-845c-13d9a616d82d admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:15.662812 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e0012-526b-42dc-845c-13d9a616d82d admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:15.667332 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5240087-3b0d-4f0f-9b07-59ccc293356b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:15.668173 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5240087-3b0d-4f0f-9b07-59ccc293356b admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:15.668287 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5240087-3b0d-4f0f-9b07-59ccc293356b admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:15.668505 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5240087-3b0d-4f0f-9b07-59ccc293356b admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:15.669229 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5240087-3b0d-4f0f-9b07-59ccc293356b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:15.670822 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5240087-3b0d-4f0f-9b07-59ccc293356b admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:15.681239 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1370/2748] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 14:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:00:15.685283 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e15411-09bb-4d47-a84f-f322c767ffc4 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:15.696079 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e15411-09bb-4d47-a84f-f322c767ffc4 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:15.700876 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58539f86-dee4-4c23-bb0e-5cc80feb2808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:15.701739 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58539f86-dee4-4c23-bb0e-5cc80feb2808 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:15.701908 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58539f86-dee4-4c23-bb0e-5cc80feb2808 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:15.702196 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58539f86-dee4-4c23-bb0e-5cc80feb2808 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:15.702912 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58539f86-dee4-4c23-bb0e-5cc80feb2808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:15.704515 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58539f86-dee4-4c23-bb0e-5cc80feb2808 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:15.717256 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1379/2749] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 14:00:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:00:15.722135 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5240087-3b0d-4f0f-9b07-59ccc293356b admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:15.732163 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5240087-3b0d-4f0f-9b07-59ccc293356b admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:15.737038 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b21b0-54df-4695-904c-75c19cc779a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:15.737950 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b21b0-54df-4695-904c-75c19cc779a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:15.738232 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b21b0-54df-4695-904c-75c19cc779a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:15.738502 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b21b0-54df-4695-904c-75c19cc779a4 admin admin] PATH_INFO: `/v3/projects/a0e0c474fb014176a574e135f794af15/users/f650ec2443b7495284483e96b14c624e/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:15.752816 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b21b0-54df-4695-904c-75c19cc779a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e0c474fb014176a574e135f794af15, user_id=f650ec2443b7495284483e96b14c624e, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:15.755443 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b21b0-54df-4695-904c-75c19cc779a4 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:15.770755 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1371/2750] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 14:00:15 2022] PUT /identity/v3/projects/a0e0c474fb014176a574e135f794af15/users/f650ec2443b7495284483e96b14c624e/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:00:15.782417 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8cbcf-6eee-40b2-a5e4-f6955ddd7fde None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:15.782710 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8cbcf-6eee-40b2-a5e4-f6955ddd7fde None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:15.782992 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb8cbcf-6eee-40b2-a5e4-f6955ddd7fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:15.811851 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-6bb8cbcf-6eee-40b2-a5e4-f6955ddd7fde None None] MFA Rules not processed for user `f650ec2443b7495284483e96b14c624e`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:00:15.812997 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-6bb8cbcf-6eee-40b2-a5e4-f6955ddd7fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:15.885949 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1380/2751] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:00:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:00:15.890895 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b21b0-54df-4695-904c-75c19cc779a4 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:15.960794 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b21b0-54df-4695-904c-75c19cc779a4 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:15.967220 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801d685-a141-4ef7-9bf3-c6231aca4ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:15.967873 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801d685-a141-4ef7-9bf3-c6231aca4ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:15.968154 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801d685-a141-4ef7-9bf3-c6231aca4ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:15.968429 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801d685-a141-4ef7-9bf3-c6231aca4ce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:15.969115 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801d685-a141-4ef7-9bf3-c6231aca4ce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:15.971036 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801d685-a141-4ef7-9bf3-c6231aca4ce8 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:16.001753 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1372/2752] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 14:00:15 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:00:16.006914 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8cbcf-6eee-40b2-a5e4-f6955ddd7fde None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:16.018942 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb8cbcf-6eee-40b2-a5e4-f6955ddd7fde None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:16.075886 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6caf20-1599-44a2-a097-93b87974bfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:16.076475 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6caf20-1599-44a2-a097-93b87974bfda admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:16.076755 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6caf20-1599-44a2-a097-93b87974bfda admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:16.077000 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6caf20-1599-44a2-a097-93b87974bfda admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:16.077724 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6caf20-1599-44a2-a097-93b87974bfda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:16.079627 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6caf20-1599-44a2-a097-93b87974bfda admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:16.103196 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1381/2753] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 14:00:16 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:00:16.107269 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801d685-a141-4ef7-9bf3-c6231aca4ce8 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:16.118056 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801d685-a141-4ef7-9bf3-c6231aca4ce8 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:16.123008 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39617a7-853d-4074-a99f-8e51aa1c2819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:16.123654 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39617a7-853d-4074-a99f-8e51aa1c2819 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:16.123929 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39617a7-853d-4074-a99f-8e51aa1c2819 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:16.124325 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39617a7-853d-4074-a99f-8e51aa1c2819 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:16.125060 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39617a7-853d-4074-a99f-8e51aa1c2819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:16.126653 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39617a7-853d-4074-a99f-8e51aa1c2819 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:16.137226 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1373/2754] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 14:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:00:16.141140 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6caf20-1599-44a2-a097-93b87974bfda admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:16.151802 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6caf20-1599-44a2-a097-93b87974bfda admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:16.157661 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bedb64-daf4-4d9e-8418-184fcd63f8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:16.158310 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bedb64-daf4-4d9e-8418-184fcd63f8ab admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:16.158590 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bedb64-daf4-4d9e-8418-184fcd63f8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:16.158862 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bedb64-daf4-4d9e-8418-184fcd63f8ab admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:16.159582 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bedb64-daf4-4d9e-8418-184fcd63f8ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:16.161170 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bedb64-daf4-4d9e-8418-184fcd63f8ab admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:16.171876 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1382/2755] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 14:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:00:16.176650 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39617a7-853d-4074-a99f-8e51aa1c2819 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:16.189126 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39617a7-853d-4074-a99f-8e51aa1c2819 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:16.195589 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdc19e-a93e-4dca-b330-5fdae873223e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:16.196462 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdc19e-a93e-4dca-b330-5fdae873223e admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:16.196739 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdc19e-a93e-4dca-b330-5fdae873223e admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:16.197011 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdc19e-a93e-4dca-b330-5fdae873223e admin admin] PATH_INFO: `/v3/projects/f915370bbc7c4d64ac0f0a8a95ecb64e/users/4692724640ea4f48900ead6657cc8418/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:16.213272 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebdc19e-a93e-4dca-b330-5fdae873223e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f915370bbc7c4d64ac0f0a8a95ecb64e, user_id=4692724640ea4f48900ead6657cc8418, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:16.216354 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebdc19e-a93e-4dca-b330-5fdae873223e admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:16.232163 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1374/2756] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 14:00:16 2022] PUT /identity/v3/projects/f915370bbc7c4d64ac0f0a8a95ecb64e/users/4692724640ea4f48900ead6657cc8418/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:00:16.242582 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed8290-3002-46c6-99d7-80fec9bdc6fc None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:16.242869 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed8290-3002-46c6-99d7-80fec9bdc6fc None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:16.243183 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed8290-3002-46c6-99d7-80fec9bdc6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:16.270551 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-09ed8290-3002-46c6-99d7-80fec9bdc6fc None None] MFA Rules not processed for user `4692724640ea4f48900ead6657cc8418`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:00:16.271741 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-09ed8290-3002-46c6-99d7-80fec9bdc6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:16.340584 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1383/2757] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:00:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:00:16.347191 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdc19e-a93e-4dca-b330-5fdae873223e admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:16.423843 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdc19e-a93e-4dca-b330-5fdae873223e admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:16.431680 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0434f5e-e572-4f87-b7a2-16b502f53a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:16.432334 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0434f5e-e572-4f87-b7a2-16b502f53a0b admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:16.432613 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0434f5e-e572-4f87-b7a2-16b502f53a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:16.432880 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0434f5e-e572-4f87-b7a2-16b502f53a0b admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:16.433628 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0434f5e-e572-4f87-b7a2-16b502f53a0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:16.435554 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0434f5e-e572-4f87-b7a2-16b502f53a0b admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:16.464274 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1375/2758] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 14:00:16 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:00:16.468730 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed8290-3002-46c6-99d7-80fec9bdc6fc None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:16.479743 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed8290-3002-46c6-99d7-80fec9bdc6fc None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:16.537523 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac5edc-a28c-40d4-95c3-88571f3d0d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:16.538192 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac5edc-a28c-40d4-95c3-88571f3d0d1b admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:16.538494 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac5edc-a28c-40d4-95c3-88571f3d0d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:16.538745 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac5edc-a28c-40d4-95c3-88571f3d0d1b admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:16.539411 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac5edc-a28c-40d4-95c3-88571f3d0d1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:16.541342 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac5edc-a28c-40d4-95c3-88571f3d0d1b admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:16.564842 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1384/2759] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 14:00:16 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:00:16.568956 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0434f5e-e572-4f87-b7a2-16b502f53a0b admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:16.579558 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0434f5e-e572-4f87-b7a2-16b502f53a0b admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:16.584379 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8fe33-35d9-4c98-a563-427117d0857e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:16.585018 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8fe33-35d9-4c98-a563-427117d0857e admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:16.585296 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8fe33-35d9-4c98-a563-427117d0857e admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:16.585599 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8fe33-35d9-4c98-a563-427117d0857e admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:16.586319 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8fe33-35d9-4c98-a563-427117d0857e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:16.587920 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8fe33-35d9-4c98-a563-427117d0857e admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:16.599014 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1376/2760] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 14:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:00:16.603222 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac5edc-a28c-40d4-95c3-88571f3d0d1b admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:16.613435 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac5edc-a28c-40d4-95c3-88571f3d0d1b admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:16.618709 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9812d0-2862-4f3c-b60c-c1833bbf9b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:16.619634 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9812d0-2862-4f3c-b60c-c1833bbf9b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:16.619909 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9812d0-2862-4f3c-b60c-c1833bbf9b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:16.620177 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9812d0-2862-4f3c-b60c-c1833bbf9b5b admin admin] PATH_INFO: `/v3/projects/1bce074593b4440f9436d49d90352050/users/89043568fc90421684d7c74d55741fd6/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:16.634753 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9812d0-2862-4f3c-b60c-c1833bbf9b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bce074593b4440f9436d49d90352050, user_id=89043568fc90421684d7c74d55741fd6, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:16.637396 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9812d0-2862-4f3c-b60c-c1833bbf9b5b admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:16.653748 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1385/2761] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 14:00:16 2022] PUT /identity/v3/projects/1bce074593b4440f9436d49d90352050/users/89043568fc90421684d7c74d55741fd6/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:00:16.657805 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8fe33-35d9-4c98-a563-427117d0857e admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:16.668068 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8fe33-35d9-4c98-a563-427117d0857e admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:16.727258 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7810a8-bab9-4dfa-8d3e-55c3273e4a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:16.727982 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7810a8-bab9-4dfa-8d3e-55c3273e4a8f admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:16.728258 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7810a8-bab9-4dfa-8d3e-55c3273e4a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:16.728521 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7810a8-bab9-4dfa-8d3e-55c3273e4a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:16.729217 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7810a8-bab9-4dfa-8d3e-55c3273e4a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:16.730809 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7810a8-bab9-4dfa-8d3e-55c3273e4a8f admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:16.740402 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1377/2762] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 14:00:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:00:16.745213 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9812d0-2862-4f3c-b60c-c1833bbf9b5b admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:16.759841 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9812d0-2862-4f3c-b60c-c1833bbf9b5b admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:16.766008 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155728f3-d22d-4626-b418-2ff8a208e448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:16.766888 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155728f3-d22d-4626-b418-2ff8a208e448 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:16.767178 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155728f3-d22d-4626-b418-2ff8a208e448 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:16.767427 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155728f3-d22d-4626-b418-2ff8a208e448 admin admin] PATH_INFO: `/v3/projects/1bce074593b4440f9436d49d90352050/users/89043568fc90421684d7c74d55741fd6/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:16.769685 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155728f3-d22d-4626-b418-2ff8a208e448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bce074593b4440f9436d49d90352050, user_id=89043568fc90421684d7c74d55741fd6, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:16.772286 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155728f3-d22d-4626-b418-2ff8a208e448 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:16.783192 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1386/2763] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 14:00:16 2022] PUT /identity/v3/projects/1bce074593b4440f9436d49d90352050/users/89043568fc90421684d7c74d55741fd6/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:00:16.796007 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8eac7f-3a04-4288-8e7c-5487c9954cc2 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:16.796523 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8eac7f-3a04-4288-8e7c-5487c9954cc2 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:16.796523 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8eac7f-3a04-4288-8e7c-5487c9954cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:16.825997 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-cd8eac7f-3a04-4288-8e7c-5487c9954cc2 None None] MFA Rules not processed for user `89043568fc90421684d7c74d55741fd6`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:00:16.827211 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-cd8eac7f-3a04-4288-8e7c-5487c9954cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:16.896553 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1378/2764] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:00:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:00:16.908054 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155728f3-d22d-4626-b418-2ff8a208e448 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:16.910036 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-155728f3-d22d-4626-b418-2ff8a208e448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:16.965707 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155728f3-d22d-4626-b418-2ff8a208e448 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:16.969882 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076044eb-fa38-4e9c-82dd-3fd9bd0c9d82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:16.970508 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076044eb-fa38-4e9c-82dd-3fd9bd0c9d82 service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:16.970774 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076044eb-fa38-4e9c-82dd-3fd9bd0c9d82 service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:16.971050 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076044eb-fa38-4e9c-82dd-3fd9bd0c9d82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:17.028160 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076044eb-fa38-4e9c-82dd-3fd9bd0c9d82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:17.029638 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076044eb-fa38-4e9c-82dd-3fd9bd0c9d82 service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:17.039040 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1387/2765] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:00:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:00:19.614880 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8eac7f-3a04-4288-8e7c-5487c9954cc2 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:19.628772 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8eac7f-3a04-4288-8e7c-5487c9954cc2 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:19.633265 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bbe98-7a5c-4489-8593-acb40f4848d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:19.633941 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bbe98-7a5c-4489-8593-acb40f4848d1 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:19.634220 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bbe98-7a5c-4489-8593-acb40f4848d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:19.634604 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bbe98-7a5c-4489-8593-acb40f4848d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:19.691934 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701bbe98-7a5c-4489-8593-acb40f4848d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:19.693346 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701bbe98-7a5c-4489-8593-acb40f4848d1 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:19.702456 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1379/2766] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:00:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:00:20.220878 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076044eb-fa38-4e9c-82dd-3fd9bd0c9d82 service cinder] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:20.230066 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076044eb-fa38-4e9c-82dd-3fd9bd0c9d82 service cinder] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:20.233738 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46582f6-2a88-4afc-9136-03ac2c72287c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:20.234378 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46582f6-2a88-4afc-9136-03ac2c72287c service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:20.234651 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46582f6-2a88-4afc-9136-03ac2c72287c service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:20.234920 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46582f6-2a88-4afc-9136-03ac2c72287c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:20.245199 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46582f6-2a88-4afc-9136-03ac2c72287c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:20.246747 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46582f6-2a88-4afc-9136-03ac2c72287c service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:20.257241 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1388/2767] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:00:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:00:25.187725 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bbe98-7a5c-4489-8593-acb40f4848d1 service cinder] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:25.252144 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701bbe98-7a5c-4489-8593-acb40f4848d1 service cinder] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:25.259341 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ce847-abff-40b8-870e-3bd8e266bd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:25.260590 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ce847-abff-40b8-870e-3bd8e266bd83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:25.260973 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ce847-abff-40b8-870e-3bd8e266bd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:25.261465 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ce847-abff-40b8-870e-3bd8e266bd83 admin admin] PATH_INFO: `/v3/users/f650ec2443b7495284483e96b14c624e` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:25.263197 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ce847-abff-40b8-870e-3bd8e266bd83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f650ec2443b7495284483e96b14c624e)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:25.265226 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ce847-abff-40b8-870e-3bd8e266bd83 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:25.312798 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-f46ce847-abff-40b8-870e-3bd8e266bd83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f650ec2443b7495284483e96b14c624e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:25.313568 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-f46ce847-abff-40b8-870e-3bd8e266bd83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f650ec2443b7495284483e96b14c624e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:25.323316 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-f46ce847-abff-40b8-870e-3bd8e266bd83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f650ec2443b7495284483e96b14c624e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:25.335490 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-f46ce847-abff-40b8-870e-3bd8e266bd83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f650ec2443b7495284483e96b14c624e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:25.342945 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-f46ce847-abff-40b8-870e-3bd8e266bd83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f650ec2443b7495284483e96b14c624e'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:25.349041 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1380/2768] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 14:00:25 2022] DELETE /identity/v3/users/f650ec2443b7495284483e96b14c624e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:00:25.353767 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b617ed-2c9f-4fa0-a6a9-56501480715b None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:25.354275 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b617ed-2c9f-4fa0-a6a9-56501480715b None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:25.354275 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b617ed-2c9f-4fa0-a6a9-56501480715b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:25.371441 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-38b617ed-2c9f-4fa0-a6a9-56501480715b None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:00:25.372676 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-38b617ed-2c9f-4fa0-a6a9-56501480715b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:25.435422 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1389/2769] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:00:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:00:25.445300 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ce847-abff-40b8-870e-3bd8e266bd83 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:25.446882 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-f46ce847-abff-40b8-870e-3bd8e266bd83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:25.504898 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ce847-abff-40b8-870e-3bd8e266bd83 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:25.509306 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4dcbc-7298-4919-8177-46523faad474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:25.509953 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4dcbc-7298-4919-8177-46523faad474 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:25.510227 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4dcbc-7298-4919-8177-46523faad474 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:25.510497 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4dcbc-7298-4919-8177-46523faad474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:25.524689 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4dcbc-7298-4919-8177-46523faad474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:25.526824 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4dcbc-7298-4919-8177-46523faad474 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:25.537529 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1381/2770] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:00:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:00:25.814801 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b617ed-2c9f-4fa0-a6a9-56501480715b None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:25.816363 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-38b617ed-2c9f-4fa0-a6a9-56501480715b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:25.828684 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b617ed-2c9f-4fa0-a6a9-56501480715b None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:25.833772 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e7867-9705-4a56-863b-d0d843928bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:25.834649 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e7867-9705-4a56-863b-d0d843928bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:25.834976 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e7867-9705-4a56-863b-d0d843928bde admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:25.835251 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e7867-9705-4a56-863b-d0d843928bde admin admin] PATH_INFO: `/v3/projects/a0e0c474fb014176a574e135f794af15` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:25.837131 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e7867-9705-4a56-863b-d0d843928bde admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0e0c474fb014176a574e135f794af15)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:25.839409 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e7867-9705-4a56-863b-d0d843928bde admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:25.888904 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-3d4e7867-9705-4a56-863b-d0d843928bde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0e0c474fb014176a574e135f794af15', 'request_id': 'req-3d4e7867-9705-4a56-863b-d0d843928bde'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:25.895071 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-3d4e7867-9705-4a56-863b-d0d843928bde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0e0c474fb014176a574e135f794af15', 'request_id': 'req-3d4e7867-9705-4a56-863b-d0d843928bde'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:25.904436 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-3d4e7867-9705-4a56-863b-d0d843928bde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0e0c474fb014176a574e135f794af15', 'request_id': 'req-3d4e7867-9705-4a56-863b-d0d843928bde'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:25.914890 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-3d4e7867-9705-4a56-863b-d0d843928bde admin admin] The token cache is being invalidate because project a0e0c474fb014176a574e135f794af15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:00:25.915170 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-3d4e7867-9705-4a56-863b-d0d843928bde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:25.915822 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-3d4e7867-9705-4a56-863b-d0d843928bde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:25.917393 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1390/2771] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 14:00:25 2022] DELETE /identity/v3/projects/a0e0c474fb014176a574e135f794af15 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:00:25.921466 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4dcbc-7298-4919-8177-46523faad474 service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:25.931355 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4dcbc-7298-4919-8177-46523faad474 service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:25.990625 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ad9b2-95c2-4850-85c4-89636af2ad13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:25.991505 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ad9b2-95c2-4850-85c4-89636af2ad13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:25.991785 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ad9b2-95c2-4850-85c4-89636af2ad13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:25.992058 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ad9b2-95c2-4850-85c4-89636af2ad13 admin admin] PATH_INFO: `/v3/users/4692724640ea4f48900ead6657cc8418` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:25.993345 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ad9b2-95c2-4850-85c4-89636af2ad13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4692724640ea4f48900ead6657cc8418)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:25.995283 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ad9b2-95c2-4850-85c4-89636af2ad13 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:26.050582 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-264ad9b2-95c2-4850-85c4-89636af2ad13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4692724640ea4f48900ead6657cc8418'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:26.051309 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-264ad9b2-95c2-4850-85c4-89636af2ad13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4692724640ea4f48900ead6657cc8418'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:26.061391 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-264ad9b2-95c2-4850-85c4-89636af2ad13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4692724640ea4f48900ead6657cc8418'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:26.073916 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-264ad9b2-95c2-4850-85c4-89636af2ad13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4692724640ea4f48900ead6657cc8418'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:26.080666 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-264ad9b2-95c2-4850-85c4-89636af2ad13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4692724640ea4f48900ead6657cc8418'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:26.086893 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1382/2772] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 14:00:25 2022] DELETE /identity/v3/users/4692724640ea4f48900ead6657cc8418 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:00:26.361983 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e7867-9705-4a56-863b-d0d843928bde admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:26.363533 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-3d4e7867-9705-4a56-863b-d0d843928bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:26.387999 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e7867-9705-4a56-863b-d0d843928bde admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:26.454776 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d0eca-38e7-42e5-a7c5-dd7cabdfd33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:26.455667 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d0eca-38e7-42e5-a7c5-dd7cabdfd33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:26.455944 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d0eca-38e7-42e5-a7c5-dd7cabdfd33e admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:26.456218 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d0eca-38e7-42e5-a7c5-dd7cabdfd33e admin admin] PATH_INFO: `/v3/projects/f915370bbc7c4d64ac0f0a8a95ecb64e` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:26.457395 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d0eca-38e7-42e5-a7c5-dd7cabdfd33e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f915370bbc7c4d64ac0f0a8a95ecb64e)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:26.459323 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d0eca-38e7-42e5-a7c5-dd7cabdfd33e admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:26.506423 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-976d0eca-38e7-42e5-a7c5-dd7cabdfd33e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f915370bbc7c4d64ac0f0a8a95ecb64e', 'request_id': 'req-976d0eca-38e7-42e5-a7c5-dd7cabdfd33e'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:26.512980 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-976d0eca-38e7-42e5-a7c5-dd7cabdfd33e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f915370bbc7c4d64ac0f0a8a95ecb64e', 'request_id': 'req-976d0eca-38e7-42e5-a7c5-dd7cabdfd33e'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:26.521820 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-976d0eca-38e7-42e5-a7c5-dd7cabdfd33e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f915370bbc7c4d64ac0f0a8a95ecb64e', 'request_id': 'req-976d0eca-38e7-42e5-a7c5-dd7cabdfd33e'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:26.531954 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-976d0eca-38e7-42e5-a7c5-dd7cabdfd33e admin admin] The token cache is being invalidate because project f915370bbc7c4d64ac0f0a8a95ecb64e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:00:26.532233 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-976d0eca-38e7-42e5-a7c5-dd7cabdfd33e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:26.532841 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-976d0eca-38e7-42e5-a7c5-dd7cabdfd33e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:26.534389 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1391/2773] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 14:00:26 2022] DELETE /identity/v3/projects/f915370bbc7c4d64ac0f0a8a95ecb64e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:00:26.538419 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ad9b2-95c2-4850-85c4-89636af2ad13 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:26.539835 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-264ad9b2-95c2-4850-85c4-89636af2ad13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:26.552713 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ad9b2-95c2-4850-85c4-89636af2ad13 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:26.610059 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c952d2f-58dc-42c3-b164-a2fcdbb389f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:26.610870 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c952d2f-58dc-42c3-b164-a2fcdbb389f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:26.611128 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c952d2f-58dc-42c3-b164-a2fcdbb389f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:26.611399 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c952d2f-58dc-42c3-b164-a2fcdbb389f5 admin admin] PATH_INFO: `/v3/users/89043568fc90421684d7c74d55741fd6` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:26.612644 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c952d2f-58dc-42c3-b164-a2fcdbb389f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89043568fc90421684d7c74d55741fd6)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:26.614557 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c952d2f-58dc-42c3-b164-a2fcdbb389f5 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:26.660034 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-4c952d2f-58dc-42c3-b164-a2fcdbb389f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89043568fc90421684d7c74d55741fd6'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:26.660680 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-4c952d2f-58dc-42c3-b164-a2fcdbb389f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89043568fc90421684d7c74d55741fd6'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:26.669581 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-4c952d2f-58dc-42c3-b164-a2fcdbb389f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89043568fc90421684d7c74d55741fd6'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:26.681552 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-4c952d2f-58dc-42c3-b164-a2fcdbb389f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89043568fc90421684d7c74d55741fd6'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:26.688393 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-4c952d2f-58dc-42c3-b164-a2fcdbb389f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89043568fc90421684d7c74d55741fd6'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:26.694180 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1383/2774] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 14:00:26 2022] DELETE /identity/v3/users/89043568fc90421684d7c74d55741fd6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:00:26.963262 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d0eca-38e7-42e5-a7c5-dd7cabdfd33e admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:26.964780 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-976d0eca-38e7-42e5-a7c5-dd7cabdfd33e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:26.978772 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d0eca-38e7-42e5-a7c5-dd7cabdfd33e admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:27.035955 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b316273-4afa-4f0e-9caa-526b1f7a4cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:27.036818 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b316273-4afa-4f0e-9caa-526b1f7a4cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:27.037096 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b316273-4afa-4f0e-9caa-526b1f7a4cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:27.037376 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b316273-4afa-4f0e-9caa-526b1f7a4cbf admin admin] PATH_INFO: `/v3/projects/1bce074593b4440f9436d49d90352050` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:27.038722 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b316273-4afa-4f0e-9caa-526b1f7a4cbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bce074593b4440f9436d49d90352050)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:27.040620 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b316273-4afa-4f0e-9caa-526b1f7a4cbf admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:27.092775 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-9b316273-4afa-4f0e-9caa-526b1f7a4cbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bce074593b4440f9436d49d90352050', 'request_id': 'req-9b316273-4afa-4f0e-9caa-526b1f7a4cbf'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:27.098742 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-9b316273-4afa-4f0e-9caa-526b1f7a4cbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bce074593b4440f9436d49d90352050', 'request_id': 'req-9b316273-4afa-4f0e-9caa-526b1f7a4cbf'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:27.107538 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-9b316273-4afa-4f0e-9caa-526b1f7a4cbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bce074593b4440f9436d49d90352050', 'request_id': 'req-9b316273-4afa-4f0e-9caa-526b1f7a4cbf'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:27.117792 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-9b316273-4afa-4f0e-9caa-526b1f7a4cbf admin admin] The token cache is being invalidate because project 1bce074593b4440f9436d49d90352050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:00:27.118073 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-9b316273-4afa-4f0e-9caa-526b1f7a4cbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:27.118702 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-9b316273-4afa-4f0e-9caa-526b1f7a4cbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:27.120255 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1392/2775] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 14:00:26 2022] DELETE /identity/v3/projects/1bce074593b4440f9436d49d90352050 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:00:27.125373 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6364aa0-7ffe-47f8-9213-80a13e42fb18 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:27.125832 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6364aa0-7ffe-47f8-9213-80a13e42fb18 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:27.126113 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6364aa0-7ffe-47f8-9213-80a13e42fb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:27.144321 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-b6364aa0-7ffe-47f8-9213-80a13e42fb18 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:00:27.145448 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-b6364aa0-7ffe-47f8-9213-80a13e42fb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:27.203828 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1384/2776] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:00:27.216146 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a95643-731d-4191-9a18-a67ef0c55b0c None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:27.216793 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a95643-731d-4191-9a18-a67ef0c55b0c None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:27.216793 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a95643-731d-4191-9a18-a67ef0c55b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:27.237172 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-a2a95643-731d-4191-9a18-a67ef0c55b0c None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:00:27.238393 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-a2a95643-731d-4191-9a18-a67ef0c55b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:27.250245 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1393/2777] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:00:27.251911 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6364aa0-7ffe-47f8-9213-80a13e42fb18 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:27.261914 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6364aa0-7ffe-47f8-9213-80a13e42fb18 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:27.265016 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a95643-731d-4191-9a18-a67ef0c55b0c None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:27.266421 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-a2a95643-731d-4191-9a18-a67ef0c55b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:27.267741 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7711f80-68f4-45e5-8f4e-202d8cb1e6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:27.268426 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7711f80-68f4-45e5-8f4e-202d8cb1e6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:27.268702 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7711f80-68f4-45e5-8f4e-202d8cb1e6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:27.268967 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7711f80-68f4-45e5-8f4e-202d8cb1e6b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:27.269725 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7711f80-68f4-45e5-8f4e-202d8cb1e6b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:00:27.270025 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7711f80-68f4-45e5-8f4e-202d8cb1e6b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:27.271621 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7711f80-68f4-45e5-8f4e-202d8cb1e6b9 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:27.278399 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a95643-731d-4191-9a18-a67ef0c55b0c None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:27.283351 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ee1ed-f606-4f32-ad0d-2a26cda2030c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:27.284202 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ee1ed-f606-4f32-ad0d-2a26cda2030c admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:27.284340 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1385/2778] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 14:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:00:27.284514 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ee1ed-f606-4f32-ad0d-2a26cda2030c admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:27.284766 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ee1ed-f606-4f32-ad0d-2a26cda2030c admin admin] PATH_INFO: `/v3/users/40fe5546c24648858ffe123c4f64e50e` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:27.286014 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ee1ed-f606-4f32-ad0d-2a26cda2030c admin admin] RBAC: Authorizing `identity:delete_user(user_id=40fe5546c24648858ffe123c4f64e50e)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:27.287887 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ee1ed-f606-4f32-ad0d-2a26cda2030c admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:27.288851 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7711f80-68f4-45e5-8f4e-202d8cb1e6b9 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:27.298564 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7711f80-68f4-45e5-8f4e-202d8cb1e6b9 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:27.303442 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23445419-c9da-4d61-8d2b-7d7848b3acd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:27.304061 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23445419-c9da-4d61-8d2b-7d7848b3acd8 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:27.304341 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23445419-c9da-4d61-8d2b-7d7848b3acd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:27.304617 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23445419-c9da-4d61-8d2b-7d7848b3acd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:27.305318 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23445419-c9da-4d61-8d2b-7d7848b3acd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:27.307246 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23445419-c9da-4d61-8d2b-7d7848b3acd8 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:27.333310 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-6a2ee1ed-f606-4f32-ad0d-2a26cda2030c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40fe5546c24648858ffe123c4f64e50e'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:27.333999 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-6a2ee1ed-f606-4f32-ad0d-2a26cda2030c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40fe5546c24648858ffe123c4f64e50e'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:27.334382 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1386/2779] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 14:00:27 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:00:27.338655 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23445419-c9da-4d61-8d2b-7d7848b3acd8 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:27.340611 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-23445419-c9da-4d61-8d2b-7d7848b3acd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:27.342872 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-6a2ee1ed-f606-4f32-ad0d-2a26cda2030c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40fe5546c24648858ffe123c4f64e50e'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:27.349985 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-6a2ee1ed-f606-4f32-ad0d-2a26cda2030c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40fe5546c24648858ffe123c4f64e50e'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:27.361811 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-6a2ee1ed-f606-4f32-ad0d-2a26cda2030c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40fe5546c24648858ffe123c4f64e50e'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:27.367621 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1394/2780] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 14:00:27 2022] DELETE /identity/v3/users/40fe5546c24648858ffe123c4f64e50e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:00:27.371980 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2005a27-a7b8-47c0-8548-4e2acd790178 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:27.372291 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2005a27-a7b8-47c0-8548-4e2acd790178 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:27.372562 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2005a27-a7b8-47c0-8548-4e2acd790178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:27.389214 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-b2005a27-a7b8-47c0-8548-4e2acd790178 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:00:27.390459 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-b2005a27-a7b8-47c0-8548-4e2acd790178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:27.402022 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23445419-c9da-4d61-8d2b-7d7848b3acd8 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:27.446619 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1395/2781] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:00:27.455693 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccfdeb-4b83-4927-9cee-7c4f10f6bd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:27.456169 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2005a27-a7b8-47c0-8548-4e2acd790178 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:27.456372 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccfdeb-4b83-4927-9cee-7c4f10f6bd30 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:27.456653 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccfdeb-4b83-4927-9cee-7c4f10f6bd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:27.456922 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccfdeb-4b83-4927-9cee-7c4f10f6bd30 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:27.457533 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-b2005a27-a7b8-47c0-8548-4e2acd790178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:27.457643 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccfdeb-4b83-4927-9cee-7c4f10f6bd30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:27.459533 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccfdeb-4b83-4927-9cee-7c4f10f6bd30 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:27.482729 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1387/2782] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 14:00:27 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:00:27.486809 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccfdeb-4b83-4927-9cee-7c4f10f6bd30 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:27.496252 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccfdeb-4b83-4927-9cee-7c4f10f6bd30 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:27.504097 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d27f7e-1772-43c6-9b68-f13d009eb968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:27.504839 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d27f7e-1772-43c6-9b68-f13d009eb968 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:27.505022 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d27f7e-1772-43c6-9b68-f13d009eb968 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:27.505286 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d27f7e-1772-43c6-9b68-f13d009eb968 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:27.506121 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d27f7e-1772-43c6-9b68-f13d009eb968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:27.508610 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d27f7e-1772-43c6-9b68-f13d009eb968 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:27.518473 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2005a27-a7b8-47c0-8548-4e2acd790178 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:27.522332 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7d824-5ff5-4e65-919e-bb9bab5ec40d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:27.522986 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7d824-5ff5-4e65-919e-bb9bab5ec40d service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:27.523267 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7d824-5ff5-4e65-919e-bb9bab5ec40d service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:27.523540 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7d824-5ff5-4e65-919e-bb9bab5ec40d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:27.526826 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1388/2783] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 14:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:00:27.527831 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d27f7e-1772-43c6-9b68-f13d009eb968 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:27.535317 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7d824-5ff5-4e65-919e-bb9bab5ec40d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:27.536776 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7d824-5ff5-4e65-919e-bb9bab5ec40d service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:27.537498 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d27f7e-1772-43c6-9b68-f13d009eb968 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:27.542520 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32135fb-7706-48cb-81ac-16cc83b4d666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:27.543153 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32135fb-7706-48cb-81ac-16cc83b4d666 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:27.543428 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32135fb-7706-48cb-81ac-16cc83b4d666 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:27.543694 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32135fb-7706-48cb-81ac-16cc83b4d666 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:27.544398 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32135fb-7706-48cb-81ac-16cc83b4d666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:27.546028 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32135fb-7706-48cb-81ac-16cc83b4d666 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:27.546154 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1396/2784] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:00:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:00:27.556747 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1389/2785] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 14:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:00:27.560869 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7d824-5ff5-4e65-919e-bb9bab5ec40d service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:27.571097 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7d824-5ff5-4e65-919e-bb9bab5ec40d service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:27.576145 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f414ee-3570-49a8-9e2c-b6404607dc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:27.577040 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f414ee-3570-49a8-9e2c-b6404607dc14 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:27.577316 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f414ee-3570-49a8-9e2c-b6404607dc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:27.577625 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f414ee-3570-49a8-9e2c-b6404607dc14 admin admin] PATH_INFO: `/v3/projects/d3b1330be6c5439591900d75e31e54a6/users/73ced951ae504612a5da2a71024d7340/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:27.592855 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f414ee-3570-49a8-9e2c-b6404607dc14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b1330be6c5439591900d75e31e54a6, user_id=73ced951ae504612a5da2a71024d7340, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:27.595519 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f414ee-3570-49a8-9e2c-b6404607dc14 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:27.610685 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1397/2786] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 14:00:27 2022] PUT /identity/v3/projects/d3b1330be6c5439591900d75e31e54a6/users/73ced951ae504612a5da2a71024d7340/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:00:27.621249 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f45d08-11c0-4ce3-a4a4-28aa1cb6c509 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:27.621613 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f45d08-11c0-4ce3-a4a4-28aa1cb6c509 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:27.621885 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f45d08-11c0-4ce3-a4a4-28aa1cb6c509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:27.647813 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-d4f45d08-11c0-4ce3-a4a4-28aa1cb6c509 None None] MFA Rules not processed for user `73ced951ae504612a5da2a71024d7340`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:00:27.649030 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-d4f45d08-11c0-4ce3-a4a4-28aa1cb6c509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:27.716993 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1390/2787] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:00:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:00:27.721118 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f414ee-3570-49a8-9e2c-b6404607dc14 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:27.779992 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f414ee-3570-49a8-9e2c-b6404607dc14 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:27.784591 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e46b59-4c68-4114-b969-71bddb9147b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:27.785248 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e46b59-4c68-4114-b969-71bddb9147b1 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:27.785562 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e46b59-4c68-4114-b969-71bddb9147b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:27.785839 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e46b59-4c68-4114-b969-71bddb9147b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:27.786534 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e46b59-4c68-4114-b969-71bddb9147b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:27.788412 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e46b59-4c68-4114-b969-71bddb9147b1 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:27.819470 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f45d08-11c0-4ce3-a4a4-28aa1cb6c509 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:27.822223 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-d4f45d08-11c0-4ce3-a4a4-28aa1cb6c509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:27.823473 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1398/2788] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 14:00:27 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:00:27.824430 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e46b59-4c68-4114-b969-71bddb9147b1 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:27.838725 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f45d08-11c0-4ce3-a4a4-28aa1cb6c509 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:27.895120 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d789c86-c9be-48df-b17c-405b9fce3f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:27.895716 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e46b59-4c68-4114-b969-71bddb9147b1 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:27.895979 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d789c86-c9be-48df-b17c-405b9fce3f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:27.896252 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d789c86-c9be-48df-b17c-405b9fce3f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:27.896518 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d789c86-c9be-48df-b17c-405b9fce3f8f admin admin] PATH_INFO: `/v3/projects/4affe3c6fb0f4dd181ca6574255abbab` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:27.897711 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d789c86-c9be-48df-b17c-405b9fce3f8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4affe3c6fb0f4dd181ca6574255abbab)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:27.899590 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d789c86-c9be-48df-b17c-405b9fce3f8f admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:27.900288 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac831d1a-5e49-4471-a1ec-5b8bfe208db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:27.900966 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac831d1a-5e49-4471-a1ec-5b8bfe208db2 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:27.901243 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac831d1a-5e49-4471-a1ec-5b8bfe208db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:27.901548 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac831d1a-5e49-4471-a1ec-5b8bfe208db2 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:27.902238 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac831d1a-5e49-4471-a1ec-5b8bfe208db2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:27.904210 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac831d1a-5e49-4471-a1ec-5b8bfe208db2 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:27.925838 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1399/2789] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 14:00:27 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:00:27.936297 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac831d1a-5e49-4471-a1ec-5b8bfe208db2 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:27.946166 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac831d1a-5e49-4471-a1ec-5b8bfe208db2 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:27.955596 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-1d789c86-c9be-48df-b17c-405b9fce3f8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4affe3c6fb0f4dd181ca6574255abbab', 'request_id': 'req-1d789c86-c9be-48df-b17c-405b9fce3f8f'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:27.961628 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-1d789c86-c9be-48df-b17c-405b9fce3f8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4affe3c6fb0f4dd181ca6574255abbab', 'request_id': 'req-1d789c86-c9be-48df-b17c-405b9fce3f8f'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:27.970293 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-1d789c86-c9be-48df-b17c-405b9fce3f8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4affe3c6fb0f4dd181ca6574255abbab', 'request_id': 'req-1d789c86-c9be-48df-b17c-405b9fce3f8f'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:27.980614 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-1d789c86-c9be-48df-b17c-405b9fce3f8f admin admin] The token cache is being invalidate because project 4affe3c6fb0f4dd181ca6574255abbab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:00:27.980894 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-1d789c86-c9be-48df-b17c-405b9fce3f8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:27.981556 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-1d789c86-c9be-48df-b17c-405b9fce3f8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:27.983194 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1391/2790] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 14:00:27 2022] DELETE /identity/v3/projects/4affe3c6fb0f4dd181ca6574255abbab => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:00:27.987167 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d789c86-c9be-48df-b17c-405b9fce3f8f admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:27.988545 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-1d789c86-c9be-48df-b17c-405b9fce3f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:28.003561 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe46585-ac99-484c-adde-f372d0692cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:28.004239 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe46585-ac99-484c-adde-f372d0692cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:28.004520 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe46585-ac99-484c-adde-f372d0692cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:28.004823 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe46585-ac99-484c-adde-f372d0692cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:28.005630 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe46585-ac99-484c-adde-f372d0692cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:28.007283 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe46585-ac99-484c-adde-f372d0692cf5 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:28.017906 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1400/2791] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 14:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:00:28.022255 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe46585-ac99-484c-adde-f372d0692cf5 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:28.023928 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-cfe46585-ac99-484c-adde-f372d0692cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:28.035935 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe46585-ac99-484c-adde-f372d0692cf5 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:28.040756 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347fee2-88c6-4efe-9275-9e0937694140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:28.041465 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347fee2-88c6-4efe-9275-9e0937694140 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:28.041774 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347fee2-88c6-4efe-9275-9e0937694140 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:28.042052 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1347fee2-88c6-4efe-9275-9e0937694140 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:28.042770 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347fee2-88c6-4efe-9275-9e0937694140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:28.044377 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1347fee2-88c6-4efe-9275-9e0937694140 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:28.053983 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1401/2792] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 14:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:00:28.054207 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d789c86-c9be-48df-b17c-405b9fce3f8f admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:28.058107 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347fee2-88c6-4efe-9275-9e0937694140 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:28.058895 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d69eb-93b9-4f6e-bb47-409c03d61bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:28.059769 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d69eb-93b9-4f6e-bb47-409c03d61bac admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:28.060048 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d69eb-93b9-4f6e-bb47-409c03d61bac admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:28.060341 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d69eb-93b9-4f6e-bb47-409c03d61bac admin admin] PATH_INFO: `/v3/users/4928c00b7ed440409941dd7d143cfb08` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:28.061589 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d69eb-93b9-4f6e-bb47-409c03d61bac admin admin] RBAC: Authorizing `identity:delete_user(user_id=4928c00b7ed440409941dd7d143cfb08)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:28.063469 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91d69eb-93b9-4f6e-bb47-409c03d61bac admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:28.067377 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1347fee2-88c6-4efe-9275-9e0937694140 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:28.071987 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ca0f0-26f9-4dab-ad41-d03d761f5096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:28.072829 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ca0f0-26f9-4dab-ad41-d03d761f5096 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:28.073125 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ca0f0-26f9-4dab-ad41-d03d761f5096 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:28.073407 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ca0f0-26f9-4dab-ad41-d03d761f5096 admin admin] PATH_INFO: `/v3/projects/e76cb8d9271a4862afb54cb5e84725ed/users/cbaaacd049d641318199ab23631adbd0/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:28.088171 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ca0f0-26f9-4dab-ad41-d03d761f5096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76cb8d9271a4862afb54cb5e84725ed, user_id=cbaaacd049d641318199ab23631adbd0, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:28.091942 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ca0f0-26f9-4dab-ad41-d03d761f5096 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:28.105997 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1402/2793] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 14:00:28 2022] PUT /identity/v3/projects/e76cb8d9271a4862afb54cb5e84725ed/users/cbaaacd049d641318199ab23631adbd0/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:00:28.117193 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec72c8-0a07-4fcd-9bb2-b306fbe59bd8 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:28.117514 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec72c8-0a07-4fcd-9bb2-b306fbe59bd8 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:28.117822 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec72c8-0a07-4fcd-9bb2-b306fbe59bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:28.118440 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-b91d69eb-93b9-4f6e-bb47-409c03d61bac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4928c00b7ed440409941dd7d143cfb08'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:28.119454 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-b91d69eb-93b9-4f6e-bb47-409c03d61bac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4928c00b7ed440409941dd7d143cfb08'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:28.128546 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-b91d69eb-93b9-4f6e-bb47-409c03d61bac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4928c00b7ed440409941dd7d143cfb08'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:28.142025 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-b91d69eb-93b9-4f6e-bb47-409c03d61bac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4928c00b7ed440409941dd7d143cfb08'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:28.143327 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-48ec72c8-0a07-4fcd-9bb2-b306fbe59bd8 None None] MFA Rules not processed for user `cbaaacd049d641318199ab23631adbd0`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:00:28.144647 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-48ec72c8-0a07-4fcd-9bb2-b306fbe59bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:28.148768 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-b91d69eb-93b9-4f6e-bb47-409c03d61bac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4928c00b7ed440409941dd7d143cfb08'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:28.155463 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1392/2794] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 14:00:27 2022] DELETE /identity/v3/users/4928c00b7ed440409941dd7d143cfb08 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:00:28.211950 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1403/2795] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:00:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:00:28.216876 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d69eb-93b9-4f6e-bb47-409c03d61bac admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:28.218391 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-b91d69eb-93b9-4f6e-bb47-409c03d61bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:28.280663 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91d69eb-93b9-4f6e-bb47-409c03d61bac admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:28.285442 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7cebe-474e-4a4a-b206-f227af53a538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:28.286088 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7cebe-474e-4a4a-b206-f227af53a538 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:28.286416 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7cebe-474e-4a4a-b206-f227af53a538 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:28.286694 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7cebe-474e-4a4a-b206-f227af53a538 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:28.287417 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7cebe-474e-4a4a-b206-f227af53a538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:28.289299 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7cebe-474e-4a4a-b206-f227af53a538 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:28.318356 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1393/2796] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 14:00:28 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:00:28.322435 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec72c8-0a07-4fcd-9bb2-b306fbe59bd8 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:28.382846 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec72c8-0a07-4fcd-9bb2-b306fbe59bd8 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:28.431694 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7cebe-474e-4a4a-b206-f227af53a538 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:28.433523 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-4dc7cebe-474e-4a4a-b206-f227af53a538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:28.445116 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19600efc-ee6b-411f-8f50-99f0d1710290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:28.445494 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19600efc-ee6b-411f-8f50-99f0d1710290 admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:28.445775 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19600efc-ee6b-411f-8f50-99f0d1710290 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:28.446227 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19600efc-ee6b-411f-8f50-99f0d1710290 admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:28.446875 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19600efc-ee6b-411f-8f50-99f0d1710290 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:28.448852 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19600efc-ee6b-411f-8f50-99f0d1710290 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:28.473383 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1404/2797] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 14:00:28 2022] POST /identity/v3/users => generated 299 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:00:28.477344 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19600efc-ee6b-411f-8f50-99f0d1710290 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:28.487151 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19600efc-ee6b-411f-8f50-99f0d1710290 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:28.492002 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7df94f-c00d-4eb6-b195-a8ead2decbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:28.492675 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7df94f-c00d-4eb6-b195-a8ead2decbe8 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:28.492956 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7df94f-c00d-4eb6-b195-a8ead2decbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:28.493224 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7df94f-c00d-4eb6-b195-a8ead2decbe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:28.493998 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7df94f-c00d-4eb6-b195-a8ead2decbe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:28.495607 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7df94f-c00d-4eb6-b195-a8ead2decbe8 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:28.504321 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7cebe-474e-4a4a-b206-f227af53a538 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:28.506045 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1405/2798] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 14:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:00:28.509049 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef14537-d067-4b1e-a3f4-8ea86273eb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:28.509950 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef14537-d067-4b1e-a3f4-8ea86273eb7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:28.510119 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7df94f-c00d-4eb6-b195-a8ead2decbe8 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:28.510227 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef14537-d067-4b1e-a3f4-8ea86273eb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:28.510485 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef14537-d067-4b1e-a3f4-8ea86273eb7a admin admin] PATH_INFO: `/v3/projects/cc2ecc411cef4676a9133327f45833e6` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:28.511671 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef14537-d067-4b1e-a3f4-8ea86273eb7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc2ecc411cef4676a9133327f45833e6)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:28.513783 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef14537-d067-4b1e-a3f4-8ea86273eb7a admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:28.519941 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7df94f-c00d-4eb6-b195-a8ead2decbe8 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:28.524449 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a60c4-15ca-44a7-93c3-7d6757666b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:28.525321 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a60c4-15ca-44a7-93c3-7d6757666b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:28.525636 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a60c4-15ca-44a7-93c3-7d6757666b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:28.525909 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a60c4-15ca-44a7-93c3-7d6757666b29 admin admin] PATH_INFO: `/v3/projects/4f554d65b1a44b649ff79790e96897d4/users/6dcb8c1872d54cbcaca7a0b6ea3b02a6/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:28.539959 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a60c4-15ca-44a7-93c3-7d6757666b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f554d65b1a44b649ff79790e96897d4, user_id=6dcb8c1872d54cbcaca7a0b6ea3b02a6, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:28.542760 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a60c4-15ca-44a7-93c3-7d6757666b29 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:28.556143 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1406/2799] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 14:00:28 2022] PUT /identity/v3/projects/4f554d65b1a44b649ff79790e96897d4/users/6dcb8c1872d54cbcaca7a0b6ea3b02a6/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:00:28.559974 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a60c4-15ca-44a7-93c3-7d6757666b29 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:28.563541 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-1ef14537-d067-4b1e-a3f4-8ea86273eb7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc2ecc411cef4676a9133327f45833e6', 'request_id': 'req-1ef14537-d067-4b1e-a3f4-8ea86273eb7a'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:28.569676 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-1ef14537-d067-4b1e-a3f4-8ea86273eb7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc2ecc411cef4676a9133327f45833e6', 'request_id': 'req-1ef14537-d067-4b1e-a3f4-8ea86273eb7a'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:28.577784 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-1ef14537-d067-4b1e-a3f4-8ea86273eb7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc2ecc411cef4676a9133327f45833e6', 'request_id': 'req-1ef14537-d067-4b1e-a3f4-8ea86273eb7a'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:28.587548 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-1ef14537-d067-4b1e-a3f4-8ea86273eb7a admin admin] The token cache is being invalidate because project cc2ecc411cef4676a9133327f45833e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:00:28.587830 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-1ef14537-d067-4b1e-a3f4-8ea86273eb7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:28.588532 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-1ef14537-d067-4b1e-a3f4-8ea86273eb7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:28.590551 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1394/2800] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 14:00:28 2022] DELETE /identity/v3/projects/cc2ecc411cef4676a9133327f45833e6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:00:28.595256 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87889c0-49f3-4a73-884b-3ceb4b7b0a2c None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:28.595542 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87889c0-49f3-4a73-884b-3ceb4b7b0a2c None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:28.595817 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87889c0-49f3-4a73-884b-3ceb4b7b0a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:28.614546 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-a87889c0-49f3-4a73-884b-3ceb4b7b0a2c None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:00:28.615745 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-a87889c0-49f3-4a73-884b-3ceb4b7b0a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:28.619709 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a60c4-15ca-44a7-93c3-7d6757666b29 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:28.671934 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1395/2801] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:00:28.672167 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc50e5-f414-4888-ae45-0873e5d71cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:28.672732 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc50e5-f414-4888-ae45-0873e5d71cba admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:28.673028 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc50e5-f414-4888-ae45-0873e5d71cba admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:28.673298 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc50e5-f414-4888-ae45-0873e5d71cba admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:28.674043 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc50e5-f414-4888-ae45-0873e5d71cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:28.675635 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc50e5-f414-4888-ae45-0873e5d71cba admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:28.679741 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324b251-8a75-47ab-a0ec-3e9d028ace9f None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:28.680225 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324b251-8a75-47ab-a0ec-3e9d028ace9f None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:28.680926 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324b251-8a75-47ab-a0ec-3e9d028ace9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:28.685221 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1407/2802] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 14:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:00:28.689060 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc50e5-f414-4888-ae45-0873e5d71cba admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:28.690775 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-aebc50e5-f414-4888-ae45-0873e5d71cba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:28.698607 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-8324b251-8a75-47ab-a0ec-3e9d028ace9f None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:00:28.699746 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-8324b251-8a75-47ab-a0ec-3e9d028ace9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:28.703775 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc50e5-f414-4888-ae45-0873e5d71cba admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:28.707887 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1396/2803] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:00:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:00:28.709150 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286049d2-3cdf-4455-bd68-b373fc43b26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:28.710067 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286049d2-3cdf-4455-bd68-b373fc43b26d admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:28.710350 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286049d2-3cdf-4455-bd68-b373fc43b26d admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:28.710648 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286049d2-3cdf-4455-bd68-b373fc43b26d admin admin] PATH_INFO: `/v3/projects/4f554d65b1a44b649ff79790e96897d4/users/6dcb8c1872d54cbcaca7a0b6ea3b02a6/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:28.711941 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324b251-8a75-47ab-a0ec-3e9d028ace9f None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:28.712826 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286049d2-3cdf-4455-bd68-b373fc43b26d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f554d65b1a44b649ff79790e96897d4, user_id=6dcb8c1872d54cbcaca7a0b6ea3b02a6, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:28.715805 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286049d2-3cdf-4455-bd68-b373fc43b26d admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:28.721108 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324b251-8a75-47ab-a0ec-3e9d028ace9f None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:28.726617 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1408/2804] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 14:00:28 2022] PUT /identity/v3/projects/4f554d65b1a44b649ff79790e96897d4/users/6dcb8c1872d54cbcaca7a0b6ea3b02a6/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:00:28.736732 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593909c-be95-4cab-8f71-57ea37dc82fb None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:28.737019 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593909c-be95-4cab-8f71-57ea37dc82fb None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:28.737367 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593909c-be95-4cab-8f71-57ea37dc82fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:28.762870 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-d593909c-be95-4cab-8f71-57ea37dc82fb None None] MFA Rules not processed for user `6dcb8c1872d54cbcaca7a0b6ea3b02a6`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:00:28.764087 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-d593909c-be95-4cab-8f71-57ea37dc82fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:28.774176 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7bdb9-7f8c-4dde-83c0-51c92762d0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:28.774837 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7bdb9-7f8c-4dde-83c0-51c92762d0ea admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:28.775111 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7bdb9-7f8c-4dde-83c0-51c92762d0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:28.775375 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7bdb9-7f8c-4dde-83c0-51c92762d0ea admin admin] PATH_INFO: `/v3/domains` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:28.776086 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7bdb9-7f8c-4dde-83c0-51c92762d0ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91154) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:00:28.776383 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7bdb9-7f8c-4dde-83c0-51c92762d0ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:28.777981 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7bdb9-7f8c-4dde-83c0-51c92762d0ea admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:28.792672 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1397/2805] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 14:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Mar 08 14:00:28.793672 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7bdb9-7f8c-4dde-83c0-51c92762d0ea admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:28.802877 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7bdb9-7f8c-4dde-83c0-51c92762d0ea admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:28.808096 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f35882-070b-4b93-bace-e8c86ba2cf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:28.808728 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f35882-070b-4b93-bace-e8c86ba2cf18 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:28.809008 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f35882-070b-4b93-bace-e8c86ba2cf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:28.809277 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f35882-070b-4b93-bace-e8c86ba2cf18 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:28.810041 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f35882-070b-4b93-bace-e8c86ba2cf18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:28.811945 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f35882-070b-4b93-bace-e8c86ba2cf18 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:28.830618 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1409/2806] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:00:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:00:28.842203 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593909c-be95-4cab-8f71-57ea37dc82fb None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:28.845740 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1398/2807] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 14:00:28 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:00:28.845892 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-d593909c-be95-4cab-8f71-57ea37dc82fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:28.846723 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f35882-070b-4b93-bace-e8c86ba2cf18 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:28.900475 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593909c-be95-4cab-8f71-57ea37dc82fb None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:28.905440 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f35882-070b-4b93-bace-e8c86ba2cf18 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:28.910270 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731743a6-2a7a-484c-bebc-397a85316461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:28.911030 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731743a6-2a7a-484c-bebc-397a85316461 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:28.911411 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731743a6-2a7a-484c-bebc-397a85316461 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:28.911780 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731743a6-2a7a-484c-bebc-397a85316461 admin admin] PATH_INFO: `/v3/users` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:28.912599 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731743a6-2a7a-484c-bebc-397a85316461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:28.914620 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731743a6-2a7a-484c-bebc-397a85316461 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:28.935313 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1399/2808] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 14:00:28 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:00:28.939385 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731743a6-2a7a-484c-bebc-397a85316461 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:28.947512 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751104d7-8251-4f7d-9492-6974978cfa63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:28.948224 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751104d7-8251-4f7d-9492-6974978cfa63 service cinder] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:28.948510 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751104d7-8251-4f7d-9492-6974978cfa63 service cinder] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:28.948777 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751104d7-8251-4f7d-9492-6974978cfa63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:28.949044 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731743a6-2a7a-484c-bebc-397a85316461 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:28.950903 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-751104d7-8251-4f7d-9492-6974978cfa63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:28.953758 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851179c0-ac11-4104-83d6-8b789a35e165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:28.954406 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851179c0-ac11-4104-83d6-8b789a35e165 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:28.954685 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851179c0-ac11-4104-83d6-8b789a35e165 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:28.954959 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851179c0-ac11-4104-83d6-8b789a35e165 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:28.955683 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851179c0-ac11-4104-83d6-8b789a35e165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:28.957257 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851179c0-ac11-4104-83d6-8b789a35e165 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:28.967352 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1400/2809] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 14:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:00:28.971067 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851179c0-ac11-4104-83d6-8b789a35e165 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:28.980551 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851179c0-ac11-4104-83d6-8b789a35e165 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:28.985804 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8e582-0364-4f02-9c89-6bff5eba28e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:28.986438 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8e582-0364-4f02-9c89-6bff5eba28e0 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:28.986712 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8e582-0364-4f02-9c89-6bff5eba28e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:28.986977 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8e582-0364-4f02-9c89-6bff5eba28e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:28.987685 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d8e582-0364-4f02-9c89-6bff5eba28e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:28.989261 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d8e582-0364-4f02-9c89-6bff5eba28e0 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:28.999484 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1401/2810] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 14:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Mar 08 14:00:29.003466 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8e582-0364-4f02-9c89-6bff5eba28e0 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:29.008135 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751104d7-8251-4f7d-9492-6974978cfa63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:29.009734 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751104d7-8251-4f7d-9492-6974978cfa63 service cinder] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:29.013059 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8e582-0364-4f02-9c89-6bff5eba28e0 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:29.017837 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c6321-b851-43ab-a907-4738e4f93121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:29.018712 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c6321-b851-43ab-a907-4738e4f93121 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:29.018992 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c6321-b851-43ab-a907-4738e4f93121 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:29.019103 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1410/2811] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:00:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:00:29.019342 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c6321-b851-43ab-a907-4738e4f93121 admin admin] PATH_INFO: `/v3/projects/6ea51bf28d6249a1a7ebc706ddc5fdcb/users/87a953cae13f4427bb20683f9f286280/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:29.034596 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c6321-b851-43ab-a907-4738e4f93121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ea51bf28d6249a1a7ebc706ddc5fdcb, user_id=87a953cae13f4427bb20683f9f286280, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:29.037272 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93c6321-b851-43ab-a907-4738e4f93121 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:29.051163 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1402/2812] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 14:00:29 2022] PUT /identity/v3/projects/6ea51bf28d6249a1a7ebc706ddc5fdcb/users/87a953cae13f4427bb20683f9f286280/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:00:29.062592 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dae107-8523-414b-bd5d-710a94d42cf1 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:29.062879 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dae107-8523-414b-bd5d-710a94d42cf1 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:29.063151 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dae107-8523-414b-bd5d-710a94d42cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:29.088755 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-11dae107-8523-414b-bd5d-710a94d42cf1 None None] MFA Rules not processed for user `87a953cae13f4427bb20683f9f286280`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:00:29.090026 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-11dae107-8523-414b-bd5d-710a94d42cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:29.153185 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1411/2813] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:00:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:00:29.165477 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c6321-b851-43ab-a907-4738e4f93121 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:29.167504 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-e93c6321-b851-43ab-a907-4738e4f93121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:29.226851 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93c6321-b851-43ab-a907-4738e4f93121 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:29.231127 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11dfc9-d824-48c6-8b06-a677fc06e96f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:29.231800 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11dfc9-d824-48c6-8b06-a677fc06e96f service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:29.232146 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11dfc9-d824-48c6-8b06-a677fc06e96f service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:29.232512 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11dfc9-d824-48c6-8b06-a677fc06e96f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:29.241575 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11dfc9-d824-48c6-8b06-a677fc06e96f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:29.242983 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11dfc9-d824-48c6-8b06-a677fc06e96f service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:29.252423 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1403/2814] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:00:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:00:29.273598 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dae107-8523-414b-bd5d-710a94d42cf1 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:29.340923 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dae107-8523-414b-bd5d-710a94d42cf1 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:29.346104 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d162d-3008-4a9c-9938-80e4b181037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:29.347037 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d162d-3008-4a9c-9938-80e4b181037a admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:29.347312 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d162d-3008-4a9c-9938-80e4b181037a admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:29.347582 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d162d-3008-4a9c-9938-80e4b181037a admin admin] PATH_INFO: `/v3/users/87a953cae13f4427bb20683f9f286280` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:29.348811 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d162d-3008-4a9c-9938-80e4b181037a admin admin] RBAC: Authorizing `identity:delete_user(user_id=87a953cae13f4427bb20683f9f286280)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:29.350770 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d162d-3008-4a9c-9938-80e4b181037a admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:29.406529 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ac0d162d-3008-4a9c-9938-80e4b181037a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87a953cae13f4427bb20683f9f286280'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:29.407330 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ac0d162d-3008-4a9c-9938-80e4b181037a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87a953cae13f4427bb20683f9f286280'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:29.415937 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ac0d162d-3008-4a9c-9938-80e4b181037a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87a953cae13f4427bb20683f9f286280'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:29.423034 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ac0d162d-3008-4a9c-9938-80e4b181037a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87a953cae13f4427bb20683f9f286280'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:29.435059 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-ac0d162d-3008-4a9c-9938-80e4b181037a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87a953cae13f4427bb20683f9f286280'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:29.441621 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1412/2815] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 14:00:29 2022] DELETE /identity/v3/users/87a953cae13f4427bb20683f9f286280 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:00:29.446538 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c42a2-626d-45a5-b56c-db4aea95d21f None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:29.446835 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c42a2-626d-45a5-b56c-db4aea95d21f None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:29.447102 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21c42a2-626d-45a5-b56c-db4aea95d21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:29.466535 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-a21c42a2-626d-45a5-b56c-db4aea95d21f None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:00:29.467998 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-a21c42a2-626d-45a5-b56c-db4aea95d21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:29.533555 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1404/2816] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:00:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:00:29.546937 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d162d-3008-4a9c-9938-80e4b181037a admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:29.548400 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-ac0d162d-3008-4a9c-9938-80e4b181037a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:29.616301 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d162d-3008-4a9c-9938-80e4b181037a admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:29.622711 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb866fda-7ba6-445d-b332-61a65a8f5a7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:29.623369 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb866fda-7ba6-445d-b332-61a65a8f5a7e service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:29.623658 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb866fda-7ba6-445d-b332-61a65a8f5a7e service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:29.623926 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb866fda-7ba6-445d-b332-61a65a8f5a7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:29.639146 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb866fda-7ba6-445d-b332-61a65a8f5a7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:29.640680 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb866fda-7ba6-445d-b332-61a65a8f5a7e service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:29.651112 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1413/2817] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:00:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:00:29.928708 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c42a2-626d-45a5-b56c-db4aea95d21f None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:29.930322 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-a21c42a2-626d-45a5-b56c-db4aea95d21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:29.943292 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21c42a2-626d-45a5-b56c-db4aea95d21f None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:29.949435 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf67f8-6f36-46f8-968e-dc5e4008e24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:29.950890 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf67f8-6f36-46f8-968e-dc5e4008e24d admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:29.951208 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf67f8-6f36-46f8-968e-dc5e4008e24d admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:29.951773 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf67f8-6f36-46f8-968e-dc5e4008e24d admin admin] PATH_INFO: `/v3/projects/6ea51bf28d6249a1a7ebc706ddc5fdcb` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:29.953113 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf67f8-6f36-46f8-968e-dc5e4008e24d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ea51bf28d6249a1a7ebc706ddc5fdcb)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:29.955128 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf67f8-6f36-46f8-968e-dc5e4008e24d admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:30.011606 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-bcaf67f8-6f36-46f8-968e-dc5e4008e24d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ea51bf28d6249a1a7ebc706ddc5fdcb', 'request_id': 'req-bcaf67f8-6f36-46f8-968e-dc5e4008e24d'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:30.017871 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-bcaf67f8-6f36-46f8-968e-dc5e4008e24d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ea51bf28d6249a1a7ebc706ddc5fdcb', 'request_id': 'req-bcaf67f8-6f36-46f8-968e-dc5e4008e24d'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:30.027954 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-bcaf67f8-6f36-46f8-968e-dc5e4008e24d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ea51bf28d6249a1a7ebc706ddc5fdcb', 'request_id': 'req-bcaf67f8-6f36-46f8-968e-dc5e4008e24d'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:30.038697 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-bcaf67f8-6f36-46f8-968e-dc5e4008e24d admin admin] The token cache is being invalidate because project 6ea51bf28d6249a1a7ebc706ddc5fdcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:00:30.038982 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-bcaf67f8-6f36-46f8-968e-dc5e4008e24d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:30.039601 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-bcaf67f8-6f36-46f8-968e-dc5e4008e24d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:30.041205 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1405/2818] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 14:00:29 2022] DELETE /identity/v3/projects/6ea51bf28d6249a1a7ebc706ddc5fdcb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:00:30.046107 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c8837-4742-4ef3-98a2-dc5539d81ded None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:30.046392 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c8837-4742-4ef3-98a2-dc5539d81ded None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:30.046692 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c8837-4742-4ef3-98a2-dc5539d81ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:30.064573 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-713c8837-4742-4ef3-98a2-dc5539d81ded None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:00:30.065815 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-713c8837-4742-4ef3-98a2-dc5539d81ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:30.128945 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1414/2819] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:00:30.141012 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af0684-1a45-47aa-9be2-4495d83f639f None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:30.141407 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af0684-1a45-47aa-9be2-4495d83f639f None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:30.141774 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af0684-1a45-47aa-9be2-4495d83f639f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:30.164864 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-b7af0684-1a45-47aa-9be2-4495d83f639f None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:00:30.166103 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-b7af0684-1a45-47aa-9be2-4495d83f639f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:30.174813 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1406/2820] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:00:30.179162 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c8837-4742-4ef3-98a2-dc5539d81ded None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:30.189928 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c8837-4742-4ef3-98a2-dc5539d81ded None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:30.195437 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0def61-e2e4-49c6-b19d-65accd8987b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:30.196082 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0def61-e2e4-49c6-b19d-65accd8987b5 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:30.196360 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0def61-e2e4-49c6-b19d-65accd8987b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:30.196623 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0def61-e2e4-49c6-b19d-65accd8987b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:30.197341 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0def61-e2e4-49c6-b19d-65accd8987b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:00:30.197672 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0def61-e2e4-49c6-b19d-65accd8987b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:30.199271 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0def61-e2e4-49c6-b19d-65accd8987b5 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:30.212459 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1415/2821] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 14:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:00:30.217409 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af0684-1a45-47aa-9be2-4495d83f639f None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:30.227121 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af0684-1a45-47aa-9be2-4495d83f639f None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:30.233179 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9f5dd-b6a8-411d-ae5a-dfa378c8f812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:30.233872 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9f5dd-b6a8-411d-ae5a-dfa378c8f812 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:30.234141 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9f5dd-b6a8-411d-ae5a-dfa378c8f812 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:30.234410 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9f5dd-b6a8-411d-ae5a-dfa378c8f812 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:30.235115 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9f5dd-b6a8-411d-ae5a-dfa378c8f812 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:30.236998 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9f5dd-b6a8-411d-ae5a-dfa378c8f812 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:30.266490 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1407/2822] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 14:00:30 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:00:30.271155 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0def61-e2e4-49c6-b19d-65accd8987b5 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:30.284297 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0def61-e2e4-49c6-b19d-65accd8987b5 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:30.342701 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205386b4-8366-4f0e-b018-825fd223722d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:30.343364 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205386b4-8366-4f0e-b018-825fd223722d admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:30.343649 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205386b4-8366-4f0e-b018-825fd223722d admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:30.343920 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205386b4-8366-4f0e-b018-825fd223722d admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:30.344612 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205386b4-8366-4f0e-b018-825fd223722d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:30.346553 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205386b4-8366-4f0e-b018-825fd223722d admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:30.370153 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1416/2823] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 14:00:30 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:00:30.371356 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9f5dd-b6a8-411d-ae5a-dfa378c8f812 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:30.381690 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9f5dd-b6a8-411d-ae5a-dfa378c8f812 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:30.386981 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c79b18-87be-4cf3-9c00-4f785619c119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:30.387711 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c79b18-87be-4cf3-9c00-4f785619c119 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:30.388056 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c79b18-87be-4cf3-9c00-4f785619c119 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:30.388389 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c79b18-87be-4cf3-9c00-4f785619c119 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:30.389249 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c79b18-87be-4cf3-9c00-4f785619c119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:30.390936 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c79b18-87be-4cf3-9c00-4f785619c119 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:30.403072 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1408/2824] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 14:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:00:30.412007 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205386b4-8366-4f0e-b018-825fd223722d admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:30.422544 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205386b4-8366-4f0e-b018-825fd223722d admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:30.427612 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a82c8-b0d6-4fe6-9337-3e3bb4b77993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:30.428275 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a82c8-b0d6-4fe6-9337-3e3bb4b77993 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:30.428554 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a82c8-b0d6-4fe6-9337-3e3bb4b77993 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:30.428826 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a82c8-b0d6-4fe6-9337-3e3bb4b77993 admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:30.429590 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a82c8-b0d6-4fe6-9337-3e3bb4b77993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:30.431484 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a82c8-b0d6-4fe6-9337-3e3bb4b77993 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:30.447128 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1417/2825] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 14:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:00:30.451698 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c79b18-87be-4cf3-9c00-4f785619c119 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:30.461981 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c79b18-87be-4cf3-9c00-4f785619c119 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:30.470559 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa55f89-5b63-45e0-aac1-0aaa13a44643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:30.470559 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa55f89-5b63-45e0-aac1-0aaa13a44643 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:30.470559 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa55f89-5b63-45e0-aac1-0aaa13a44643 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:30.470559 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa55f89-5b63-45e0-aac1-0aaa13a44643 admin admin] PATH_INFO: `/v3/projects/f88f77257ee74eb8b7644e3da5f76ebe/users/c4d0e298e5cf4e5db4f2b10cdc1271fa/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:30.485393 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa55f89-5b63-45e0-aac1-0aaa13a44643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f88f77257ee74eb8b7644e3da5f76ebe, user_id=c4d0e298e5cf4e5db4f2b10cdc1271fa, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:30.488180 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa55f89-5b63-45e0-aac1-0aaa13a44643 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:30.503039 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1409/2826] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 14:00:30 2022] PUT /identity/v3/projects/f88f77257ee74eb8b7644e3da5f76ebe/users/c4d0e298e5cf4e5db4f2b10cdc1271fa/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:00:30.508180 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ca0be-c690-409f-9e20-9c7dd6d19f96 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:30.508462 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ca0be-c690-409f-9e20-9c7dd6d19f96 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:30.508736 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131ca0be-c690-409f-9e20-9c7dd6d19f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:30.526138 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa55f89-5b63-45e0-aac1-0aaa13a44643 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:30.526862 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-131ca0be-c690-409f-9e20-9c7dd6d19f96 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:00:30.528048 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-131ca0be-c690-409f-9e20-9c7dd6d19f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:30.528166 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-eaa55f89-5b63-45e0-aac1-0aaa13a44643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:30.585070 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa55f89-5b63-45e0-aac1-0aaa13a44643 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:30.590693 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1418/2827] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:00:30.593186 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209094cd-9317-4fef-ac17-1c023aa3eac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:30.593897 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209094cd-9317-4fef-ac17-1c023aa3eac5 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:30.594296 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209094cd-9317-4fef-ac17-1c023aa3eac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:30.594567 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209094cd-9317-4fef-ac17-1c023aa3eac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:30.596455 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-209094cd-9317-4fef-ac17-1c023aa3eac5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:30.597206 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ca0be-c690-409f-9e20-9c7dd6d19f96 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:30.598562 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-131ca0be-c690-409f-9e20-9c7dd6d19f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:30.652274 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131ca0be-c690-409f-9e20-9c7dd6d19f96 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:30.653577 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209094cd-9317-4fef-ac17-1c023aa3eac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:30.654994 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209094cd-9317-4fef-ac17-1c023aa3eac5 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:30.656019 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17a678-d151-4403-9f35-081674c5897d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:30.656663 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17a678-d151-4403-9f35-081674c5897d service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:30.656942 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17a678-d151-4403-9f35-081674c5897d service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:30.657216 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17a678-d151-4403-9f35-081674c5897d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:30.663635 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1410/2828] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:00:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:00:30.666390 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17a678-d151-4403-9f35-081674c5897d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:30.667812 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17a678-d151-4403-9f35-081674c5897d service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:30.677324 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1419/2829] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:00:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:00:31.208737 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209094cd-9317-4fef-ac17-1c023aa3eac5 service cinder] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:31.218292 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209094cd-9317-4fef-ac17-1c023aa3eac5 service cinder] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:31.222536 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526255ad-af8b-40e4-9b8d-4d1f56fa99ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:31.223467 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526255ad-af8b-40e4-9b8d-4d1f56fa99ba service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:31.223595 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526255ad-af8b-40e4-9b8d-4d1f56fa99ba service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:31.223890 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526255ad-af8b-40e4-9b8d-4d1f56fa99ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:31.225967 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-526255ad-af8b-40e4-9b8d-4d1f56fa99ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:31.297679 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526255ad-af8b-40e4-9b8d-4d1f56fa99ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:31.299268 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526255ad-af8b-40e4-9b8d-4d1f56fa99ba service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:31.304350 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f35086-2c80-4481-809b-52e134b2f84b None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:31.304645 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f35086-2c80-4481-809b-52e134b2f84b None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:31.305334 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f35086-2c80-4481-809b-52e134b2f84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:31.311168 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1411/2830] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:00:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:00:31.333950 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-03f35086-2c80-4481-809b-52e134b2f84b None None] MFA Rules not processed for user `c4d0e298e5cf4e5db4f2b10cdc1271fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:00:31.335217 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-03f35086-2c80-4481-809b-52e134b2f84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:31.411821 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1420/2831] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:00:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Mar 08 14:00:31.425335 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526255ad-af8b-40e4-9b8d-4d1f56fa99ba service cinder] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:31.435250 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526255ad-af8b-40e4-9b8d-4d1f56fa99ba service cinder] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:31.439032 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3741fc-feef-4b0d-9568-e6047ead0e81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56ddb15832b048f5a19d7d3887e088b3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:31.439675 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3741fc-feef-4b0d-9568-e6047ead0e81 service cinder] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:31.439978 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3741fc-feef-4b0d-9568-e6047ead0e81 service cinder] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:31.440248 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3741fc-feef-4b0d-9568-e6047ead0e81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:31.448863 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3741fc-feef-4b0d-9568-e6047ead0e81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:31.450299 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3741fc-feef-4b0d-9568-e6047ead0e81 service cinder] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:31.459294 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1412/2832] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:00:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:00:32.865203 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df168030-768d-44a7-acdc-9492bb29d25d None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:32.865736 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df168030-768d-44a7-acdc-9492bb29d25d None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:32.865868 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df168030-768d-44a7-acdc-9492bb29d25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:32.883170 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-df168030-768d-44a7-acdc-9492bb29d25d None None] MFA Rules not processed for user `c4d0e298e5cf4e5db4f2b10cdc1271fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:00:32.884352 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-df168030-768d-44a7-acdc-9492bb29d25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:32.892768 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1421/2833] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:00:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:00:35.194270 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3741fc-feef-4b0d-9568-e6047ead0e81 service cinder] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:35.195985 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-9d3741fc-feef-4b0d-9568-e6047ead0e81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:35.211045 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3741fc-feef-4b0d-9568-e6047ead0e81 service cinder] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:35.217071 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb21fc7-3db9-4fbe-aa5a-fe3d254b0211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:35.217977 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb21fc7-3db9-4fbe-aa5a-fe3d254b0211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:35.218314 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb21fc7-3db9-4fbe-aa5a-fe3d254b0211 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:35.218529 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb21fc7-3db9-4fbe-aa5a-fe3d254b0211 admin admin] PATH_INFO: `/v3/users/73ced951ae504612a5da2a71024d7340` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:35.219863 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb21fc7-3db9-4fbe-aa5a-fe3d254b0211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73ced951ae504612a5da2a71024d7340)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:35.221792 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb21fc7-3db9-4fbe-aa5a-fe3d254b0211 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:35.270110 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-cfb21fc7-3db9-4fbe-aa5a-fe3d254b0211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73ced951ae504612a5da2a71024d7340'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:35.270745 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-cfb21fc7-3db9-4fbe-aa5a-fe3d254b0211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73ced951ae504612a5da2a71024d7340'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:35.279495 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-cfb21fc7-3db9-4fbe-aa5a-fe3d254b0211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73ced951ae504612a5da2a71024d7340'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:35.291103 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-cfb21fc7-3db9-4fbe-aa5a-fe3d254b0211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73ced951ae504612a5da2a71024d7340'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:35.297783 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-cfb21fc7-3db9-4fbe-aa5a-fe3d254b0211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73ced951ae504612a5da2a71024d7340'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:35.303945 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1413/2834] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 14:00:35 2022] DELETE /identity/v3/users/73ced951ae504612a5da2a71024d7340 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:00:35.308726 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6220ab-181a-45fb-a378-d0af31cab42b None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:35.309211 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6220ab-181a-45fb-a378-d0af31cab42b None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:35.309211 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6220ab-181a-45fb-a378-d0af31cab42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:35.327064 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-bc6220ab-181a-45fb-a378-d0af31cab42b None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:00:35.328352 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-bc6220ab-181a-45fb-a378-d0af31cab42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:35.392301 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1422/2835] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:00:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:00:35.402199 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb21fc7-3db9-4fbe-aa5a-fe3d254b0211 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:35.403885 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-cfb21fc7-3db9-4fbe-aa5a-fe3d254b0211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:35.466624 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb21fc7-3db9-4fbe-aa5a-fe3d254b0211 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:35.471304 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5338bf-c556-445a-9427-a7c4f509d281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:35.471955 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5338bf-c556-445a-9427-a7c4f509d281 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:35.472230 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5338bf-c556-445a-9427-a7c4f509d281 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:35.472497 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5338bf-c556-445a-9427-a7c4f509d281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:35.482359 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5338bf-c556-445a-9427-a7c4f509d281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:35.483806 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5338bf-c556-445a-9427-a7c4f509d281 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:35.493334 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1414/2836] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:00:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:00:35.763332 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6220ab-181a-45fb-a378-d0af31cab42b None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:35.765430 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-bc6220ab-181a-45fb-a378-d0af31cab42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:35.779768 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6220ab-181a-45fb-a378-d0af31cab42b None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:35.785880 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd9167-f827-4c69-a45c-abf6a1637a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:35.786766 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd9167-f827-4c69-a45c-abf6a1637a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:35.787185 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd9167-f827-4c69-a45c-abf6a1637a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:35.787456 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd9167-f827-4c69-a45c-abf6a1637a59 admin admin] PATH_INFO: `/v3/projects/d3b1330be6c5439591900d75e31e54a6` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:35.788809 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd9167-f827-4c69-a45c-abf6a1637a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3b1330be6c5439591900d75e31e54a6)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:35.790957 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bd9167-f827-4c69-a45c-abf6a1637a59 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:35.843742 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-b4bd9167-f827-4c69-a45c-abf6a1637a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3b1330be6c5439591900d75e31e54a6', 'request_id': 'req-b4bd9167-f827-4c69-a45c-abf6a1637a59'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:35.850878 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-b4bd9167-f827-4c69-a45c-abf6a1637a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3b1330be6c5439591900d75e31e54a6', 'request_id': 'req-b4bd9167-f827-4c69-a45c-abf6a1637a59'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:35.859878 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-b4bd9167-f827-4c69-a45c-abf6a1637a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3b1330be6c5439591900d75e31e54a6', 'request_id': 'req-b4bd9167-f827-4c69-a45c-abf6a1637a59'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:35.870554 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-b4bd9167-f827-4c69-a45c-abf6a1637a59 admin admin] The token cache is being invalidate because project d3b1330be6c5439591900d75e31e54a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:00:35.870842 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-b4bd9167-f827-4c69-a45c-abf6a1637a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:35.871608 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-b4bd9167-f827-4c69-a45c-abf6a1637a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:35.873604 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1423/2837] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 14:00:35 2022] DELETE /identity/v3/projects/d3b1330be6c5439591900d75e31e54a6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:00:35.877674 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5338bf-c556-445a-9427-a7c4f509d281 service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:35.887714 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5338bf-c556-445a-9427-a7c4f509d281 service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:35.953948 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81291036-64f9-40d1-a6bd-68d31a119800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:35.955345 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81291036-64f9-40d1-a6bd-68d31a119800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:35.955805 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81291036-64f9-40d1-a6bd-68d31a119800 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:35.956254 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81291036-64f9-40d1-a6bd-68d31a119800 admin admin] PATH_INFO: `/v3/users/cbaaacd049d641318199ab23631adbd0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:35.958304 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81291036-64f9-40d1-a6bd-68d31a119800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbaaacd049d641318199ab23631adbd0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:35.960823 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81291036-64f9-40d1-a6bd-68d31a119800 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:36.013881 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-81291036-64f9-40d1-a6bd-68d31a119800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbaaacd049d641318199ab23631adbd0'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:36.014511 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-81291036-64f9-40d1-a6bd-68d31a119800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbaaacd049d641318199ab23631adbd0'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:36.023387 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-81291036-64f9-40d1-a6bd-68d31a119800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbaaacd049d641318199ab23631adbd0'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:36.035101 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-81291036-64f9-40d1-a6bd-68d31a119800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbaaacd049d641318199ab23631adbd0'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:36.041713 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-81291036-64f9-40d1-a6bd-68d31a119800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbaaacd049d641318199ab23631adbd0'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:36.047967 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1415/2838] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 14:00:35 2022] DELETE /identity/v3/users/cbaaacd049d641318199ab23631adbd0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:00:36.315161 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd9167-f827-4c69-a45c-abf6a1637a59 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:36.316641 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-b4bd9167-f827-4c69-a45c-abf6a1637a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:36.330076 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd9167-f827-4c69-a45c-abf6a1637a59 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:36.388865 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a709dea-aa8b-4232-9166-dd00e4ef7f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:36.389762 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a709dea-aa8b-4232-9166-dd00e4ef7f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:36.390041 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a709dea-aa8b-4232-9166-dd00e4ef7f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:36.390312 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a709dea-aa8b-4232-9166-dd00e4ef7f0e admin admin] PATH_INFO: `/v3/projects/e76cb8d9271a4862afb54cb5e84725ed` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:36.391533 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a709dea-aa8b-4232-9166-dd00e4ef7f0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e76cb8d9271a4862afb54cb5e84725ed)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:36.393503 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a709dea-aa8b-4232-9166-dd00e4ef7f0e admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:36.441532 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-3a709dea-aa8b-4232-9166-dd00e4ef7f0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e76cb8d9271a4862afb54cb5e84725ed', 'request_id': 'req-3a709dea-aa8b-4232-9166-dd00e4ef7f0e'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:36.448000 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-3a709dea-aa8b-4232-9166-dd00e4ef7f0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e76cb8d9271a4862afb54cb5e84725ed', 'request_id': 'req-3a709dea-aa8b-4232-9166-dd00e4ef7f0e'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:36.457227 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-3a709dea-aa8b-4232-9166-dd00e4ef7f0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e76cb8d9271a4862afb54cb5e84725ed', 'request_id': 'req-3a709dea-aa8b-4232-9166-dd00e4ef7f0e'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:36.468320 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-3a709dea-aa8b-4232-9166-dd00e4ef7f0e admin admin] The token cache is being invalidate because project e76cb8d9271a4862afb54cb5e84725ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:00:36.468607 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-3a709dea-aa8b-4232-9166-dd00e4ef7f0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:36.469334 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-3a709dea-aa8b-4232-9166-dd00e4ef7f0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:36.471054 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1424/2839] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 14:00:36 2022] DELETE /identity/v3/projects/e76cb8d9271a4862afb54cb5e84725ed => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:00:36.475220 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81291036-64f9-40d1-a6bd-68d31a119800 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:36.476807 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-81291036-64f9-40d1-a6bd-68d31a119800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:36.490295 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81291036-64f9-40d1-a6bd-68d31a119800 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:36.544942 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcaaebc-55a5-4286-b51b-6d599424e4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:36.545892 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaaebc-55a5-4286-b51b-6d599424e4ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:36.546167 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaaebc-55a5-4286-b51b-6d599424e4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:36.546441 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaaebc-55a5-4286-b51b-6d599424e4ea admin admin] PATH_INFO: `/v3/users/6dcb8c1872d54cbcaca7a0b6ea3b02a6` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:36.547700 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcaaebc-55a5-4286-b51b-6d599424e4ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dcb8c1872d54cbcaca7a0b6ea3b02a6)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:36.549628 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcaaebc-55a5-4286-b51b-6d599424e4ea admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:36.600614 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-8dcaaebc-55a5-4286-b51b-6d599424e4ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dcb8c1872d54cbcaca7a0b6ea3b02a6'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:36.601316 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-8dcaaebc-55a5-4286-b51b-6d599424e4ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dcb8c1872d54cbcaca7a0b6ea3b02a6'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:36.613495 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-8dcaaebc-55a5-4286-b51b-6d599424e4ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dcb8c1872d54cbcaca7a0b6ea3b02a6'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:36.625220 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-8dcaaebc-55a5-4286-b51b-6d599424e4ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dcb8c1872d54cbcaca7a0b6ea3b02a6'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:36.631853 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-8dcaaebc-55a5-4286-b51b-6d599424e4ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dcb8c1872d54cbcaca7a0b6ea3b02a6'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:36.637594 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1416/2840] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 14:00:36 2022] DELETE /identity/v3/users/6dcb8c1872d54cbcaca7a0b6ea3b02a6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:00:36.947629 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a709dea-aa8b-4232-9166-dd00e4ef7f0e admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:00:36.949018 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-3a709dea-aa8b-4232-9166-dd00e4ef7f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:36.962911 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a709dea-aa8b-4232-9166-dd00e4ef7f0e admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:00:37.019355 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a14d1e-12ae-4866-ada7-49a04e19d607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:00:37.020211 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a14d1e-12ae-4866-ada7-49a04e19d607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:37.020643 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a14d1e-12ae-4866-ada7-49a04e19d607 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:37.020891 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a14d1e-12ae-4866-ada7-49a04e19d607 admin admin] PATH_INFO: `/v3/projects/4f554d65b1a44b649ff79790e96897d4` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:37.022123 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a14d1e-12ae-4866-ada7-49a04e19d607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f554d65b1a44b649ff79790e96897d4)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:00:37.024009 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a14d1e-12ae-4866-ada7-49a04e19d607 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:00:37.079683 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-98a14d1e-12ae-4866-ada7-49a04e19d607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f554d65b1a44b649ff79790e96897d4', 'request_id': 'req-98a14d1e-12ae-4866-ada7-49a04e19d607'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:37.085568 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-98a14d1e-12ae-4866-ada7-49a04e19d607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f554d65b1a44b649ff79790e96897d4', 'request_id': 'req-98a14d1e-12ae-4866-ada7-49a04e19d607'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:37.095373 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-98a14d1e-12ae-4866-ada7-49a04e19d607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f554d65b1a44b649ff79790e96897d4', 'request_id': 'req-98a14d1e-12ae-4866-ada7-49a04e19d607'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:37.106246 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-98a14d1e-12ae-4866-ada7-49a04e19d607 admin admin] The token cache is being invalidate because project 4f554d65b1a44b649ff79790e96897d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:00:37.106526 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-98a14d1e-12ae-4866-ada7-49a04e19d607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:37.107177 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-98a14d1e-12ae-4866-ada7-49a04e19d607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:00:37.108887 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1425/2841] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 14:00:36 2022] DELETE /identity/v3/projects/4f554d65b1a44b649ff79790e96897d4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:00:49.106342 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c1b41-a10c-4cb8-bfd4-82436510c95c None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:00:49.106875 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c1b41-a10c-4cb8-bfd4-82436510c95c None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:00:49.106875 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31c1b41-a10c-4cb8-bfd4-82436510c95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:00:49.125543 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-c31c1b41-a10c-4cb8-bfd4-82436510c95c None None] MFA Rules not processed for user `c4d0e298e5cf4e5db4f2b10cdc1271fa`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:00:49.126716 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-c31c1b41-a10c-4cb8-bfd4-82436510c95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:00:49.190050 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1417/2842] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:00:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:05.462823 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e9ad6-5c7c-4530-8522-886de916e9a9 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:05.463367 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e9ad6-5c7c-4530-8522-886de916e9a9 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:05.463367 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e9ad6-5c7c-4530-8522-886de916e9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:05.482462 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-500e9ad6-5c7c-4530-8522-886de916e9a9 None None] MFA Rules not processed for user `817bcd2c5f6e4bceb049eeb122d4e432`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:05.483713 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-500e9ad6-5c7c-4530-8522-886de916e9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:05.539500 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1426/2843] 10.222.0.18 () {58 vars in 1009 bytes} [Tue Mar 8 14:01:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:05.588561 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c1b41-a10c-4cb8-bfd4-82436510c95c None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:05.590098 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-c31c1b41-a10c-4cb8-bfd4-82436510c95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:05.663705 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31c1b41-a10c-4cb8-bfd4-82436510c95c None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:05.669848 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1d2e9-8356-4bc3-ae68-a2afd10ae0b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0f442666d0459aa9a34fc2f91228e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:05.670523 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1d2e9-8356-4bc3-ae68-a2afd10ae0b4 service swift] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:05.670804 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1d2e9-8356-4bc3-ae68-a2afd10ae0b4 service swift] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:05.671075 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1d2e9-8356-4bc3-ae68-a2afd10ae0b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:05.679578 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1d2e9-8356-4bc3-ae68-a2afd10ae0b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:05.681201 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1d2e9-8356-4bc3-ae68-a2afd10ae0b4 service swift] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:05.690022 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1418/2844] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Mar 8 14:01:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 14:01:20.587172 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2092af5-6dd6-418d-b4e2-8a303689e3bc None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:20.587611 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2092af5-6dd6-418d-b4e2-8a303689e3bc None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:20.587728 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2092af5-6dd6-418d-b4e2-8a303689e3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:20.608561 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-b2092af5-6dd6-418d-b4e2-8a303689e3bc None None] MFA Rules not processed for user `817bcd2c5f6e4bceb049eeb122d4e432`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:20.609772 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-b2092af5-6dd6-418d-b4e2-8a303689e3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:20.617928 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1427/2845] 10.222.0.18 () {58 vars in 967 bytes} [Tue Mar 8 14:01:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:20.630521 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1d2e9-8356-4bc3-ae68-a2afd10ae0b4 service swift] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:20.642234 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1d2e9-8356-4bc3-ae68-a2afd10ae0b4 service swift] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:20.648024 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34809da-e33d-40e9-acdc-63f2fedae711 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a0f442666d0459aa9a34fc2f91228e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:20.648646 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34809da-e33d-40e9-acdc-63f2fedae711 service swift] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:20.648922 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34809da-e33d-40e9-acdc-63f2fedae711 service swift] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:20.649184 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34809da-e33d-40e9-acdc-63f2fedae711 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:20.657971 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34809da-e33d-40e9-acdc-63f2fedae711 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:20.659521 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34809da-e33d-40e9-acdc-63f2fedae711 service swift] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:20.667610 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1419/2846] 10.222.0.18 () {60 vars in 1384 bytes} [Tue Mar 8 14:01:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Mar 08 14:01:22.580633 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2092af5-6dd6-418d-b4e2-8a303689e3bc None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:22.582258 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-b2092af5-6dd6-418d-b4e2-8a303689e3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:22.648929 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2092af5-6dd6-418d-b4e2-8a303689e3bc None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:22.653790 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7eeb7-3528-4ad7-843b-794d3a0b550e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:22.654670 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7eeb7-3528-4ad7-843b-794d3a0b550e admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:22.654953 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7eeb7-3528-4ad7-843b-794d3a0b550e admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:22.655230 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7eeb7-3528-4ad7-843b-794d3a0b550e admin admin] PATH_INFO: `/v3/users/c4d0e298e5cf4e5db4f2b10cdc1271fa` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:22.656451 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7eeb7-3528-4ad7-843b-794d3a0b550e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4d0e298e5cf4e5db4f2b10cdc1271fa)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:22.658457 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7eeb7-3528-4ad7-843b-794d3a0b550e admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:22.705713 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8ab7eeb7-3528-4ad7-843b-794d3a0b550e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4d0e298e5cf4e5db4f2b10cdc1271fa'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:22.706380 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8ab7eeb7-3528-4ad7-843b-794d3a0b550e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4d0e298e5cf4e5db4f2b10cdc1271fa'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:22.714577 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8ab7eeb7-3528-4ad7-843b-794d3a0b550e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4d0e298e5cf4e5db4f2b10cdc1271fa'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:22.721639 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8ab7eeb7-3528-4ad7-843b-794d3a0b550e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4d0e298e5cf4e5db4f2b10cdc1271fa'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:22.733150 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-8ab7eeb7-3528-4ad7-843b-794d3a0b550e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4d0e298e5cf4e5db4f2b10cdc1271fa'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:22.738914 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1428/2847] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 14:01:22 2022] DELETE /identity/v3/users/c4d0e298e5cf4e5db4f2b10cdc1271fa => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:22.907336 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34809da-e33d-40e9-acdc-63f2fedae711 service swift] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:22.918409 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34809da-e33d-40e9-acdc-63f2fedae711 service swift] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:22.980201 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155d81b-8e43-46dd-a407-2f11766a601b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:22.981413 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155d81b-8e43-46dd-a407-2f11766a601b admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:22.981767 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155d81b-8e43-46dd-a407-2f11766a601b admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:22.982127 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155d81b-8e43-46dd-a407-2f11766a601b admin admin] PATH_INFO: `/v3/projects/f88f77257ee74eb8b7644e3da5f76ebe` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:22.984036 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155d81b-8e43-46dd-a407-2f11766a601b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f88f77257ee74eb8b7644e3da5f76ebe)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:22.986525 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155d81b-8e43-46dd-a407-2f11766a601b admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:23.037120 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-7155d81b-8e43-46dd-a407-2f11766a601b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f88f77257ee74eb8b7644e3da5f76ebe', 'request_id': 'req-7155d81b-8e43-46dd-a407-2f11766a601b'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:23.046883 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-7155d81b-8e43-46dd-a407-2f11766a601b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f88f77257ee74eb8b7644e3da5f76ebe', 'request_id': 'req-7155d81b-8e43-46dd-a407-2f11766a601b'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:23.057623 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-7155d81b-8e43-46dd-a407-2f11766a601b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f88f77257ee74eb8b7644e3da5f76ebe', 'request_id': 'req-7155d81b-8e43-46dd-a407-2f11766a601b'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:23.068102 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-7155d81b-8e43-46dd-a407-2f11766a601b admin admin] The token cache is being invalidate because project f88f77257ee74eb8b7644e3da5f76ebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:01:23.068396 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-7155d81b-8e43-46dd-a407-2f11766a601b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:23.069071 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-7155d81b-8e43-46dd-a407-2f11766a601b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:23.070717 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1420/2848] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 14:01:22 2022] DELETE /identity/v3/projects/f88f77257ee74eb8b7644e3da5f76ebe => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:23.076118 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd842d8-28da-4270-b80f-ad482aff7864 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:23.076407 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd842d8-28da-4270-b80f-ad482aff7864 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:23.076804 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd842d8-28da-4270-b80f-ad482aff7864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:23.095965 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-abd842d8-28da-4270-b80f-ad482aff7864 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:23.097145 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-abd842d8-28da-4270-b80f-ad482aff7864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:23.157521 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1429/2849] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:23.165347 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edee53-e4e8-4413-a739-877140dd70de None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:23.165660 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edee53-e4e8-4413-a739-877140dd70de None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:23.165959 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87edee53-e4e8-4413-a739-877140dd70de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:23.190342 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-87edee53-e4e8-4413-a739-877140dd70de None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:23.191543 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-87edee53-e4e8-4413-a739-877140dd70de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:23.200613 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1421/2850] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:23.205081 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd842d8-28da-4270-b80f-ad482aff7864 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:23.215211 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd842d8-28da-4270-b80f-ad482aff7864 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:23.221220 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ee63a-793f-4fce-b2db-1bee107a5c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:23.221961 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ee63a-793f-4fce-b2db-1bee107a5c13 admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:23.222310 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ee63a-793f-4fce-b2db-1bee107a5c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:23.222685 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ee63a-793f-4fce-b2db-1bee107a5c13 admin admin] PATH_INFO: `/v3/domains` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:23.223620 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ee63a-793f-4fce-b2db-1bee107a5c13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=91153) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Mar 08 14:01:23.223929 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ee63a-793f-4fce-b2db-1bee107a5c13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:23.225606 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ee63a-793f-4fce-b2db-1bee107a5c13 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:23.237740 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1430/2851] 10.222.0.18 () {58 vars in 1152 bytes} [Tue Mar 8 14:01:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Mar 08 14:01:23.242305 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edee53-e4e8-4413-a739-877140dd70de None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:23.251739 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87edee53-e4e8-4413-a739-877140dd70de None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:23.256799 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6a9e8-197e-4d7b-9df2-55382823ee72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:23.257497 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6a9e8-197e-4d7b-9df2-55382823ee72 admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:23.257791 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6a9e8-197e-4d7b-9df2-55382823ee72 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:23.258063 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a6a9e8-197e-4d7b-9df2-55382823ee72 admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:23.258750 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6a9e8-197e-4d7b-9df2-55382823ee72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:23.260596 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a6a9e8-197e-4d7b-9df2-55382823ee72 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:23.287287 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1422/2852] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 14:01:23 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:01:23.292963 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ee63a-793f-4fce-b2db-1bee107a5c13 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:23.308321 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ee63a-793f-4fce-b2db-1bee107a5c13 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:23.364668 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde603d-d75b-4028-9f77-4535bd4f06de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:23.365329 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde603d-d75b-4028-9f77-4535bd4f06de admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:23.365638 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde603d-d75b-4028-9f77-4535bd4f06de admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:23.365910 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde603d-d75b-4028-9f77-4535bd4f06de admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:23.366586 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde603d-d75b-4028-9f77-4535bd4f06de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:23.368471 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde603d-d75b-4028-9f77-4535bd4f06de admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:23.391475 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1431/2853] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 14:01:23 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:01:23.395711 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6a9e8-197e-4d7b-9df2-55382823ee72 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:23.406350 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a6a9e8-197e-4d7b-9df2-55382823ee72 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:23.411999 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0f1dd-7c9c-488c-95d6-d5d72c36f647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:23.412593 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0f1dd-7c9c-488c-95d6-d5d72c36f647 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:23.412870 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0f1dd-7c9c-488c-95d6-d5d72c36f647 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:23.413138 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0f1dd-7c9c-488c-95d6-d5d72c36f647 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:23.413903 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c0f1dd-7c9c-488c-95d6-d5d72c36f647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:23.415486 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c0f1dd-7c9c-488c-95d6-d5d72c36f647 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:23.426026 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1423/2854] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 14:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:01:23.429896 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde603d-d75b-4028-9f77-4535bd4f06de admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:23.440184 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde603d-d75b-4028-9f77-4535bd4f06de admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:23.445879 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf89875-9cbb-472c-b931-83206509d8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:23.446523 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf89875-9cbb-472c-b931-83206509d8cc admin admin] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:23.446796 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf89875-9cbb-472c-b931-83206509d8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:23.447058 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf89875-9cbb-472c-b931-83206509d8cc admin admin] PATH_INFO: `/v3/roles` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:23.447775 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf89875-9cbb-472c-b931-83206509d8cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:23.449375 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf89875-9cbb-472c-b931-83206509d8cc admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:23.459429 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1432/2855] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 14:01:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:01:23.463505 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0f1dd-7c9c-488c-95d6-d5d72c36f647 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:23.474565 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0f1dd-7c9c-488c-95d6-d5d72c36f647 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:23.480192 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfcac8-2648-4ed7-b6b4-8fee88a256e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:23.481080 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfcac8-2648-4ed7-b6b4-8fee88a256e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:23.481425 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfcac8-2648-4ed7-b6b4-8fee88a256e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:23.481700 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfcac8-2648-4ed7-b6b4-8fee88a256e9 admin admin] PATH_INFO: `/v3/projects/f1b44df5d14a42e9a7fac13e1e908b53/users/1ec083ddf72d4522b3dddca1aa7b08b0/roles/0010e8da2d4b4bb8af05894096d2fc92` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:23.496309 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfcac8-2648-4ed7-b6b4-8fee88a256e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b44df5d14a42e9a7fac13e1e908b53, user_id=1ec083ddf72d4522b3dddca1aa7b08b0, role_id=0010e8da2d4b4bb8af05894096d2fc92)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:23.498950 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfcac8-2648-4ed7-b6b4-8fee88a256e9 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:23.513392 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1424/2856] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 14:01:23 2022] PUT /identity/v3/projects/f1b44df5d14a42e9a7fac13e1e908b53/users/1ec083ddf72d4522b3dddca1aa7b08b0/roles/0010e8da2d4b4bb8af05894096d2fc92 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:23.518787 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db42dd4-d3f5-4298-9955-0be785b115a6 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:23.519079 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db42dd4-d3f5-4298-9955-0be785b115a6 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:23.519383 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db42dd4-d3f5-4298-9955-0be785b115a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:23.537513 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-5db42dd4-d3f5-4298-9955-0be785b115a6 None None] MFA Rules not processed for user `9e52ccf157d64bf8a84675f802b2f178`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:23.538719 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-5db42dd4-d3f5-4298-9955-0be785b115a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:23.597332 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1433/2857] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:23.607303 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfcac8-2648-4ed7-b6b4-8fee88a256e9 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:23.609208 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-9fbfcac8-2648-4ed7-b6b4-8fee88a256e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:23.667048 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfcac8-2648-4ed7-b6b4-8fee88a256e9 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:23.671419 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9d019-ecd7-4449-8892-f31de9b9f98d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:23.672065 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9d019-ecd7-4449-8892-f31de9b9f98d service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:23.672344 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9d019-ecd7-4449-8892-f31de9b9f98d service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:23.672632 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f9d019-ecd7-4449-8892-f31de9b9f98d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:23.682403 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f9d019-ecd7-4449-8892-f31de9b9f98d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:23.683877 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f9d019-ecd7-4449-8892-f31de9b9f98d service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:23.693482 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1425/2858] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:01:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:01:27.774343 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ae8eb-dffe-44b7-8d72-7aae0e7950ae None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:27.774854 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ae8eb-dffe-44b7-8d72-7aae0e7950ae None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:27.775096 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ae8eb-dffe-44b7-8d72-7aae0e7950ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:27.803148 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-dd4ae8eb-dffe-44b7-8d72-7aae0e7950ae None None] MFA Rules not processed for user `1ec083ddf72d4522b3dddca1aa7b08b0`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:27.804448 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-dd4ae8eb-dffe-44b7-8d72-7aae0e7950ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:27.873775 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1434/2859] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:01:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:27.878309 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9d019-ecd7-4449-8892-f31de9b9f98d service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:27.888468 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f9d019-ecd7-4449-8892-f31de9b9f98d service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:27.893198 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f345c1-8da3-41a9-8256-5ecd64e8761d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:27.893889 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f345c1-8da3-41a9-8256-5ecd64e8761d admin admin] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:27.894169 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f345c1-8da3-41a9-8256-5ecd64e8761d admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:27.894440 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f345c1-8da3-41a9-8256-5ecd64e8761d admin admin] PATH_INFO: `/v3/projects` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:27.895134 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f345c1-8da3-41a9-8256-5ecd64e8761d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:27.897054 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f345c1-8da3-41a9-8256-5ecd64e8761d admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:27.928389 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1426/2860] 10.222.0.18 () {60 vars in 1152 bytes} [Tue Mar 8 14:01:27 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Mar 08 14:01:27.929730 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ae8eb-dffe-44b7-8d72-7aae0e7950ae None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:27.940588 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ae8eb-dffe-44b7-8d72-7aae0e7950ae None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:27.996180 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e55950-3753-44d3-86b7-5ab1f9ece09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:27.996902 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e55950-3753-44d3-86b7-5ab1f9ece09d admin admin] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:27.997207 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e55950-3753-44d3-86b7-5ab1f9ece09d admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:27.997515 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e55950-3753-44d3-86b7-5ab1f9ece09d admin admin] PATH_INFO: `/v3/users` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:27.998214 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e55950-3753-44d3-86b7-5ab1f9ece09d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:28.000130 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e55950-3753-44d3-86b7-5ab1f9ece09d admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:28.021114 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1435/2861] 10.222.0.18 () {60 vars in 1143 bytes} [Tue Mar 8 14:01:27 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Mar 08 14:01:28.025276 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f345c1-8da3-41a9-8256-5ecd64e8761d admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:28.035949 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f345c1-8da3-41a9-8256-5ecd64e8761d admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:28.040778 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7e4f7-db10-43ee-9259-be3ae251791a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:28.041503 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7e4f7-db10-43ee-9259-be3ae251791a admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:28.041788 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7e4f7-db10-43ee-9259-be3ae251791a admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:28.042071 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7e4f7-db10-43ee-9259-be3ae251791a admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:28.042810 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7e4f7-db10-43ee-9259-be3ae251791a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:28.044545 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7e4f7-db10-43ee-9259-be3ae251791a admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:28.055643 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1427/2862] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 14:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:01:28.060020 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e55950-3753-44d3-86b7-5ab1f9ece09d admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:28.070255 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e55950-3753-44d3-86b7-5ab1f9ece09d admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:28.074915 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f10d4c-d466-4287-82b5-2c51391b7d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:28.075882 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f10d4c-d466-4287-82b5-2c51391b7d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:28.076159 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f10d4c-d466-4287-82b5-2c51391b7d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:28.076430 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f10d4c-d466-4287-82b5-2c51391b7d2b admin admin] PATH_INFO: `/v3/projects/8ed129a30ced41a0a6a2b7e0a0d0195f/users/c9cfed76204c4e5ebef8bd8584db21c8/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:28.092753 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f10d4c-d466-4287-82b5-2c51391b7d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ed129a30ced41a0a6a2b7e0a0d0195f, user_id=c9cfed76204c4e5ebef8bd8584db21c8, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:28.095857 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f10d4c-d466-4287-82b5-2c51391b7d2b admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:28.110369 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1436/2863] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 14:01:28 2022] PUT /identity/v3/projects/8ed129a30ced41a0a6a2b7e0a0d0195f/users/c9cfed76204c4e5ebef8bd8584db21c8/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:28.114568 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7e4f7-db10-43ee-9259-be3ae251791a admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:28.124717 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7e4f7-db10-43ee-9259-be3ae251791a admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:28.180931 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7095ba2-2eab-41a9-854c-9a6253b3c176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:28.181643 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7095ba2-2eab-41a9-854c-9a6253b3c176 admin admin] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:28.181953 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7095ba2-2eab-41a9-854c-9a6253b3c176 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:28.182225 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7095ba2-2eab-41a9-854c-9a6253b3c176 admin admin] PATH_INFO: `/v3/roles` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:28.182954 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7095ba2-2eab-41a9-854c-9a6253b3c176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:28.184559 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7095ba2-2eab-41a9-854c-9a6253b3c176 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:28.194830 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1428/2864] 10.222.0.18 () {58 vars in 1121 bytes} [Tue Mar 8 14:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Mar 08 14:01:28.199088 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f10d4c-d466-4287-82b5-2c51391b7d2b admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:28.209576 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f10d4c-d466-4287-82b5-2c51391b7d2b admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:28.214028 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa606d4c-a605-4418-8852-84923ab67775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:28.214905 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa606d4c-a605-4418-8852-84923ab67775 admin admin] REQUEST_METHOD: `PUT` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:28.215182 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa606d4c-a605-4418-8852-84923ab67775 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:28.215452 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa606d4c-a605-4418-8852-84923ab67775 admin admin] PATH_INFO: `/v3/projects/8ed129a30ced41a0a6a2b7e0a0d0195f/users/c9cfed76204c4e5ebef8bd8584db21c8/roles/fc021ed5870a44f5a0f0b8fff994d6f0` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:28.217463 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa606d4c-a605-4418-8852-84923ab67775 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ed129a30ced41a0a6a2b7e0a0d0195f, user_id=c9cfed76204c4e5ebef8bd8584db21c8, role_id=fc021ed5870a44f5a0f0b8fff994d6f0)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:28.220422 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa606d4c-a605-4418-8852-84923ab67775 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:28.230230 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1437/2865] 10.222.0.18 () {60 vars in 1482 bytes} [Tue Mar 8 14:01:28 2022] PUT /identity/v3/projects/8ed129a30ced41a0a6a2b7e0a0d0195f/users/c9cfed76204c4e5ebef8bd8584db21c8/roles/fc021ed5870a44f5a0f0b8fff994d6f0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:32.857476 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb9363-101d-43c0-827e-6b56f6e03146 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:32.858741 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb9363-101d-43c0-827e-6b56f6e03146 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:32.859101 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb9363-101d-43c0-827e-6b56f6e03146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:32.888443 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-ebcb9363-101d-43c0-827e-6b56f6e03146 None None] MFA Rules not processed for user `c9cfed76204c4e5ebef8bd8584db21c8`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:32.890870 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-ebcb9363-101d-43c0-827e-6b56f6e03146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:32.983669 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1429/2866] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:01:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:32.995489 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa606d4c-a605-4418-8852-84923ab67775 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:32.997607 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-aa606d4c-a605-4418-8852-84923ab67775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:33.081965 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa606d4c-a605-4418-8852-84923ab67775 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:33.091547 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3294a-7f30-4c3c-b39a-1e2956598a3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:33.092440 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3294a-7f30-4c3c-b39a-1e2956598a3c service nova] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:33.092821 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3294a-7f30-4c3c-b39a-1e2956598a3c service nova] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:33.093198 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c3294a-7f30-4c3c-b39a-1e2956598a3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:33.156303 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3294a-7f30-4c3c-b39a-1e2956598a3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:33.158164 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c3294a-7f30-4c3c-b39a-1e2956598a3c service nova] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:33.168534 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1438/2867] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:01:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:01:39.855263 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb9363-101d-43c0-827e-6b56f6e03146 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:39.911485 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb9363-101d-43c0-827e-6b56f6e03146 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:39.915422 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602a43f-4b9c-4fb7-94bd-a60b48f10488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:39.916144 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602a43f-4b9c-4fb7-94bd-a60b48f10488 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:39.916421 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602a43f-4b9c-4fb7-94bd-a60b48f10488 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:39.916693 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602a43f-4b9c-4fb7-94bd-a60b48f10488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:39.918670 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-9602a43f-4b9c-4fb7-94bd-a60b48f10488 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:39.998960 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602a43f-4b9c-4fb7-94bd-a60b48f10488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:40.000377 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602a43f-4b9c-4fb7-94bd-a60b48f10488 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:40.010656 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1430/2868] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:01:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:01:46.648133 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3294a-7f30-4c3c-b39a-1e2956598a3c service nova] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:46.649687 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-19c3294a-7f30-4c3c-b39a-1e2956598a3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:46.664312 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c3294a-7f30-4c3c-b39a-1e2956598a3c service nova] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:46.669302 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de0a24-1dce-40ea-977a-1f1842378dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:46.670332 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de0a24-1dce-40ea-977a-1f1842378dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:46.670548 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de0a24-1dce-40ea-977a-1f1842378dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:46.670822 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de0a24-1dce-40ea-977a-1f1842378dd6 admin admin] PATH_INFO: `/v3/users/6861ddcf71654113915e209c1f34999b` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:46.672055 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de0a24-1dce-40ea-977a-1f1842378dd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6861ddcf71654113915e209c1f34999b)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:46.674002 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de0a24-1dce-40ea-977a-1f1842378dd6 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:46.719584 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-81de0a24-1dce-40ea-977a-1f1842378dd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6861ddcf71654113915e209c1f34999b'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:46.720302 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-81de0a24-1dce-40ea-977a-1f1842378dd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6861ddcf71654113915e209c1f34999b'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:46.727928 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-81de0a24-1dce-40ea-977a-1f1842378dd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6861ddcf71654113915e209c1f34999b'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:46.735307 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-81de0a24-1dce-40ea-977a-1f1842378dd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6861ddcf71654113915e209c1f34999b'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:46.747287 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-81de0a24-1dce-40ea-977a-1f1842378dd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6861ddcf71654113915e209c1f34999b'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:46.753692 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1439/2869] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 14:01:46 2022] DELETE /identity/v3/users/6861ddcf71654113915e209c1f34999b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:46.930723 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602a43f-4b9c-4fb7-94bd-a60b48f10488 service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:46.941741 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602a43f-4b9c-4fb7-94bd-a60b48f10488 service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:47.002075 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48879b8-0078-4ccd-a7b5-9a3e29a708ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:47.002969 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48879b8-0078-4ccd-a7b5-9a3e29a708ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:47.003246 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48879b8-0078-4ccd-a7b5-9a3e29a708ba admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:47.003517 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48879b8-0078-4ccd-a7b5-9a3e29a708ba admin admin] PATH_INFO: `/v3/projects/34f980e7a3e94d7ca2edd7cf4e17633c` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:47.004674 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48879b8-0078-4ccd-a7b5-9a3e29a708ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=34f980e7a3e94d7ca2edd7cf4e17633c)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:47.006585 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48879b8-0078-4ccd-a7b5-9a3e29a708ba admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:47.052882 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a48879b8-0078-4ccd-a7b5-9a3e29a708ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34f980e7a3e94d7ca2edd7cf4e17633c', 'request_id': 'req-a48879b8-0078-4ccd-a7b5-9a3e29a708ba'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:47.058865 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a48879b8-0078-4ccd-a7b5-9a3e29a708ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34f980e7a3e94d7ca2edd7cf4e17633c', 'request_id': 'req-a48879b8-0078-4ccd-a7b5-9a3e29a708ba'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:47.066971 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a48879b8-0078-4ccd-a7b5-9a3e29a708ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34f980e7a3e94d7ca2edd7cf4e17633c', 'request_id': 'req-a48879b8-0078-4ccd-a7b5-9a3e29a708ba'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:47.077311 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a48879b8-0078-4ccd-a7b5-9a3e29a708ba admin admin] The token cache is being invalidate because project 34f980e7a3e94d7ca2edd7cf4e17633c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:01:47.077642 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a48879b8-0078-4ccd-a7b5-9a3e29a708ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:47.078254 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-a48879b8-0078-4ccd-a7b5-9a3e29a708ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:47.079768 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1431/2870] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 14:01:46 2022] DELETE /identity/v3/projects/34f980e7a3e94d7ca2edd7cf4e17633c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:47.083962 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de0a24-1dce-40ea-977a-1f1842378dd6 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:47.085389 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-81de0a24-1dce-40ea-977a-1f1842378dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:47.098901 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de0a24-1dce-40ea-977a-1f1842378dd6 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:47.161779 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f1b7b-8095-4302-88e9-23906ba0de81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:47.162659 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f1b7b-8095-4302-88e9-23906ba0de81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:47.162936 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f1b7b-8095-4302-88e9-23906ba0de81 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:47.163199 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f1b7b-8095-4302-88e9-23906ba0de81 admin admin] PATH_INFO: `/v3/users/e318ef345c7d46fc9aeb82bdcf519de8` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:47.164434 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f1b7b-8095-4302-88e9-23906ba0de81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e318ef345c7d46fc9aeb82bdcf519de8)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:47.166411 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f1b7b-8095-4302-88e9-23906ba0de81 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:47.213157 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-310f1b7b-8095-4302-88e9-23906ba0de81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e318ef345c7d46fc9aeb82bdcf519de8'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:47.213837 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-310f1b7b-8095-4302-88e9-23906ba0de81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e318ef345c7d46fc9aeb82bdcf519de8'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:47.222763 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-310f1b7b-8095-4302-88e9-23906ba0de81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e318ef345c7d46fc9aeb82bdcf519de8'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:47.229611 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-310f1b7b-8095-4302-88e9-23906ba0de81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e318ef345c7d46fc9aeb82bdcf519de8'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:47.240604 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-310f1b7b-8095-4302-88e9-23906ba0de81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e318ef345c7d46fc9aeb82bdcf519de8'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:47.246304 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1440/2871] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 14:01:47 2022] DELETE /identity/v3/users/e318ef345c7d46fc9aeb82bdcf519de8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:01:47.436061 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48879b8-0078-4ccd-a7b5-9a3e29a708ba admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:47.437615 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-a48879b8-0078-4ccd-a7b5-9a3e29a708ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:47.450677 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48879b8-0078-4ccd-a7b5-9a3e29a708ba admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:47.507775 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51517d6c-30b0-48ac-99d9-266942228786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:47.508643 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51517d6c-30b0-48ac-99d9-266942228786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:47.508928 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51517d6c-30b0-48ac-99d9-266942228786 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:47.509202 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51517d6c-30b0-48ac-99d9-266942228786 admin admin] PATH_INFO: `/v3/projects/bb5d65b8049640b68446c765a4db82e4` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:47.510415 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51517d6c-30b0-48ac-99d9-266942228786 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb5d65b8049640b68446c765a4db82e4)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:47.512300 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51517d6c-30b0-48ac-99d9-266942228786 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:47.558230 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-51517d6c-30b0-48ac-99d9-266942228786 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb5d65b8049640b68446c765a4db82e4', 'request_id': 'req-51517d6c-30b0-48ac-99d9-266942228786'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:47.564366 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-51517d6c-30b0-48ac-99d9-266942228786 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb5d65b8049640b68446c765a4db82e4', 'request_id': 'req-51517d6c-30b0-48ac-99d9-266942228786'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:47.573039 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-51517d6c-30b0-48ac-99d9-266942228786 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb5d65b8049640b68446c765a4db82e4', 'request_id': 'req-51517d6c-30b0-48ac-99d9-266942228786'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:47.583820 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-51517d6c-30b0-48ac-99d9-266942228786 admin admin] The token cache is being invalidate because project bb5d65b8049640b68446c765a4db82e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91154) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:01:47.584109 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-51517d6c-30b0-48ac-99d9-266942228786 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:47.584772 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-51517d6c-30b0-48ac-99d9-266942228786 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:01:47.586599 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1432/2872] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 14:01:47 2022] DELETE /identity/v3/projects/bb5d65b8049640b68446c765a4db82e4 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Mar 08 14:01:49.604380 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351cab7-f937-41e6-a2cc-ad91defe4323 None None] REQUEST_METHOD: `POST` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:49.604905 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351cab7-f937-41e6-a2cc-ad91defe4323 None None] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:49.604905 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351cab7-f937-41e6-a2cc-ad91defe4323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:49.625272 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.auth.core [None req-d351cab7-f937-41e6-a2cc-ad91defe4323 None None] MFA Rules not processed for user `1ec083ddf72d4522b3dddca1aa7b08b0`. Rule list: `[]` (Enabled: `True`). {{(pid=91153) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:01:49.626483 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-d351cab7-f937-41e6-a2cc-ad91defe4323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:49.687510 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1441/2873] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:01:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:01:50.026741 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51517d6c-30b0-48ac-99d9-266942228786 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:01:50.028412 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-51517d6c-30b0-48ac-99d9-266942228786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:50.102414 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51517d6c-30b0-48ac-99d9-266942228786 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:01:50.107009 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69b65d-8def-4c8c-9ed4-6210194464ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:01:50.107679 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69b65d-8def-4c8c-9ed4-6210194464ed service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:01:50.107958 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69b65d-8def-4c8c-9ed4-6210194464ed service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:01:50.108232 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69b65d-8def-4c8c-9ed4-6210194464ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:01:50.110242 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-ac69b65d-8def-4c8c-9ed4-6210194464ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:01:50.120159 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69b65d-8def-4c8c-9ed4-6210194464ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:01:50.121588 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69b65d-8def-4c8c-9ed4-6210194464ed service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:01:50.129875 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1433/2874] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:01:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:02:03.556618 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351cab7-f937-41e6-a2cc-ad91defe4323 None None] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:02:03.558616 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-d351cab7-f937-41e6-a2cc-ad91defe4323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:02:03.574277 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351cab7-f937-41e6-a2cc-ad91defe4323 None None] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:02:03.578823 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf066993-ef27-449a-a2b0-d4485fcf46e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:02:03.579459 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf066993-ef27-449a-a2b0-d4485fcf46e1 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:03.579736 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf066993-ef27-449a-a2b0-d4485fcf46e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:03.580000 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf066993-ef27-449a-a2b0-d4485fcf46e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:03.582157 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-bf066993-ef27-449a-a2b0-d4485fcf46e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:02:03.660290 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf066993-ef27-449a-a2b0-d4485fcf46e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:02:03.661824 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf066993-ef27-449a-a2b0-d4485fcf46e1 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:02:03.673550 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1442/2875] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:02:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:02:05.175530 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69b65d-8def-4c8c-9ed4-6210194464ed service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:02:05.185505 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69b65d-8def-4c8c-9ed4-6210194464ed service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:02:05.189889 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2a35b-88a0-43aa-9364-e3837c928b96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:02:05.190521 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2a35b-88a0-43aa-9364-e3837c928b96 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:02:05.190801 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2a35b-88a0-43aa-9364-e3837c928b96 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:02:05.191071 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2a35b-88a0-43aa-9364-e3837c928b96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:02:05.193293 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-56d2a35b-88a0-43aa-9364-e3837c928b96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:02:05.257695 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2a35b-88a0-43aa-9364-e3837c928b96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:02:05.259113 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d2a35b-88a0-43aa-9364-e3837c928b96 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:02:05.271518 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1434/2876] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:02:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:03:11.003214 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf066993-ef27-449a-a2b0-d4485fcf46e1 service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:03:11.012739 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf066993-ef27-449a-a2b0-d4485fcf46e1 service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:03:11.017057 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551fd20-c7ba-4077-b661-1a67d467ee30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:03:11.017745 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551fd20-c7ba-4077-b661-1a67d467ee30 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:03:11.018022 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551fd20-c7ba-4077-b661-1a67d467ee30 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:03:11.018289 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551fd20-c7ba-4077-b661-1a67d467ee30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:03:11.020477 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-e551fd20-c7ba-4077-b661-1a67d467ee30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:03:11.030601 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551fd20-c7ba-4077-b661-1a67d467ee30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:03:11.032029 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551fd20-c7ba-4077-b661-1a67d467ee30 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:03:11.040308 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1443/2877] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:03:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:04:02.144457 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2a35b-88a0-43aa-9364-e3837c928b96 service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:04:02.155720 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2a35b-88a0-43aa-9364-e3837c928b96 service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:04:02.161465 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c9ded-c3df-4177-9ab2-2ca3f8cb9812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:04:02.162106 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c9ded-c3df-4177-9ab2-2ca3f8cb9812 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:04:02.162377 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c9ded-c3df-4177-9ab2-2ca3f8cb9812 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:04:02.162645 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c9ded-c3df-4177-9ab2-2ca3f8cb9812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:04:02.164713 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-3e6c9ded-c3df-4177-9ab2-2ca3f8cb9812 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:04:02.178157 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c9ded-c3df-4177-9ab2-2ca3f8cb9812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:04:02.179554 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c9ded-c3df-4177-9ab2-2ca3f8cb9812 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:04:02.190431 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1435/2878] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:04:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Mar 08 14:04:04.531533 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551fd20-c7ba-4077-b661-1a67d467ee30 service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:04:04.534310 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-e551fd20-c7ba-4077-b661-1a67d467ee30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:04:04.558764 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551fd20-c7ba-4077-b661-1a67d467ee30 service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:04:04.570913 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa842c-edb4-40ca-98e3-102d7174a246 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:04:04.571689 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa842c-edb4-40ca-98e3-102d7174a246 service nova] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:04:04.571891 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa842c-edb4-40ca-98e3-102d7174a246 service nova] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:04:04.572159 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa842c-edb4-40ca-98e3-102d7174a246 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:04:04.574243 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-05aa842c-edb4-40ca-98e3-102d7174a246 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:04:04.596876 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa842c-edb4-40ca-98e3-102d7174a246 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:04:04.598741 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa842c-edb4-40ca-98e3-102d7174a246 service nova] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:04:04.621115 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1444/2879] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:04:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:04:05.669872 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e8a0c-dacd-43b8-a626-d30ce59124bc None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:04:05.670397 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e8a0c-dacd-43b8-a626-d30ce59124bc None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:04:05.670507 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e8a0c-dacd-43b8-a626-d30ce59124bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:04:05.688660 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-997e8a0c-dacd-43b8-a626-d30ce59124bc None None] MFA Rules not processed for user `1ec083ddf72d4522b3dddca1aa7b08b0`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:04:05.689916 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-997e8a0c-dacd-43b8-a626-d30ce59124bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:04:05.697936 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1436/2880] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:04:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:04:06.026669 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa842c-edb4-40ca-98e3-102d7174a246 service nova] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:04:06.036964 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa842c-edb4-40ca-98e3-102d7174a246 service nova] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:04:06.040928 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a89c88-62ab-4553-bf51-32c057f22320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:04:06.041601 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a89c88-62ab-4553-bf51-32c057f22320 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:04:06.041878 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a89c88-62ab-4553-bf51-32c057f22320 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:04:06.042152 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a89c88-62ab-4553-bf51-32c057f22320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:04:06.043984 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-78a89c88-62ab-4553-bf51-32c057f22320 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:04:06.054245 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a89c88-62ab-4553-bf51-32c057f22320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:04:06.055658 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a89c88-62ab-4553-bf51-32c057f22320 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:04:06.064258 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1445/2881] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:04:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:04:06.538151 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e8a0c-dacd-43b8-a626-d30ce59124bc None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:04:06.539586 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-997e8a0c-dacd-43b8-a626-d30ce59124bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:04:06.609184 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e8a0c-dacd-43b8-a626-d30ce59124bc None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:04:06.614275 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e088e3c-2f4a-48d4-9aee-acd7f560e364 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2e8458589b45fa8c91b0d95840e45e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:04:06.614925 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e088e3c-2f4a-48d4-9aee-acd7f560e364 service placement] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:04:06.615207 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e088e3c-2f4a-48d4-9aee-acd7f560e364 service placement] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:04:06.615482 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e088e3c-2f4a-48d4-9aee-acd7f560e364 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:04:06.617279 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-0e088e3c-2f4a-48d4-9aee-acd7f560e364 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:04:06.628702 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e088e3c-2f4a-48d4-9aee-acd7f560e364 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:04:06.630339 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e088e3c-2f4a-48d4-9aee-acd7f560e364 service placement] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:04:06.640402 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1437/2882] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:04:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:04:17.901826 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a89c88-62ab-4553-bf51-32c057f22320 service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:04:17.916873 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a89c88-62ab-4553-bf51-32c057f22320 service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:04:17.922880 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456828a-e105-45ff-b5c4-1abbc0163e82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:04:17.923532 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456828a-e105-45ff-b5c4-1abbc0163e82 service nova] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:04:17.923866 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456828a-e105-45ff-b5c4-1abbc0163e82 service nova] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:04:17.924189 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0456828a-e105-45ff-b5c4-1abbc0163e82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:04:17.926197 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-0456828a-e105-45ff-b5c4-1abbc0163e82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:04:17.938992 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456828a-e105-45ff-b5c4-1abbc0163e82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:04:17.940662 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0456828a-e105-45ff-b5c4-1abbc0163e82 service nova] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:04:17.951276 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1446/2883] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:04:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:04:21.615394 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e088e3c-2f4a-48d4-9aee-acd7f560e364 service placement] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:04:21.628044 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e088e3c-2f4a-48d4-9aee-acd7f560e364 service placement] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:04:21.634520 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3edd63-fcae-40af-bc58-195a71fe199a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ec894123044d4382995791c74c587b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:04:21.635171 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3edd63-fcae-40af-bc58-195a71fe199a service nova] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:04:21.635470 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3edd63-fcae-40af-bc58-195a71fe199a service nova] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:04:21.635735 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3edd63-fcae-40af-bc58-195a71fe199a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:04:21.637855 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-3a3edd63-fcae-40af-bc58-195a71fe199a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:04:21.650145 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3edd63-fcae-40af-bc58-195a71fe199a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:04:21.651869 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3edd63-fcae-40af-bc58-195a71fe199a service nova] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:04:21.662352 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1438/2884] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:04:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:05:21.282707 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456828a-e105-45ff-b5c4-1abbc0163e82 service nova] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:05:21.284371 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-0456828a-e105-45ff-b5c4-1abbc0163e82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:05:21.370592 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0456828a-e105-45ff-b5c4-1abbc0163e82 service nova] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:05:21.376508 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8300f35-0cad-43b9-89f5-c104c416a2a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2e8458589b45fa8c91b0d95840e45e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:05:21.377141 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8300f35-0cad-43b9-89f5-c104c416a2a6 service placement] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:05:21.377442 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8300f35-0cad-43b9-89f5-c104c416a2a6 service placement] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:05:21.377712 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8300f35-0cad-43b9-89f5-c104c416a2a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:05:21.379524 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-a8300f35-0cad-43b9-89f5-c104c416a2a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:05:21.390936 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8300f35-0cad-43b9-89f5-c104c416a2a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:05:21.392505 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8300f35-0cad-43b9-89f5-c104c416a2a6 service placement] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:05:21.402350 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1447/2885] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:05:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:05:58.611357 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e34f6-500b-4089-8c4b-37639f03a205 None None] REQUEST_METHOD: `POST` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:05:58.611895 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e34f6-500b-4089-8c4b-37639f03a205 None None] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:05:58.611998 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e34f6-500b-4089-8c4b-37639f03a205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:05:58.632227 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.auth.core [None req-346e34f6-500b-4089-8c4b-37639f03a205 None None] MFA Rules not processed for user `1ec083ddf72d4522b3dddca1aa7b08b0`. Rule list: `[]` (Enabled: `True`). {{(pid=91154) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Mar 08 14:05:58.633467 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-346e34f6-500b-4089-8c4b-37639f03a205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:05:58.641639 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1439/2886] 10.222.0.18 () {58 vars in 957 bytes} [Tue Mar 8 14:05:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Mar 08 14:07:41.637063 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8300f35-0cad-43b9-89f5-c104c416a2a6 service placement] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:07:41.662642 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8300f35-0cad-43b9-89f5-c104c416a2a6 service placement] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:07:41.666679 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41454c88-dba4-4c36-89b0-aa0197a58dde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:07:41.667303 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41454c88-dba4-4c36-89b0-aa0197a58dde service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:07:41.667580 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41454c88-dba4-4c36-89b0-aa0197a58dde service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:07:41.667847 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41454c88-dba4-4c36-89b0-aa0197a58dde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:07:41.669781 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-41454c88-dba4-4c36-89b0-aa0197a58dde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:07:41.680820 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41454c88-dba4-4c36-89b0-aa0197a58dde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:07:41.682245 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41454c88-dba4-4c36-89b0-aa0197a58dde service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:07:41.691035 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1448/2887] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:07:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:07:43.910831 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e34f6-500b-4089-8c4b-37639f03a205 None None] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:07:43.921469 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e34f6-500b-4089-8c4b-37639f03a205 None None] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:07:43.925943 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4ba13-1cfd-44f8-805e-0bb40e75fa38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:07:43.926578 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4ba13-1cfd-44f8-805e-0bb40e75fa38 service neutron] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:07:43.926855 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4ba13-1cfd-44f8-805e-0bb40e75fa38 service neutron] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:07:43.927126 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4ba13-1cfd-44f8-805e-0bb40e75fa38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:07:43.944877 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4ba13-1cfd-44f8-805e-0bb40e75fa38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:07:43.946324 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4ba13-1cfd-44f8-805e-0bb40e75fa38 service neutron] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:07:43.967612 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1440/2888] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:07:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:07:55.104173 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41454c88-dba4-4c36-89b0-aa0197a58dde service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:07:55.112821 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41454c88-dba4-4c36-89b0-aa0197a58dde service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:07:55.117423 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88511ab9-31f7-4b90-a184-c7b6d3ec9545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c610d719b3049f98b95cc8e9bd56834', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:07:55.118117 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88511ab9-31f7-4b90-a184-c7b6d3ec9545 service neutron] REQUEST_METHOD: `GET` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:07:55.118400 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88511ab9-31f7-4b90-a184-c7b6d3ec9545 service neutron] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:07:55.118677 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88511ab9-31f7-4b90-a184-c7b6d3ec9545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:07:55.120672 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-88511ab9-31f7-4b90-a184-c7b6d3ec9545 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:07:55.208025 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88511ab9-31f7-4b90-a184-c7b6d3ec9545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:07:55.209476 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88511ab9-31f7-4b90-a184-c7b6d3ec9545 service neutron] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:07:55.229266 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1449/2889] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:07:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Mar 08 14:08:01.483622 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4ba13-1cfd-44f8-805e-0bb40e75fa38 service neutron] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:08:01.485145 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-9ef4ba13-1cfd-44f8-805e-0bb40e75fa38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:08:01.498786 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4ba13-1cfd-44f8-805e-0bb40e75fa38 service neutron] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:08:01.503222 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dda756-3376-4ce0-ab1f-dd370a254784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:08:01.504262 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dda756-3376-4ce0-ab1f-dd370a254784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:08:01.504552 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dda756-3376-4ce0-ab1f-dd370a254784 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:08:01.504825 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dda756-3376-4ce0-ab1f-dd370a254784 admin admin] PATH_INFO: `/v3/users/1ec083ddf72d4522b3dddca1aa7b08b0` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:08:01.506160 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dda756-3376-4ce0-ab1f-dd370a254784 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ec083ddf72d4522b3dddca1aa7b08b0)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:08:01.508144 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dda756-3376-4ce0-ab1f-dd370a254784 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:08:01.556574 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-b1dda756-3376-4ce0-ab1f-dd370a254784 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ec083ddf72d4522b3dddca1aa7b08b0'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:08:01.557255 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-b1dda756-3376-4ce0-ab1f-dd370a254784 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ec083ddf72d4522b3dddca1aa7b08b0'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:08:01.565621 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-b1dda756-3376-4ce0-ab1f-dd370a254784 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ec083ddf72d4522b3dddca1aa7b08b0'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:08:01.578287 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-b1dda756-3376-4ce0-ab1f-dd370a254784 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ec083ddf72d4522b3dddca1aa7b08b0'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:08:01.585641 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-b1dda756-3376-4ce0-ab1f-dd370a254784 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ec083ddf72d4522b3dddca1aa7b08b0'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:08:01.593984 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1441/2890] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 14:08:01 2022] DELETE /identity/v3/users/1ec083ddf72d4522b3dddca1aa7b08b0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:08:01.777190 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88511ab9-31f7-4b90-a184-c7b6d3ec9545 service neutron] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:08:01.787410 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88511ab9-31f7-4b90-a184-c7b6d3ec9545 service neutron] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:08:01.842527 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92018e1a-2c05-4ea6-a985-212cd0990ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:08:01.843380 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92018e1a-2c05-4ea6-a985-212cd0990ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:08:01.843650 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92018e1a-2c05-4ea6-a985-212cd0990ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:08:01.843918 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92018e1a-2c05-4ea6-a985-212cd0990ec4 admin admin] PATH_INFO: `/v3/projects/f1b44df5d14a42e9a7fac13e1e908b53` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:08:01.845079 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92018e1a-2c05-4ea6-a985-212cd0990ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1b44df5d14a42e9a7fac13e1e908b53)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:08:01.847052 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92018e1a-2c05-4ea6-a985-212cd0990ec4 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:08:01.899111 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-92018e1a-2c05-4ea6-a985-212cd0990ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1b44df5d14a42e9a7fac13e1e908b53', 'request_id': 'req-92018e1a-2c05-4ea6-a985-212cd0990ec4'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:08:01.905713 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-92018e1a-2c05-4ea6-a985-212cd0990ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1b44df5d14a42e9a7fac13e1e908b53', 'request_id': 'req-92018e1a-2c05-4ea6-a985-212cd0990ec4'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:08:01.914168 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-92018e1a-2c05-4ea6-a985-212cd0990ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1b44df5d14a42e9a7fac13e1e908b53', 'request_id': 'req-92018e1a-2c05-4ea6-a985-212cd0990ec4'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:08:01.925269 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-92018e1a-2c05-4ea6-a985-212cd0990ec4 admin admin] The token cache is being invalidate because project f1b44df5d14a42e9a7fac13e1e908b53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:08:01.925787 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-92018e1a-2c05-4ea6-a985-212cd0990ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:08:01.926610 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-92018e1a-2c05-4ea6-a985-212cd0990ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:08:01.928677 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1450/2891] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 14:08:01 2022] DELETE /identity/v3/projects/f1b44df5d14a42e9a7fac13e1e908b53 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:08:01.932688 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dda756-3376-4ce0-ab1f-dd370a254784 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:08:01.934094 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-b1dda756-3376-4ce0-ab1f-dd370a254784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:08:01.946937 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dda756-3376-4ce0-ab1f-dd370a254784 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:08:02.004987 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969be8f9-29f7-4170-8593-b6cc3ff29448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:08:02.005897 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969be8f9-29f7-4170-8593-b6cc3ff29448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:08:02.006178 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969be8f9-29f7-4170-8593-b6cc3ff29448 admin admin] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:08:02.006457 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969be8f9-29f7-4170-8593-b6cc3ff29448 admin admin] PATH_INFO: `/v3/users/c9cfed76204c4e5ebef8bd8584db21c8` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:08:02.007744 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969be8f9-29f7-4170-8593-b6cc3ff29448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9cfed76204c4e5ebef8bd8584db21c8)` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:08:02.009631 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969be8f9-29f7-4170-8593-b6cc3ff29448 admin admin] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:08:02.064643 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-969be8f9-29f7-4170-8593-b6cc3ff29448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9cfed76204c4e5ebef8bd8584db21c8'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:08:02.065333 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-969be8f9-29f7-4170-8593-b6cc3ff29448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9cfed76204c4e5ebef8bd8584db21c8'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:08:02.073803 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-969be8f9-29f7-4170-8593-b6cc3ff29448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9cfed76204c4e5ebef8bd8584db21c8'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:08:02.085264 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-969be8f9-29f7-4170-8593-b6cc3ff29448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9cfed76204c4e5ebef8bd8584db21c8'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:08:02.091871 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.notifications [None req-969be8f9-29f7-4170-8593-b6cc3ff29448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9cfed76204c4e5ebef8bd8584db21c8'} {{(pid=91154) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:08:02.097944 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1442/2892] 10.222.0.18 () {58 vars in 1223 bytes} [Tue Mar 8 14:08:01 2022] DELETE /identity/v3/users/c9cfed76204c4e5ebef8bd8584db21c8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:08:02.302270 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92018e1a-2c05-4ea6-a985-212cd0990ec4 admin admin] Authenticating user token {{(pid=91153) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:08:02.303775 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.fernet_utils [None req-92018e1a-2c05-4ea6-a985-212cd0990ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91153) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:08:02.317909 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92018e1a-2c05-4ea6-a985-212cd0990ec4 admin admin] Validating token access rules against request {{(pid=91153) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:08:02.376343 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435116d3-a255-4978-b150-210a68350161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e52ccf157d64bf8a84675f802b2f178', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5233956b7746bc8c923776ec1a970c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91153) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:08:02.377196 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435116d3-a255-4978-b150-210a68350161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:08:02.377513 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435116d3-a255-4978-b150-210a68350161 admin admin] SCRIPT_NAME: `/identity` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:08:02.377785 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435116d3-a255-4978-b150-210a68350161 admin admin] PATH_INFO: `/v3/projects/8ed129a30ced41a0a6a2b7e0a0d0195f` {{(pid=91153) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:08:02.379019 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435116d3-a255-4978-b150-210a68350161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ed129a30ced41a0a6a2b7e0a0d0195f)` {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:08:02.380908 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435116d3-a255-4978-b150-210a68350161 admin admin] RBAC: Authorization granted {{(pid=91153) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:08:02.427172 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-435116d3-a255-4978-b150-210a68350161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ed129a30ced41a0a6a2b7e0a0d0195f', 'request_id': 'req-435116d3-a255-4978-b150-210a68350161'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:08:02.433367 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-435116d3-a255-4978-b150-210a68350161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ed129a30ced41a0a6a2b7e0a0d0195f', 'request_id': 'req-435116d3-a255-4978-b150-210a68350161'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:08:02.441422 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-435116d3-a255-4978-b150-210a68350161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ed129a30ced41a0a6a2b7e0a0d0195f', 'request_id': 'req-435116d3-a255-4978-b150-210a68350161'} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:08:02.451218 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-435116d3-a255-4978-b150-210a68350161 admin admin] The token cache is being invalidate because project 8ed129a30ced41a0a6a2b7e0a0d0195f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=91153) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Mar 08 14:08:02.451495 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-435116d3-a255-4978-b150-210a68350161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:08:02.452143 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: DEBUG keystone.notifications [None req-435116d3-a255-4978-b150-210a68350161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=91153) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Mar 08 14:08:02.453986 dv-cinder-830092-2-iscsi devstack@keystone.service[91153]: [pid: 91153|app: 0|req: 1451/2893] 10.222.0.18 () {58 vars in 1232 bytes} [Tue Mar 8 14:08:02 2022] DELETE /identity/v3/projects/8ed129a30ced41a0a6a2b7e0a0d0195f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Mar 08 14:10:25.241004 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969be8f9-29f7-4170-8593-b6cc3ff29448 admin admin] Authenticating user token {{(pid=91154) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Mar 08 14:10:25.242820 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-969be8f9-29f7-4170-8593-b6cc3ff29448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:10:25.314701 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969be8f9-29f7-4170-8593-b6cc3ff29448 admin admin] Validating token access rules against request {{(pid=91154) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Mar 08 14:10:25.377984 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92b290-3685-448d-b378-12e00261f8fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e2e8458589b45fa8c91b0d95840e45e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7d693fb3e9fc4d82a0ed054f31f1e56e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=91154) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Mar 08 14:10:25.378640 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92b290-3685-448d-b378-12e00261f8fd service placement] REQUEST_METHOD: `GET` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Mar 08 14:10:25.378926 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92b290-3685-448d-b378-12e00261f8fd service placement] SCRIPT_NAME: `/identity` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Mar 08 14:10:25.379192 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92b290-3685-448d-b378-12e00261f8fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=91154) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Mar 08 14:10:25.381236 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.fernet_utils [None req-7c92b290-3685-448d-b378-12e00261f8fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=91154) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Mar 08 14:10:25.392407 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92b290-3685-448d-b378-12e00261f8fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Mar 08 14:10:25.394025 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92b290-3685-448d-b378-12e00261f8fd service placement] RBAC: Authorization granted {{(pid=91154) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Mar 08 14:10:25.403541 dv-cinder-830092-2-iscsi devstack@keystone.service[91154]: [pid: 91154|app: 0|req: 1443/2894] 10.222.0.18 () {60 vars in 1365 bytes} [Tue Mar 8 14:10:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)